-- Logs begin at Sat 2022-08-06 00:38:57 UTC, end at Sat 2022-08-06 01:51:42 UTC. -- Aug 06 01:19:00.094999 dv-cinder-852009-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 06 01:19:00.102890 dv-cinder-852009-1-smb devstack@keystone.service[80148]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 06 01:19:00.104914 dv-cinder-852009-1-smb devstack@keystone.service[80148]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 01:19:00 2022] *** Aug 06 01:19:00.104914 dv-cinder-852009-1-smb devstack@keystone.service[80148]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 01:19:00.105978 dv-cinder-852009-1-smb devstack@keystone.service[80148]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 01:19:00.105978 dv-cinder-852009-1-smb devstack@keystone.service[80148]: nodename: dv-cinder-852009-1-smb Aug 06 01:19:00.105978 dv-cinder-852009-1-smb devstack@keystone.service[80148]: machine: x86_64 Aug 06 01:19:00.105978 dv-cinder-852009-1-smb devstack@keystone.service[80148]: clock source: unix Aug 06 01:19:00.105978 dv-cinder-852009-1-smb devstack@keystone.service[80148]: pcre jit disabled Aug 06 01:19:00.105978 dv-cinder-852009-1-smb devstack@keystone.service[80148]: detected number of CPU cores: 4 Aug 06 01:19:00.105978 dv-cinder-852009-1-smb devstack@keystone.service[80148]: current working directory: / Aug 06 01:19:00.105978 dv-cinder-852009-1-smb devstack@keystone.service[80148]: detected binary path: /usr/bin/uwsgi-core Aug 06 01:19:00.105978 dv-cinder-852009-1-smb devstack@keystone.service[80148]: your processes number limit is 47680 Aug 06 01:19:00.105978 dv-cinder-852009-1-smb devstack@keystone.service[80148]: your memory page size is 4096 bytes Aug 06 01:19:00.106502 dv-cinder-852009-1-smb devstack@keystone.service[80148]: detected max file descriptor number: 2048 Aug 06 01:19:00.106502 dv-cinder-852009-1-smb devstack@keystone.service[80148]: lock engine: pthread robust mutexes Aug 06 01:19:00.106502 dv-cinder-852009-1-smb devstack@keystone.service[80148]: thunder lock: enabled Aug 06 01:19:00.106502 dv-cinder-852009-1-smb devstack@keystone.service[80148]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 06 01:19:00.106502 dv-cinder-852009-1-smb devstack@keystone.service[80148]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 01:19:00.145550 dv-cinder-852009-1-smb devstack@keystone.service[80148]: Python main interpreter initialized at 0x5627f79d09c0 Aug 06 01:19:00.145550 dv-cinder-852009-1-smb devstack@keystone.service[80148]: python threads support enabled Aug 06 01:19:00.145550 dv-cinder-852009-1-smb devstack@keystone.service[80148]: your server socket listen backlog is limited to 100 connections Aug 06 01:19:00.145550 dv-cinder-852009-1-smb devstack@keystone.service[80148]: your mercy for graceful operations on workers is 90 seconds Aug 06 01:19:00.145934 dv-cinder-852009-1-smb devstack@keystone.service[80148]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 01:19:00.146003 dv-cinder-852009-1-smb devstack@keystone.service[80148]: *** Operational MODE: preforking *** Aug 06 01:19:00.146230 dv-cinder-852009-1-smb devstack@keystone.service[80148]: *** uWSGI is running in multiple interpreter mode *** Aug 06 01:19:00.146230 dv-cinder-852009-1-smb devstack@keystone.service[80148]: spawned uWSGI master process (pid: 80148) Aug 06 01:19:00.146438 dv-cinder-852009-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 06 01:19:00.147001 dv-cinder-852009-1-smb devstack@keystone.service[80148]: spawned uWSGI worker 1 (pid: 80157, cores: 1) Aug 06 01:19:00.147337 dv-cinder-852009-1-smb devstack@keystone.service[80148]: spawned uWSGI worker 2 (pid: 80158, cores: 1) Aug 06 01:19:00.147489 dv-cinder-852009-1-smb devstack@keystone.service[80148]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 01:19:05.606452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:19:05.606452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: from cryptography.utils import int_from_bytes Aug 06 01:19:05.607269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:19:05.607269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: from cryptography.utils import int_from_bytes Aug 06 01:19:05.607698 dv-cinder-852009-1-smb devstack@keystone.service[80157]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:19:05.607698 dv-cinder-852009-1-smb devstack@keystone.service[80157]: from cryptography.utils import int_from_bytes Aug 06 01:19:05.607808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:19:05.607808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: from cryptography.utils import int_from_bytes Aug 06 01:19:05.656423 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 01:19:05.656576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 01:19:05.656576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 01:19:05.656738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 01:19:05.656738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] command line args: [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 01:19:05.656878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] command line args: [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 01:19:05.657025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 01:19:05.657162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 01:19:05.657252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ================================================================================ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 01:19:05.657336 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ================================================================================ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 01:19:05.657523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] admin_token = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.658129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] admin_token = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.658372 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] config_dir = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.658516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] config_dir = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.658596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.658711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.658824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] config_source = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.658903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] config_source = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.659012 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] debug = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.659101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] debug = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.659216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.659472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.659571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.659639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.659771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.659881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.659985 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.660089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.660227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.660333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.660446 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.660541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.660642 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_config_append = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.660737 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] log_config_append = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.660845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.660970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.660970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] log_dir = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.661172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_dir = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.661281 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] log_file = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.661383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.661504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.661587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.661711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.661788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.661904 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.661985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.662067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.662195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.662280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.662355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.662473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.662561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.662643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.662768 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.662851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.662931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.663055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.663184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.663275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.663349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.663498 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.663580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.663730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.663818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.663972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.664053 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.664213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.664299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.664481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.664576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.664995 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.665081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.665214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] publish_errors = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.665298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] publish_errors = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.665399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.665478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.665627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.665713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.665787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.665858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.666032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.666129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.666265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.666351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.666496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] standard_threads = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.666573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] standard_threads = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.666724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.666848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.666964 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.667042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.667138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.667223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.667296 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] use_journal = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.667375 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] use_journal = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.667454 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] use_json = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.667527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] use_json = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.667633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] use_stderr = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.667719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] use_stderr = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.667798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] use_syslog = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.667878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] use_syslog = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.668023 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.668102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:19:05.668272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.668351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.668505 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.668591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.668757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.668835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.669017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.669097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.669267 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.669357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.669502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.669586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.669744 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.669822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.669975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.670061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.670218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.670295 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.670458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.670535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.670700 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.670786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.670931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.671008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.671173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.671251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.671403 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.671489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.671645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.671726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.671887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.671969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.672121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.672276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.672363 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.672437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.672609 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.672695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.672849 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.672968 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.673663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.673811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.673952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.674103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.674208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.674281 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.674409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.674487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.674629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.674711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.674857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.674946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.675085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.675165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.675313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.675397 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.675544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.675624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.675787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.675865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.676028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.676106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.676254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.676340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.676480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.676562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.676720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.676799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.676982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.677067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.677221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.677301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.677463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.677541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.677695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.677929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.678014 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.678164 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.678242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.678392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.678545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.678622 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.678699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.678836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.678916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.679065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.679153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.679297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.679375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.679534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.679614 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.679763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.679862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.680000 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.680086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.680229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.680309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.680455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.680542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.680686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.680766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.680946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.681037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.681170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.681260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.681402 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.681480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.681636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.681715 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.681872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.681998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.682105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.682201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.682327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.682443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.682541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.682649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.682778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.682884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.683013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.683138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.683235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.683315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.683467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.683567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.683698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.683821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.683943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.684024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.684173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.684268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.684400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.684523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.684632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.684718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.684862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.684974 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.685142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.685222 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.685377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.685463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.685617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.685698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.685851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.685972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.686085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.686167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.686318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.686399 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.686549 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.686637 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.686786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.686866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.687021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.687103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.687259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.687380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.687493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.687573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.687726 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.687813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.687956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.688036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.688190 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.688271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.688423 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.688506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.688796 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.689400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.689563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.689859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.689962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.690047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.690200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.690282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.690454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.690534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.690704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.690788 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.690938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.691024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.691182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.691262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.691414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.691505 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.691645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.691727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.691876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.691956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.692102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.692197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.692331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.692413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.692564 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.692643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.692793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.692872 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.693058 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.693140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.693293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.693373 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.693540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.693621 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.693777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.693863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.694007 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.external = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.694086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.694237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.694326 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.694501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.694580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.694731 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.external = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.694811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.694963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.695054 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.password = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.695189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.token = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.695277 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.695426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.695516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.695660 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.695741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.password = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.695905 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.695993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.token = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.696135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.696216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.696367 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.696453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.696610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.696708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.696839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.696994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.697095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.697176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.697344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.697437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.697575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.697656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.697812 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.697893 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.698045 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.698135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.698289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.698370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.698523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.698604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.698757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.698845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.699001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.699082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.699237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.699384 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.699469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.699592 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.699741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.699821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.699978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.700059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.700228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.700320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.700468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.700548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.700722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.700803 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.700976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.701074 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.701214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.701296 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.701458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.701538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.701699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.701789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.701925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.702005 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.702166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.702248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.702400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.702489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.702627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.702715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.702872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.702954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.703106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.703196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.703341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.703428 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.703580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.703660 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.703811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.703907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.704056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.704137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.704319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.704407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.704695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.704779 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.705031 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.705115 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.705394 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.705476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.705644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.705728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.705884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.705967 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.706133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.706214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.706365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.706448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.706605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.706686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.706835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.706915 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.707068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.707152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.707315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.707395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.707554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.707666 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.707782 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.707868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.708032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.708115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.708275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.708359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.708520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.708602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.708766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.708846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.709029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.709124 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.709262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.709346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.709509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.709592 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.709741 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.709822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.709969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.710060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.710206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.710287 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.710434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.710514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.710676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.710758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.710906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.710987 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.711141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.711221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.711383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.711465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.711612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.711692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.711851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.711931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.712093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.712182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.712319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.712400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.712556 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.712643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.712783 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.712866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.713040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.713123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.713277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.713359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.713504 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.713587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.713739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.713820 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.713961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.714038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.714201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.714284 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.714438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.714521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.714664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.714745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.714893 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.714976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.715136 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.715218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.715365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.715446 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.715595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.715677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.715824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.715904 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.716055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.716144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.716283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.716367 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.716514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.716595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.716747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.716837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.716997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.717082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.717237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.717318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.717479 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.717572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.717712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.717793 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.717941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.718024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.718167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.718294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.718400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.718482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.718631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.718712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.718859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.718947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.719084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.719171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.719315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.719396 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.719550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.719640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.719779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.719860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.720070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.720279 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.720363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.720448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.720551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.720633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.720878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.721023 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.721142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.721237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.721379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.721460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.721614 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.721694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.721850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.721939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.722085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.722165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.722321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.722402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.722555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.722644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.722797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.722877 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.723026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.723106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.723265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.723353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.723498 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.723578 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.723733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.723814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.723969 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.724059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.724202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.724283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.724437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.724518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.724665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.724743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.724946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.725044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.725160 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.725242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.725388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.725477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.725625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.725706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.725864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.725946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.726109 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.726198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.726351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.726431 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.726584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.726664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.726828 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.726935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.727063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.727143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.727306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.727387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.727541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] role.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.727699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.727777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.727849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] role.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.728005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.728085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.728236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] role.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.728326 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.728480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] role.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.728561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.728711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.728797 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.728976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.729073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.729224 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.729306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.729467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.729547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.729710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.729796 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.729952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.730032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.730180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.730261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.730424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.730513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.730666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.730746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.730896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.730977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.731139 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.731221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.731382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.731536 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.731618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.731770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.731860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.732017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.732248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.732330 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.732489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.732570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.732732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.732814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.732992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.733077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.733241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.733322 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.733490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.733573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.733723 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.733803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.733953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.734035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.734186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.734268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.734416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.734497 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.734660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.734755 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.734894 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.734976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.735125 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.735206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.735367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.735457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.736131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.736219 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.736368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.736450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.736638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.736727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] token.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.736873 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.737023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.737129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.737211 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.737364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.737459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.737602 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.737684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.737851 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.737932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.738088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.738177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.738327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.738408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.738568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.738649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.738799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.738887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.739033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.739120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.739271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.739353 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.739505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.739595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.739738 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.739819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.739976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.740057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.740203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.740292 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.740445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.740526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.740690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.740771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.740934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.741032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.741182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.741277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.741471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.741553 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.741705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.741787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.741944 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.742036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.742176 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.742260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.742412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.742493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.742645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.742727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.742876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.742959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.743112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.743194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.743342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.743423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.743575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.743658 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.743804 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.743885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.744042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.744122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.744272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.744354 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.744505 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.744587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.744733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.744814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.744996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.745080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.745231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.745311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.745386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 01:19:05.745460 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.745692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.745927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:19:05.746097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 01:19:05.774927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.775151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.775377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.775519 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.775754 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.775980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.784157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.785386 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.813296 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.813522 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.814666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.814896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.866217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.866648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.916550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.916725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.916984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.917221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.980837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.981077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.981168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.981248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.981324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.981420 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.981500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.981621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.981706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.981837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.981921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:05.982049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.005294 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.005519 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.005608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.005738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.005838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.005953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.006041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.006163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.006246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.006371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.006456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.006577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.006659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.006787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.018374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.018638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.031008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.031278 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.031387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.031515 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.031617 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.031734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.031817 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.031946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.032029 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.032156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.032241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.032364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.032983 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.033160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:19:06.050795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.051004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 01:19:06.051262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.051346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.051471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 01:19:06.051554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 01:19:06.051768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.051851 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.051990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 01:19:06.052072 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.052254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.052346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.052499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.052580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.052750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.053039 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.062157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.062430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.062678 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.062762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.062950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.063033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.063212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.063488 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.070036 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.070566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.074819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.075097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.075270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.075378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.075548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.075654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.075826 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.075918 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.076103 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.076187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.076377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.076459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.076629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.076713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.076893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.077001 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.077186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.077280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.077445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.077534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.077708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.077970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.101346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.102166 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.102831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.103108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.103644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.103920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.107806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.108080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.108360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.108524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.108800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.109102 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.115709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.115986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.116474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.116755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.120109 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.120401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.120678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.120870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.120979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.121179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.121276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.121457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.121540 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.121741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.121822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.122021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.122104 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.122310 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.122576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.122847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.138133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.138413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.138984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.139258 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.142886 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.143611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.146084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.146377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.146773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.147065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.150782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.151463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.154181 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.154718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.157345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.158207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.158507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.158655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.158794 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.158971 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.159055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.159256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.159342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.159548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.159836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.160112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.175962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.176186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.176450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.176703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.176787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.177008 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.177274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.177532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.183582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.184639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.185154 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.185428 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.186231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.186502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.188245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.188525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.189471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.189751 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.189974 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.190118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.190251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.190440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.190760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.191033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.201434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.201707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.201981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.202254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.202505 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.202652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.202781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.202915 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.203044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.203171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.203297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.203576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.203855 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.204127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.219292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.220636 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.222354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.223652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.225318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.226618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.227724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.229068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.229263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.229544 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.229828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.230560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.230847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.231131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.236298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.237659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.237914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.239249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.240840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.241150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.241426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.241693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.242201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.242485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.242761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.243030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.249758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.250042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.250317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.251048 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.251888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.252162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.257734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.258006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.258280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.258550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.258819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.259069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:19:06.259199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.259327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.259454 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.259596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.259726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.259854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.259981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.260120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.260247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.260383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.260511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.260643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.260782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.260989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.261120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.261253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.261382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.261547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.261817 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.262083 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.262346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.262607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:19:06.295632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5627f79d09c0 pid: 80157 (default app) Aug 06 01:19:06.297196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5627f79d09c0 pid: 80158 (default app) Aug 06 01:19:06.299451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e41e5-6493-4889-a884-4db17cbf7f85 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:06.299744 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e41e5-6493-4889-a884-4db17cbf7f85 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:06.300018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e41e5-6493-4889-a884-4db17cbf7f85 None None] PATH_INFO: `/v3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:06.304192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Sat Aug 6 01:19:06 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:14.040367 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c919dca-d947-4bce-ba56-a410d062726a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:14.040949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c919dca-d947-4bce-ba56-a410d062726a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:14.040949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c919dca-d947-4bce-ba56-a410d062726a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:14.045361 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:14.050863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e740708-f1e0-4770-82db-837c0fb91e48 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:14.051293 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e740708-f1e0-4770-82db-837c0fb91e48 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:14.051416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e740708-f1e0-4770-82db-837c0fb91e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:14.120750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: INFO dbcounter [None req-8e740708-f1e0-4770-82db-837c0fb91e48 None None] Registered counter for database keystone Aug 06 01:19:14.139591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG oslo_db.sqlalchemy.engines [None req-8e740708-f1e0-4770-82db-837c0fb91e48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:19:14.146478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writer thread running {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:19:14.325651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG passlib.handlers.bcrypt [None req-8e740708-f1e0-4770-82db-837c0fb91e48 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80157) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 06 01:19:14.325994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG passlib.handlers.bcrypt [None req-8e740708-f1e0-4770-82db-837c0fb91e48 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80157) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 06 01:19:14.381156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8e740708-f1e0-4770-82db-837c0fb91e48 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:14.382759 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8e740708-f1e0-4770-82db-837c0fb91e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:14.511311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 06 01:19:14.643118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c919dca-d947-4bce-ba56-a410d062726a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:14.712710 dv-cinder-852009-1-smb devstack@keystone.service[80158]: INFO dbcounter [None req-5c919dca-d947-4bce-ba56-a410d062726a None None] Registered counter for database keystone Aug 06 01:19:14.733477 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG oslo_db.sqlalchemy.engines [None req-5c919dca-d947-4bce-ba56-a410d062726a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:19:14.740295 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writer thread running {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:19:14.860679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c919dca-d947-4bce-ba56-a410d062726a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:14.865032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a04b46-822b-48c2-a64a-23f448dddd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:14.865679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a04b46-822b-48c2-a64a-23f448dddd18 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:14.865966 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a04b46-822b-48c2-a64a-23f448dddd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:14.866244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a04b46-822b-48c2-a64a-23f448dddd18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:14.874645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a04b46-822b-48c2-a64a-23f448dddd18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:14.925877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: WARNING keystone.common.rbac_enforcer.enforcer [None req-51a04b46-822b-48c2-a64a-23f448dddd18 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 06 01:19:14.926168 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a04b46-822b-48c2-a64a-23f448dddd18 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:14.936002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Sat Aug 6 01:19:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:19:14.942570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e740708-f1e0-4770-82db-837c0fb91e48 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:14.957583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e740708-f1e0-4770-82db-837c0fb91e48 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:14.961920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b93d4a-6f88-4323-a522-48f5b0e4fe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:14.963021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b93d4a-6f88-4323-a522-48f5b0e4fe48 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:14.963303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b93d4a-6f88-4323-a522-48f5b0e4fe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:14.963576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b93d4a-6f88-4323-a522-48f5b0e4fe48 admin admin] PATH_INFO: `/v3/projects/3c0f4c0f88fe4deb812ff64ab95ac12c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:14.965094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b93d4a-6f88-4323-a522-48f5b0e4fe48 admin admin] RBAC: Authorizing `identity:get_project(project_id=3c0f4c0f88fe4deb812ff64ab95ac12c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:15.014973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: WARNING keystone.common.rbac_enforcer.enforcer [None req-72b93d4a-6f88-4323-a522-48f5b0e4fe48 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 06 01:19:15.015317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b93d4a-6f88-4323-a522-48f5b0e4fe48 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:15.020768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Sat Aug 6 01:19:14 2022] GET /identity/v3/projects/3c0f4c0f88fe4deb812ff64ab95ac12c => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:17.003844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e06157-b3b2-4460-aef1-a7007808f893 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:17.004389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e06157-b3b2-4460-aef1-a7007808f893 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:17.004389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e06157-b3b2-4460-aef1-a7007808f893 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:17.008465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:17.013913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1134-2ba7-4a92-9bba-c46ee60aaee0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:17.014302 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1134-2ba7-4a92-9bba-c46ee60aaee0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:17.014473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1134-2ba7-4a92-9bba-c46ee60aaee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:17.036561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f12b1134-2ba7-4a92-9bba-c46ee60aaee0 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:17.038092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f12b1134-2ba7-4a92-9bba-c46ee60aaee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:17.045849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 06 01:19:17.068044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e06157-b3b2-4460-aef1-a7007808f893 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:17.080563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e06157-b3b2-4460-aef1-a7007808f893 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:17.084895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac967d1-b5c2-4507-ac5a-853dc501b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:17.085537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac967d1-b5c2-4507-ac5a-853dc501b8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:17.085852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac967d1-b5c2-4507-ac5a-853dc501b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:17.086130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac967d1-b5c2-4507-ac5a-853dc501b8ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:17.093945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac967d1-b5c2-4507-ac5a-853dc501b8ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:17.096453 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac967d1-b5c2-4507-ac5a-853dc501b8ce admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:17.105236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Sat Aug 6 01:19:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:19:17.110889 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1134-2ba7-4a92-9bba-c46ee60aaee0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:17.119760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1134-2ba7-4a92-9bba-c46ee60aaee0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:17.124096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cf268-5dcb-498a-8f64-47a282ed3b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:17.124711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cf268-5dcb-498a-8f64-47a282ed3b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:17.125031 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cf268-5dcb-498a-8f64-47a282ed3b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:17.125311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cf268-5dcb-498a-8f64-47a282ed3b69 admin admin] PATH_INFO: `/v3/users/44865c547348438e8c2b72709661a2a7` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:17.127386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cf268-5dcb-498a-8f64-47a282ed3b69 admin admin] RBAC: Authorizing `identity:get_user(user_id=44865c547348438e8c2b72709661a2a7)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:17.129385 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cf268-5dcb-498a-8f64-47a282ed3b69 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:17.130913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Sat Aug 6 01:19:17 2022] GET /identity/v3/users/44865c547348438e8c2b72709661a2a7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:19.193428 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c0625-9f82-4cd2-a51b-9c21af75ed75 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:19.193984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c0625-9f82-4cd2-a51b-9c21af75ed75 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:19.193984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c0625-9f82-4cd2-a51b-9c21af75ed75 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:19.194398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e7098-a3ae-4257-b6c2-fbd49b0bae30 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:19.194767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e7098-a3ae-4257-b6c2-fbd49b0bae30 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:19.194956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e7098-a3ae-4257-b6c2-fbd49b0bae30 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:19.195312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:19.196340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:19:19.200162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35db962-a3f5-48b2-bdc8-a8d4e4add4e8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:19.200459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35db962-a3f5-48b2-bdc8-a8d4e4add4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:19.200735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35db962-a3f5-48b2-bdc8-a8d4e4add4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:19.201484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b4e53-0139-4fca-8b41-23d926bdb438 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:19.201770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b4e53-0139-4fca-8b41-23d926bdb438 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:19.202049 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b4e53-0139-4fca-8b41-23d926bdb438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:19.222206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5c6b4e53-0139-4fca-8b41-23d926bdb438 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:19.223400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5c6b4e53-0139-4fca-8b41-23d926bdb438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:19.243040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG passlib.handlers.bcrypt [None req-f35db962-a3f5-48b2-bdc8-a8d4e4add4e8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80158) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 06 01:19:19.243474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG passlib.handlers.bcrypt [None req-f35db962-a3f5-48b2-bdc8-a8d4e4add4e8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80158) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 06 01:19:19.289745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f35db962-a3f5-48b2-bdc8-a8d4e4add4e8 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:19.291345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f35db962-a3f5-48b2-bdc8-a8d4e4add4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:19.304996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:19.327518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b4e53-0139-4fca-8b41-23d926bdb438 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:19.352458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:19.396497 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 6/13] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:19.419735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35db962-a3f5-48b2-bdc8-a8d4e4add4e8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:19.435318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b4e53-0139-4fca-8b41-23d926bdb438 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:19.470295 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60869f52-2b6e-4f61-86fd-9150b0e7b2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:19.470854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60869f52-2b6e-4f61-86fd-9150b0e7b2ad None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:19.471138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60869f52-2b6e-4f61-86fd-9150b0e7b2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:19.471414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60869f52-2b6e-4f61-86fd-9150b0e7b2ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:19.520290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35db962-a3f5-48b2-bdc8-a8d4e4add4e8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:19.522622 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:19.539320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60869f52-2b6e-4f61-86fd-9150b0e7b2ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:19.540789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60869f52-2b6e-4f61-86fd-9150b0e7b2ad None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:19.560729 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8627de3-18ab-48fc-914a-8a1e4c0b71b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:19.561871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8627de3-18ab-48fc-914a-8a1e4c0b71b6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:19.562162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8627de3-18ab-48fc-914a-8a1e4c0b71b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:19.562442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8627de3-18ab-48fc-914a-8a1e4c0b71b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:19.563816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:19.574506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8627de3-18ab-48fc-914a-8a1e4c0b71b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a8627de3-18ab-48fc-914a-8a1e4c0b71b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:19.584752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:19.585829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:19.586652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:19:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:19:19.591686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8627de3-18ab-48fc-914a-8a1e4c0b71b6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:19.642567 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 8/15] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:19:19.648175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60869f52-2b6e-4f61-86fd-9150b0e7b2ad None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:19.695869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8627de3-18ab-48fc-914a-8a1e4c0b71b6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:19.728317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35308b3-80d4-469c-bbe0-5fc11f293b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:19.728864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35308b3-80d4-469c-bbe0-5fc11f293b3a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:19.729179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35308b3-80d4-469c-bbe0-5fc11f293b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:19.729456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35308b3-80d4-469c-bbe0-5fc11f293b3a None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:19.730169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35308b3-80d4-469c-bbe0-5fc11f293b3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:19.730472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35308b3-80d4-469c-bbe0-5fc11f293b3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:19.731893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35308b3-80d4-469c-bbe0-5fc11f293b3a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:19.743105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60869f52-2b6e-4f61-86fd-9150b0e7b2ad None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:19.743969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 8/16] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:19.749584 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35308b3-80d4-469c-bbe0-5fc11f293b3a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:19.767450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:19.777265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:19.779715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a3ef-3ff3-4981-a6da-f32f15d577c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:19.780423 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a3ef-3ff3-4981-a6da-f32f15d577c3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:19.780707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a3ef-3ff3-4981-a6da-f32f15d577c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:19.781119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a3ef-3ff3-4981-a6da-f32f15d577c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:19.790842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a3ef-3ff3-4981-a6da-f32f15d577c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:19.792304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a3ef-3ff3-4981-a6da-f32f15d577c3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a628a3ef-3ff3-4981-a6da-f32f15d577c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:19:19.811583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:19.812583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:19.813547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:19:19.813547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:19:19.813547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:19:19.813547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:19.813547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:19:19.819651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a3ef-3ff3-4981-a6da-f32f15d577c3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:19.854751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35308b3-80d4-469c-bbe0-5fc11f293b3a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:19.892195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483f714-3e4c-4850-9e50-979d78814c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:19.892856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483f714-3e4c-4850-9e50-979d78814c9b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:19.893167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483f714-3e4c-4850-9e50-979d78814c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:19.893442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483f714-3e4c-4850-9e50-979d78814c9b None admin] PATH_INFO: `/v3/users/44865c547348438e8c2b72709661a2a7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:19.895030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483f714-3e4c-4850-9e50-979d78814c9b None admin] RBAC: Authorizing `identity:get_user(user_id=44865c547348438e8c2b72709661a2a7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:19.896575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483f714-3e4c-4850-9e50-979d78814c9b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:19.898329 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:19 2022] GET /identity/v3/users/44865c547348438e8c2b72709661a2a7 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:19.903926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483f714-3e4c-4850-9e50-979d78814c9b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:19.997247 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:20.005493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483f714-3e4c-4850-9e50-979d78814c9b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:20.027773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a3ef-3ff3-4981-a6da-f32f15d577c3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:20.038472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f849c5-7ec2-419f-a683-41994aecc912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:20.039117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f849c5-7ec2-419f-a683-41994aecc912 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:20.039403 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f849c5-7ec2-419f-a683-41994aecc912 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:20.039679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f849c5-7ec2-419f-a683-41994aecc912 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:20.040846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f849c5-7ec2-419f-a683-41994aecc912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:20.042332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f849c5-7ec2-419f-a683-41994aecc912 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:20.043920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:20.050215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f849c5-7ec2-419f-a683-41994aecc912 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:20.061046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c567b-b663-401a-8c9d-d255b58eb503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:20.061658 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c567b-b663-401a-8c9d-d255b58eb503 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:20.061939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c567b-b663-401a-8c9d-d255b58eb503 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:20.062212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c567b-b663-401a-8c9d-d255b58eb503 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:20.062895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c567b-b663-401a-8c9d-d255b58eb503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:20.063289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c567b-b663-401a-8c9d-d255b58eb503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:20.064646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c567b-b663-401a-8c9d-d255b58eb503 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:20.082143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:20.154456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f849c5-7ec2-419f-a683-41994aecc912 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:20.191185 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0852f-166b-466c-886f-abac62e460d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:20.191834 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0852f-166b-466c-886f-abac62e460d4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:20.192122 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0852f-166b-466c-886f-abac62e460d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:20.192401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0852f-166b-466c-886f-abac62e460d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:20.193247 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0852f-166b-466c-886f-abac62e460d4 None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.domain.id=default, user.id=44865c547348438e8c2b72709661a2a7) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:20.193567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0852f-166b-466c-886f-abac62e460d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:20.195061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0852f-166b-466c-886f-abac62e460d4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:20.204627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1322 bytes} [Sat Aug 6 01:19:20 2022] GET /identity/v3/role_assignments?user.id=44865c547348438e8c2b72709661a2a7&scope.domain.id=default&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:22.377965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ac577-e27f-41b5-acf8-5795555b37b2 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:22.378404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ac577-e27f-41b5-acf8-5795555b37b2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:22.378620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ac577-e27f-41b5-acf8-5795555b37b2 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:22.379872 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:22.394891 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558da94-a370-424c-be94-ed19900f4186 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:22.395369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558da94-a370-424c-be94-ed19900f4186 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:22.395449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558da94-a370-424c-be94-ed19900f4186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:22.425027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d558da94-a370-424c-be94-ed19900f4186 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:22.426271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d558da94-a370-424c-be94-ed19900f4186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:22.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:22.520560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:22.541573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037df4fd-aee2-47fe-9319-b60c78cad1b8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:22.541866 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037df4fd-aee2-47fe-9319-b60c78cad1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:22.542153 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037df4fd-aee2-47fe-9319-b60c78cad1b8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:22.543495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:22.549105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01c1d6-e61f-4ec3-b29d-173be9715c8f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:22.549410 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01c1d6-e61f-4ec3-b29d-173be9715c8f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:22.549794 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01c1d6-e61f-4ec3-b29d-173be9715c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:22.561294 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037df4fd-aee2-47fe-9319-b60c78cad1b8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:22.579670 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0a01c1d6-e61f-4ec3-b29d-173be9715c8f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:22.580886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0a01c1d6-e61f-4ec3-b29d-173be9715c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:22.650285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:22.695422 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:22.727302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01c1d6-e61f-4ec3-b29d-173be9715c8f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:22.774626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037df4fd-aee2-47fe-9319-b60c78cad1b8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:22.822875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666f508-d757-4a26-981d-60ba9e231601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:22.823523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666f508-d757-4a26-981d-60ba9e231601 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:22.823808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666f508-d757-4a26-981d-60ba9e231601 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:22.824082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666f508-d757-4a26-981d-60ba9e231601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:22.842196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666f508-d757-4a26-981d-60ba9e231601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:22.843668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666f508-d757-4a26-981d-60ba9e231601 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4666f508-d757-4a26-981d-60ba9e231601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:19:22.875266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:22.876308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:22.877146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:19:22.877146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:19:22.877146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:19:22.877146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:22.877146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 13/26] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:19:22.878307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17272adb-434e-45b5-9667-eb45b6a87135 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:22.878600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17272adb-434e-45b5-9667-eb45b6a87135 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:22.878884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17272adb-434e-45b5-9667-eb45b6a87135 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:22.880136 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 14/27] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:22.888889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:22.889628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17272adb-434e-45b5-9667-eb45b6a87135 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:22.921026 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01c1d6-e61f-4ec3-b29d-173be9715c8f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:22.995708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea5300-1c8a-4140-9d12-9109bcf56180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:22.996414 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea5300-1c8a-4140-9d12-9109bcf56180 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:22.996709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea5300-1c8a-4140-9d12-9109bcf56180 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:22.997137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea5300-1c8a-4140-9d12-9109bcf56180 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:22.997950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea5300-1c8a-4140-9d12-9109bcf56180 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:22.999453 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea5300-1c8a-4140-9d12-9109bcf56180 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:23.080684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:23.117008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17272adb-434e-45b5-9667-eb45b6a87135 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:23.181100 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf6e9c-1536-47ee-949c-1e27f4d0de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:23.181677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf6e9c-1536-47ee-949c-1e27f4d0de2b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:23.182032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf6e9c-1536-47ee-949c-1e27f4d0de2b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:23.182312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf6e9c-1536-47ee-949c-1e27f4d0de2b None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:23.183093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf6e9c-1536-47ee-949c-1e27f4d0de2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:23.183411 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf6e9c-1536-47ee-949c-1e27f4d0de2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:23.184844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf6e9c-1536-47ee-949c-1e27f4d0de2b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:23.201559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 15/28] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:23.203230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc5ecc-3b1f-41d3-9f7c-1dc2980e822a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:23.203937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc5ecc-3b1f-41d3-9f7c-1dc2980e822a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:23.204439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc5ecc-3b1f-41d3-9f7c-1dc2980e822a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:23.223834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7dcc5ecc-3b1f-41d3-9f7c-1dc2980e822a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:23.225415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7dcc5ecc-3b1f-41d3-9f7c-1dc2980e822a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:23.296407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 16/29] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:23.297766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544bb97-37ed-4439-9559-3f22c180d86f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:23.298062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544bb97-37ed-4439-9559-3f22c180d86f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:23.298346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544bb97-37ed-4439-9559-3f22c180d86f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:23.299598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 17/30] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:23.300280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544bb97-37ed-4439-9559-3f22c180d86f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:23.304013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 14/31] 10.222.0.15 () {60 vars in 1131 bytes} [Sat Aug 6 01:19:22 2022] POST /identity/v3/roles => generated 219 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:19:23.310724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac62386-34f2-4bd8-8abd-a7ff36f74175 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:23.311206 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac62386-34f2-4bd8-8abd-a7ff36f74175 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:23.311678 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac62386-34f2-4bd8-8abd-a7ff36f74175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:23.351748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8ac62386-34f2-4bd8-8abd-a7ff36f74175 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:23.359539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8ac62386-34f2-4bd8-8abd-a7ff36f74175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:23.453367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:23.506616 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544bb97-37ed-4439-9559-3f22c180d86f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:23.509105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 15/32] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:23.517228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac62386-34f2-4bd8-8abd-a7ff36f74175 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:23.544970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0a695-c7ef-4d62-8b5b-3329af7fe667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:23.545283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0a695-c7ef-4d62-8b5b-3329af7fe667 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:23.545924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0a695-c7ef-4d62-8b5b-3329af7fe667 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:23.545924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0a695-c7ef-4d62-8b5b-3329af7fe667 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:23.546535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0a695-c7ef-4d62-8b5b-3329af7fe667 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:23.548923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0a695-c7ef-4d62-8b5b-3329af7fe667 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:23.621435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:23.647920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac62386-34f2-4bd8-8abd-a7ff36f74175 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:23.684880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8ba26-c0cc-473d-a4d1-97bd12a732d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:23.685569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8ba26-c0cc-473d-a4d1-97bd12a732d4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:23.685861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8ba26-c0cc-473d-a4d1-97bd12a732d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:23.686146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8ba26-c0cc-473d-a4d1-97bd12a732d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:23.696925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8ba26-c0cc-473d-a4d1-97bd12a732d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-78b8ba26-c0cc-473d-a4d1-97bd12a732d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:23.701989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:23.703059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:23.704623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:23.704623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:23.704623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:23.704623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:23.704623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:23.704623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:23.704623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:23.704623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:23.704623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:23.704623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:23.704623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:23.704623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:23.705402 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 16/33] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:19:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:23.706211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8ba26-c0cc-473d-a4d1-97bd12a732d4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:23.718725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 18/34] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:19:23 2022] POST /identity/v3/projects => generated 301 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:19:23.720219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0a695-c7ef-4d62-8b5b-3329af7fe667 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:23.840539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0a695-c7ef-4d62-8b5b-3329af7fe667 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:23.864716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8ba26-c0cc-473d-a4d1-97bd12a732d4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:23.877332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:23.882494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa5b21-4e0f-4ebf-a90d-7876c1ebd598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:23.883428 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa5b21-4e0f-4ebf-a90d-7876c1ebd598 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:23.883907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa5b21-4e0f-4ebf-a90d-7876c1ebd598 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:23.884270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa5b21-4e0f-4ebf-a90d-7876c1ebd598 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:23.885280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa5b21-4e0f-4ebf-a90d-7876c1ebd598 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:23.885676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa5b21-4e0f-4ebf-a90d-7876c1ebd598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:23.887507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa5b21-4e0f-4ebf-a90d-7876c1ebd598 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:23.902363 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 19/35] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:23.908848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa5b21-4e0f-4ebf-a90d-7876c1ebd598 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:23.934285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d18bc5-ce4f-4645-bcbb-68a853270714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:23.935009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d18bc5-ce4f-4645-bcbb-68a853270714 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:23.935303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d18bc5-ce4f-4645-bcbb-68a853270714 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:23.935585 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d18bc5-ce4f-4645-bcbb-68a853270714 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:23.936330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d18bc5-ce4f-4645-bcbb-68a853270714 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:23.938541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d18bc5-ce4f-4645-bcbb-68a853270714 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:23.952334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:23.972385 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 17/36] 10.222.0.15 () {60 vars in 1131 bytes} [Sat Aug 6 01:19:23 2022] POST /identity/v3/roles => generated 225 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:19:24.013766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56653a1b-9bf6-43c4-b6bb-aca10f05957e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:24.014409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56653a1b-9bf6-43c4-b6bb-aca10f05957e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:24.014899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56653a1b-9bf6-43c4-b6bb-aca10f05957e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:24.017123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 18/37] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:19:24.023246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae423bb-0a55-46f4-aa83-3ea6a2a64493 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:24.023838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae423bb-0a55-46f4-aa83-3ea6a2a64493 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:24.024357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae423bb-0a55-46f4-aa83-3ea6a2a64493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:24.043238 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa5b21-4e0f-4ebf-a90d-7876c1ebd598 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:24.045908 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-eae423bb-0a55-46f4-aa83-3ea6a2a64493 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:24.047679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eae423bb-0a55-46f4-aa83-3ea6a2a64493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:24.092185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707c877-238c-4130-94ff-d82d52861e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:24.093940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707c877-238c-4130-94ff-d82d52861e9b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:24.094773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707c877-238c-4130-94ff-d82d52861e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:24.095159 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707c877-238c-4130-94ff-d82d52861e9b None admin] PATH_INFO: `/v3/users/44865c547348438e8c2b72709661a2a7` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:24.096619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707c877-238c-4130-94ff-d82d52861e9b None admin] RBAC: Authorizing `identity:get_user(user_id=44865c547348438e8c2b72709661a2a7)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:24.098163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707c877-238c-4130-94ff-d82d52861e9b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:24.099878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:23 2022] GET /identity/v3/users/44865c547348438e8c2b72709661a2a7 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:24.102018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ee394-c455-4ce0-b7ba-5bb7a9546b35 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:24.102318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ee394-c455-4ce0-b7ba-5bb7a9546b35 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:24.102606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ee394-c455-4ce0-b7ba-5bb7a9546b35 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:24.104675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 21/39] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:24.105870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ee394-c455-4ce0-b7ba-5bb7a9546b35 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:24.138675 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 19/40] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:24.140218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055aebe-40da-44ef-a915-bfd9fad551e4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:24.141047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055aebe-40da-44ef-a915-bfd9fad551e4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:24.141564 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055aebe-40da-44ef-a915-bfd9fad551e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:24.173437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9055aebe-40da-44ef-a915-bfd9fad551e4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:24.175121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9055aebe-40da-44ef-a915-bfd9fad551e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:24.188742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:24.239500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ee394-c455-4ce0-b7ba-5bb7a9546b35 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:24.254788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 20/41] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:24.255646 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055aebe-40da-44ef-a915-bfd9fad551e4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:24.280636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c823-1211-444e-9ede-6cbde8c379a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:24.281311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c823-1211-444e-9ede-6cbde8c379a7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:24.281651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c823-1211-444e-9ede-6cbde8c379a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:24.282233 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c823-1211-444e-9ede-6cbde8c379a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:24.283158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501c823-1211-444e-9ede-6cbde8c379a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:24.284604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501c823-1211-444e-9ede-6cbde8c379a7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:24.290768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 22/42] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:24.290768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c823-1211-444e-9ede-6cbde8c379a7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:24.312343 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:24.355280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055aebe-40da-44ef-a915-bfd9fad551e4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:24.388422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c823-1211-444e-9ede-6cbde8c379a7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:24.391980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d406e0-6630-4eba-8278-fede890c6634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:24.392626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d406e0-6630-4eba-8278-fede890c6634 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:24.392922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d406e0-6630-4eba-8278-fede890c6634 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:24.393213 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d406e0-6630-4eba-8278-fede890c6634 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:24.394357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d406e0-6630-4eba-8278-fede890c6634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:24.396133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d406e0-6630-4eba-8278-fede890c6634 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:24.397733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:24.398471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d406e0-6630-4eba-8278-fede890c6634 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:24.419451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:24.430183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab82e69-69fd-46fb-9efc-306c881c9819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:24.430805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab82e69-69fd-46fb-9efc-306c881c9819 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:24.431095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab82e69-69fd-46fb-9efc-306c881c9819 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:24.431379 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab82e69-69fd-46fb-9efc-306c881c9819 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:24.432099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab82e69-69fd-46fb-9efc-306c881c9819 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:24.433529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab82e69-69fd-46fb-9efc-306c881c9819 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:24.449677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1131 bytes} [Sat Aug 6 01:19:24 2022] POST /identity/v3/roles => generated 223 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:19:24.450468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab82e69-69fd-46fb-9efc-306c881c9819 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:24.510051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d406e0-6630-4eba-8278-fede890c6634 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:24.539421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:24.552322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd670b0-f931-4756-9b37-2c11815b1327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:24.553050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd670b0-f931-4756-9b37-2c11815b1327 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:24.553341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd670b0-f931-4756-9b37-2c11815b1327 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:24.553624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd670b0-f931-4756-9b37-2c11815b1327 None admin] PATH_INFO: `/v3/domains/default/users/44865c547348438e8c2b72709661a2a7/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:24.555683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd670b0-f931-4756-9b37-2c11815b1327 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=44865c547348438e8c2b72709661a2a7, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:24.557234 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd670b0-f931-4756-9b37-2c11815b1327 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:24.561902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab82e69-69fd-46fb-9efc-306c881c9819 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:24.575367 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 22/45] 10.222.0.15 () {58 vars in 1361 bytes} [Sat Aug 6 01:19:24 2022] PUT /identity/v3/domains/default/users/44865c547348438e8c2b72709661a2a7/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:19:24.602907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901356f-8d68-486b-8ef4-eada4943907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:24.603559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901356f-8d68-486b-8ef4-eada4943907c None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:24.603847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901356f-8d68-486b-8ef4-eada4943907c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:24.604127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901356f-8d68-486b-8ef4-eada4943907c None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:24.604841 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901356f-8d68-486b-8ef4-eada4943907c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:24.606375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901356f-8d68-486b-8ef4-eada4943907c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:24.637675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:19:24 2022] POST /identity/v3/projects => generated 312 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:19:26.577606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb2be1-bccb-46d4-9541-0ab6243cc3fd None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:26.578135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb2be1-bccb-46d4-9541-0ab6243cc3fd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:26.578234 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb2be1-bccb-46d4-9541-0ab6243cc3fd None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:26.580251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 23/47] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:26.585438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bf03f-ff1a-4434-a580-a72994dbc6c9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:26.585862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bf03f-ff1a-4434-a580-a72994dbc6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:26.585996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bf03f-ff1a-4434-a580-a72994dbc6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:26.604876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-229bf03f-ff1a-4434-a580-a72994dbc6c9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:26.606424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-229bf03f-ff1a-4434-a580-a72994dbc6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:26.636348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:26.675054 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:26.697268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb2be1-bccb-46d4-9541-0ab6243cc3fd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:26.702582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3422-890a-4b69-af67-717c62526add None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:26.702943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3422-890a-4b69-af67-717c62526add None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:26.703250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3422-890a-4b69-af67-717c62526add None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:26.705204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 26/49] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:19:26.709990 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827327b-13f7-49f2-8528-846895bed315 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:26.710276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827327b-13f7-49f2-8528-846895bed315 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:26.710558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827327b-13f7-49f2-8528-846895bed315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:26.728430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6827327b-13f7-49f2-8528-846895bed315 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:26.729643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6827327b-13f7-49f2-8528-846895bed315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:26.796829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 27/50] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:26.801040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb2be1-bccb-46d4-9541-0ab6243cc3fd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:26.820005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827327b-13f7-49f2-8528-846895bed315 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:26.835145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1f23e-ff6d-4678-9e17-357ed3e9155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:26.835798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1f23e-ff6d-4678-9e17-357ed3e9155f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:26.836085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1f23e-ff6d-4678-9e17-357ed3e9155f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:26.836361 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1f23e-ff6d-4678-9e17-357ed3e9155f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:26.847510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1f23e-ff6d-4678-9e17-357ed3e9155f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-53b1f23e-ff6d-4678-9e17-357ed3e9155f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:26.852514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:26.853534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:26.854604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 24/51] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:26.860123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1f23e-ff6d-4678-9e17-357ed3e9155f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:26.905975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:26.918038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:26.923446 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827327b-13f7-49f2-8528-846895bed315 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:26.958649 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6322e9-d873-4a34-8094-5f4b243ede72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:26.959292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6322e9-d873-4a34-8094-5f4b243ede72 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:26.959575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6322e9-d873-4a34-8094-5f4b243ede72 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:26.959848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6322e9-d873-4a34-8094-5f4b243ede72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:26.961010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6322e9-d873-4a34-8094-5f4b243ede72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:26.962450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6322e9-d873-4a34-8094-5f4b243ede72 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:26.964012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 28/52] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:26.966651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1f23e-ff6d-4678-9e17-357ed3e9155f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:26.971139 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6322e9-d873-4a34-8094-5f4b243ede72 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:27.001536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067411f0-68eb-4688-a90a-6bc28d1c2ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:27.002147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067411f0-68eb-4688-a90a-6bc28d1c2ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:27.002430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067411f0-68eb-4688-a90a-6bc28d1c2ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:27.002708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067411f0-68eb-4688-a90a-6bc28d1c2ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:27.003421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067411f0-68eb-4688-a90a-6bc28d1c2ba6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:27.003728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067411f0-68eb-4688-a90a-6bc28d1c2ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:27.005138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067411f0-68eb-4688-a90a-6bc28d1c2ba6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:27.014304 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 25/53] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:27.020082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067411f0-68eb-4688-a90a-6bc28d1c2ba6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:27.070755 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6322e9-d873-4a34-8094-5f4b243ede72 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:27.105137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd3263-903c-4c4d-a60f-74003b2dbd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:27.105750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3263-903c-4c4d-a60f-74003b2dbd9d None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:27.106033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3263-903c-4c4d-a60f-74003b2dbd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:27.106309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd3263-903c-4c4d-a60f-74003b2dbd9d None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:27.106988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd3263-903c-4c4d-a60f-74003b2dbd9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:27.108414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd3263-903c-4c4d-a60f-74003b2dbd9d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:27.118693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067411f0-68eb-4688-a90a-6bc28d1c2ba6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:27.126189 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:27.135519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 29/54] 10.222.0.15 () {60 vars in 1140 bytes} [Sat Aug 6 01:19:26 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:19:27.155624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212aa6b-a64b-4390-a32e-7216cb7adff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:27.156357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212aa6b-a64b-4390-a32e-7216cb7adff2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:27.157141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212aa6b-a64b-4390-a32e-7216cb7adff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:27.157463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212aa6b-a64b-4390-a32e-7216cb7adff2 None admin] PATH_INFO: `/v3/users/44865c547348438e8c2b72709661a2a7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:27.158746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212aa6b-a64b-4390-a32e-7216cb7adff2 None admin] RBAC: Authorizing `identity:get_user(user_id=44865c547348438e8c2b72709661a2a7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:27.160230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212aa6b-a64b-4390-a32e-7216cb7adff2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:27.161951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 26/55] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:27 2022] GET /identity/v3/users/44865c547348438e8c2b72709661a2a7 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:27.167707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd3263-903c-4c4d-a60f-74003b2dbd9d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:27.188858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:27.275652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd3263-903c-4c4d-a60f-74003b2dbd9d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:27.310981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7c667-ed1a-4d6f-a6fd-349d8ec79096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:27.311626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7c667-ed1a-4d6f-a6fd-349d8ec79096 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:27.311916 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7c667-ed1a-4d6f-a6fd-349d8ec79096 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:27.312188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7c667-ed1a-4d6f-a6fd-349d8ec79096 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:27.314392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7c667-ed1a-4d6f-a6fd-349d8ec79096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:27.315826 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7c667-ed1a-4d6f-a6fd-349d8ec79096 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:27.317451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 30/56] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:27.323408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212aa6b-a64b-4390-a32e-7216cb7adff2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:27.424496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212aa6b-a64b-4390-a32e-7216cb7adff2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:27.457555 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b10db0-a3da-4dc2-87b4-117f5fbf99e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:27.458172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b10db0-a3da-4dc2-87b4-117f5fbf99e3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:27.458457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b10db0-a3da-4dc2-87b4-117f5fbf99e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:27.458740 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b10db0-a3da-4dc2-87b4-117f5fbf99e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:27.459559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b10db0-a3da-4dc2-87b4-117f5fbf99e3 None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.domain.id=default, user.id=44865c547348438e8c2b72709661a2a7) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:27.459870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b10db0-a3da-4dc2-87b4-117f5fbf99e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:27.461338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b10db0-a3da-4dc2-87b4-117f5fbf99e3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:27.467182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 27/57] 10.222.0.15 () {56 vars in 1322 bytes} [Sat Aug 6 01:19:27 2022] GET /identity/v3/role_assignments?user.id=44865c547348438e8c2b72709661a2a7&scope.domain.id=default&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:29.160551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443691b7-3975-4c22-ba11-a37fa43447e4 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:29.161094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443691b7-3975-4c22-ba11-a37fa43447e4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:29.161182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443691b7-3975-4c22-ba11-a37fa43447e4 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:29.162587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 31/58] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:29.167686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88770257-be93-4233-9ccb-da02eebb70fd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:29.168079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88770257-be93-4233-9ccb-da02eebb70fd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:29.168248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88770257-be93-4233-9ccb-da02eebb70fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:29.185699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-88770257-be93-4233-9ccb-da02eebb70fd None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:29.186889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-88770257-be93-4233-9ccb-da02eebb70fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:29.216873 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:29.253143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 28/59] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:29.277175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443691b7-3975-4c22-ba11-a37fa43447e4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:29.360424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:29.377389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443691b7-3975-4c22-ba11-a37fa43447e4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:29.411029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa3000-2238-413c-9110-356a235d9d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:29.411609 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3000-2238-413c-9110-356a235d9d02 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:29.411894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3000-2238-413c-9110-356a235d9d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:29.412174 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3000-2238-413c-9110-356a235d9d02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:29.413354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa3000-2238-413c-9110-356a235d9d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:29.414812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa3000-2238-413c-9110-356a235d9d02 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:29.416385 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 32/60] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:29.422554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88770257-be93-4233-9ccb-da02eebb70fd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:29.518982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88770257-be93-4233-9ccb-da02eebb70fd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:29.551207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cbf73-0cd2-4a9e-801b-26331eb09f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:29.551822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cbf73-0cd2-4a9e-801b-26331eb09f02 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:29.552105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cbf73-0cd2-4a9e-801b-26331eb09f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:29.552381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cbf73-0cd2-4a9e-801b-26331eb09f02 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:29.553097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cbf73-0cd2-4a9e-801b-26331eb09f02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:29.554533 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cbf73-0cd2-4a9e-801b-26331eb09f02 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:29.580809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 29/61] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:19:29 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:19:32.586687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8babb56-df0a-47f7-8e50-663a3ea10864 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:32.587638 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8babb56-df0a-47f7-8e50-663a3ea10864 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:32.588159 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8babb56-df0a-47f7-8e50-663a3ea10864 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:32.589743 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 33/62] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:32.595785 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e949d4-f93c-41b8-8277-bea071b99422 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:32.596636 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e949d4-f93c-41b8-8277-bea071b99422 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:32.597160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e949d4-f93c-41b8-8277-bea071b99422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:32.626680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-89e949d4-f93c-41b8-8277-bea071b99422 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:32.628212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-89e949d4-f93c-41b8-8277-bea071b99422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:32.649375 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:32.715006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cadeb-fb3a-4397-8600-817342954d01 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:32.715299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cadeb-fb3a-4397-8600-817342954d01 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:32.715673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 30/63] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:32.715921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cadeb-fb3a-4397-8600-817342954d01 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:32.717425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 34/64] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:32.739105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8862a6-bf00-4ee4-993e-f2a482ba3376 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:32.739402 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8862a6-bf00-4ee4-993e-f2a482ba3376 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:32.739683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8862a6-bf00-4ee4-993e-f2a482ba3376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:32.763760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ba8862a6-bf00-4ee4-993e-f2a482ba3376 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:32.765079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ba8862a6-bf00-4ee4-993e-f2a482ba3376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:32.775076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cadeb-fb3a-4397-8600-817342954d01 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:32.873238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 31/65] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:32.947929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cadeb-fb3a-4397-8600-817342954d01 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:32.956486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8862a6-bf00-4ee4-993e-f2a482ba3376 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:33.029692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8b461-9274-4c01-8052-21df70a90ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:33.030355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8b461-9274-4c01-8052-21df70a90ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.030648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8b461-9274-4c01-8052-21df70a90ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.030929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8b461-9274-4c01-8052-21df70a90ec4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.058107 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8b461-9274-4c01-8052-21df70a90ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-cae8b461-9274-4c01-8052-21df70a90ec4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:33.069981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:33.070870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:33.071630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 35/66] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:33.077331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8b461-9274-4c01-8052-21df70a90ec4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:33.101313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:33.144094 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:33.194272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8b461-9274-4c01-8052-21df70a90ec4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:33.203058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8862a6-bf00-4ee4-993e-f2a482ba3376 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:33.236485 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3f947-e55a-49bd-ba04-bed1c46014c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:33.237707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3f947-e55a-49bd-ba04-bed1c46014c4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.238141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3f947-e55a-49bd-ba04-bed1c46014c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.238694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3f947-e55a-49bd-ba04-bed1c46014c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.240168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3f947-e55a-49bd-ba04-bed1c46014c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:33.240654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3f947-e55a-49bd-ba04-bed1c46014c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:33.242389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3f947-e55a-49bd-ba04-bed1c46014c4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:33.244451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61226-ff90-4e79-849c-8fa18881b8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:33.245359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61226-ff90-4e79-849c-8fa18881b8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.245847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61226-ff90-4e79-849c-8fa18881b8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.246341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61226-ff90-4e79-849c-8fa18881b8c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.253101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 36/67] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:33.254906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63b30a-f0a8-4bf1-82b9-5007c4576005 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.255349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63b30a-f0a8-4bf1-82b9-5007c4576005 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.255805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63b30a-f0a8-4bf1-82b9-5007c4576005 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.257209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 37/68] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:33.258635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c69e19-33ef-44bb-8d2d-7cb6090c6b1a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.259065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c69e19-33ef-44bb-8d2d-7cb6090c6b1a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.259491 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c69e19-33ef-44bb-8d2d-7cb6090c6b1a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.260658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61226-ff90-4e79-849c-8fa18881b8c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:33.261111 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 38/69] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:33.262003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c69e19-33ef-44bb-8d2d-7cb6090c6b1a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-80d61226-ff90-4e79-849c-8fa18881b8c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:33.267472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:33.268355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:33.269136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:33.269136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:33.269136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:33.269136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:33.269136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:33.269136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:33.269136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:33.269136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:33.269136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:33.269136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:33.269136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:33.269136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:33.271135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 32/70] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:19:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:19:33.274730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077814-75fd-4a36-94cf-a5ac7ea6f928 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.275096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077814-75fd-4a36-94cf-a5ac7ea6f928 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.275452 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077814-75fd-4a36-94cf-a5ac7ea6f928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.293699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8f077814-75fd-4a36-94cf-a5ac7ea6f928 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:33.295118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8f077814-75fd-4a36-94cf-a5ac7ea6f928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:33.343375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:33.371194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c69e19-33ef-44bb-8d2d-7cb6090c6b1a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:33.374552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 33/71] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:33.376075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2067-d221-47a8-b351-faf0cfad4ff9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.376601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2067-d221-47a8-b351-faf0cfad4ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.377115 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2067-d221-47a8-b351-faf0cfad4ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.400841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-89de2067-d221-47a8-b351-faf0cfad4ff9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:33.402222 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-89de2067-d221-47a8-b351-faf0cfad4ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:33.415911 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b52b0-c771-41f3-8137-bc19aa02791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:33.416563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b52b0-c771-41f3-8137-bc19aa02791b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.416858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b52b0-c771-41f3-8137-bc19aa02791b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.417177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b52b0-c771-41f3-8137-bc19aa02791b None admin] PATH_INFO: `/v3/users/552b105a90954a8c9b8f34f2f992b2e6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.431969 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b52b0-c771-41f3-8137-bc19aa02791b None admin] RBAC: Authorizing `identity:get_user(user_id=552b105a90954a8c9b8f34f2f992b2e6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:33.433640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b52b0-c771-41f3-8137-bc19aa02791b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:33.439715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 39/72] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:33 2022] GET /identity/v3/users/552b105a90954a8c9b8f34f2f992b2e6 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:33.439715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b52b0-c771-41f3-8137-bc19aa02791b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:33.475048 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 34/73] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:33.476788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2067-d221-47a8-b351-faf0cfad4ff9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:33.479988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:33.546204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b52b0-c771-41f3-8137-bc19aa02791b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:33.580300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e997f-f727-4d40-91dc-01830991479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:33.580727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2067-d221-47a8-b351-faf0cfad4ff9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:33.580940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e997f-f727-4d40-91dc-01830991479b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.581220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e997f-f727-4d40-91dc-01830991479b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.581494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e997f-f727-4d40-91dc-01830991479b None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.582210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e997f-f727-4d40-91dc-01830991479b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:33.582511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e997f-f727-4d40-91dc-01830991479b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:33.583874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e997f-f727-4d40-91dc-01830991479b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:33.585200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:33.592503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 40/74] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:33.597767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e997f-f727-4d40-91dc-01830991479b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:33.615902 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fb5a4-1071-4b97-927c-ac5f5b7469c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:33.616569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fb5a4-1071-4b97-927c-ac5f5b7469c8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.616860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fb5a4-1071-4b97-927c-ac5f5b7469c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.617182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fb5a4-1071-4b97-927c-ac5f5b7469c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.627488 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fb5a4-1071-4b97-927c-ac5f5b7469c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b36fb5a4-1071-4b97-927c-ac5f5b7469c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:33.632483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:33.633600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:33.634383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 35/75] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:19:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:33.635014 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927114fd-34ce-4f4f-85e0-9ea2185ed199 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.635076 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927114fd-34ce-4f4f-85e0-9ea2185ed199 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.635511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927114fd-34ce-4f4f-85e0-9ea2185ed199 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.637082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 36/76] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:33.642485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927114fd-34ce-4f4f-85e0-9ea2185ed199 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:33.699821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e997f-f727-4d40-91dc-01830991479b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:33.706482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:33.733603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8be280-47d5-48d9-b518-87a38eed9ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:33.734173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8be280-47d5-48d9-b518-87a38eed9ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.734578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8be280-47d5-48d9-b518-87a38eed9ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.734834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8be280-47d5-48d9-b518-87a38eed9ff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.745204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927114fd-34ce-4f4f-85e0-9ea2185ed199 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:33.780192 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2466592-f209-460f-8feb-e94a3e3b5ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:33.780837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2466592-f209-460f-8feb-e94a3e3b5ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.781688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2466592-f209-460f-8feb-e94a3e3b5ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.781968 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2466592-f209-460f-8feb-e94a3e3b5ba9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.792143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2466592-f209-460f-8feb-e94a3e3b5ba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:33.796353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d2466592-f209-460f-8feb-e94a3e3b5ba9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:33.797313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:33.798661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 37/77] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:33.799434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2466592-f209-460f-8feb-e94a3e3b5ba9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:33.806172 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8be280-47d5-48d9-b518-87a38eed9ff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:33.807653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8be280-47d5-48d9-b518-87a38eed9ff7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:33.900537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2466592-f209-460f-8feb-e94a3e3b5ba9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:33.904484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 41/78] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:33.905347 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8be280-47d5-48d9-b518-87a38eed9ff7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:33.926531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:33.939332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0e511-cba4-41dd-bb47-71e6737e6c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:33.939975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0e511-cba4-41dd-bb47-71e6737e6c93 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.940256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0e511-cba4-41dd-bb47-71e6737e6c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.940530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0e511-cba4-41dd-bb47-71e6737e6c93 None admin] PATH_INFO: `/v3/users/44865c547348438e8c2b72709661a2a7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.941740 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0e511-cba4-41dd-bb47-71e6737e6c93 None admin] RBAC: Authorizing `identity:get_user(user_id=44865c547348438e8c2b72709661a2a7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:33.943194 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0e511-cba4-41dd-bb47-71e6737e6c93 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:33.944781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 38/79] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:33 2022] GET /identity/v3/users/44865c547348438e8c2b72709661a2a7 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:33.950427 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a1de4-3ba0-48b2-b0f8-52ad35f70ae3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:33.950723 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a1de4-3ba0-48b2-b0f8-52ad35f70ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:33.951008 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a1de4-3ba0-48b2-b0f8-52ad35f70ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:33.969388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c28a1de4-3ba0-48b2-b0f8-52ad35f70ae3 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:33.970594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c28a1de4-3ba0-48b2-b0f8-52ad35f70ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:33.998690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:34.005213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8be280-47d5-48d9-b518-87a38eed9ff7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:34.036744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 39/80] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:34.045062 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a1de4-3ba0-48b2-b0f8-52ad35f70ae3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:34.048830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca462a-64a5-4a5d-a804-adcbf8deef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:34.049616 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca462a-64a5-4a5d-a804-adcbf8deef59 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:34.049895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca462a-64a5-4a5d-a804-adcbf8deef59 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:34.050174 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca462a-64a5-4a5d-a804-adcbf8deef59 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:34.050891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca462a-64a5-4a5d-a804-adcbf8deef59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:34.051199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca462a-64a5-4a5d-a804-adcbf8deef59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:34.052804 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca462a-64a5-4a5d-a804-adcbf8deef59 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:34.061306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 42/81] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:19:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:34.062099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca462a-64a5-4a5d-a804-adcbf8deef59 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:34.138681 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a1de4-3ba0-48b2-b0f8-52ad35f70ae3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:34.160767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca462a-64a5-4a5d-a804-adcbf8deef59 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:34.161867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:34.174346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3806f-f398-457f-8822-612ce3b08e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:34.174979 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3806f-f398-457f-8822-612ce3b08e48 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:34.175264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3806f-f398-457f-8822-612ce3b08e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:34.175547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3806f-f398-457f-8822-612ce3b08e48 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:34.176271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3806f-f398-457f-8822-612ce3b08e48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:34.176582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3806f-f398-457f-8822-612ce3b08e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:34.177994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3806f-f398-457f-8822-612ce3b08e48 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:34.186067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 40/82] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:34.186660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3806f-f398-457f-8822-612ce3b08e48 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:34.199863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882080d6-d514-461d-bf68-a5796432ae78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:34.200507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882080d6-d514-461d-bf68-a5796432ae78 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:34.200790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882080d6-d514-461d-bf68-a5796432ae78 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:34.201099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882080d6-d514-461d-bf68-a5796432ae78 None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:34.202265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882080d6-d514-461d-bf68-a5796432ae78 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:34.203802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882080d6-d514-461d-bf68-a5796432ae78 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:34.205463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 43/83] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:34 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:34.206209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882080d6-d514-461d-bf68-a5796432ae78 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:34.233943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:34.294330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3806f-f398-457f-8822-612ce3b08e48 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:34.310513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882080d6-d514-461d-bf68-a5796432ae78 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:34.328600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335897e4-e674-45ec-991e-e58acae430a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:34.329147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335897e4-e674-45ec-991e-e58acae430a4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:34.329538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335897e4-e674-45ec-991e-e58acae430a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:34.329919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335897e4-e674-45ec-991e-e58acae430a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:34.344152 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b88f9-243d-4299-8416-9ba4052bb940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:34.344786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b88f9-243d-4299-8416-9ba4052bb940 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:34.345103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b88f9-243d-4299-8416-9ba4052bb940 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:34.345381 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b88f9-243d-4299-8416-9ba4052bb940 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:34.346538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b88f9-243d-4299-8416-9ba4052bb940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:34.347975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b88f9-243d-4299-8416-9ba4052bb940 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:34.349566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 44/84] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:34.350326 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b88f9-243d-4299-8416-9ba4052bb940 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:34.390935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:34.408449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335897e4-e674-45ec-991e-e58acae430a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:34.410174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335897e4-e674-45ec-991e-e58acae430a4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:34.443631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:34.452503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b88f9-243d-4299-8416-9ba4052bb940 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:34.487463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ddf6d-db03-4968-b5b4-49cd1ceaa2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:34.488098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ddf6d-db03-4968-b5b4-49cd1ceaa2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:34.488387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ddf6d-db03-4968-b5b4-49cd1ceaa2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:34.488668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ddf6d-db03-4968-b5b4-49cd1ceaa2d8 None admin] PATH_INFO: `/v3/users/552b105a90954a8c9b8f34f2f992b2e6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:34.489880 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ddf6d-db03-4968-b5b4-49cd1ceaa2d8 None admin] RBAC: Authorizing `identity:get_user(user_id=552b105a90954a8c9b8f34f2f992b2e6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:34.491301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ddf6d-db03-4968-b5b4-49cd1ceaa2d8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:34.492887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 45/85] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:34 2022] GET /identity/v3/users/552b105a90954a8c9b8f34f2f992b2e6 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:34.492887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ddf6d-db03-4968-b5b4-49cd1ceaa2d8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:34.514486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 41/86] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:34.515705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335897e4-e674-45ec-991e-e58acae430a4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:34.596743 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ddf6d-db03-4968-b5b4-49cd1ceaa2d8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:34.600291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:34.617614 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335897e4-e674-45ec-991e-e58acae430a4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:34.630628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691aaf-5c89-45bb-b806-e5adc64e1d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:34.631275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691aaf-5c89-45bb-b806-e5adc64e1d5a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:34.631561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691aaf-5c89-45bb-b806-e5adc64e1d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:34.631844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691aaf-5c89-45bb-b806-e5adc64e1d5a None admin] PATH_INFO: `/v3/users/552b105a90954a8c9b8f34f2f992b2e6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:34.633030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35691aaf-5c89-45bb-b806-e5adc64e1d5a None admin] RBAC: Authorizing `identity:get_user(user_id=552b105a90954a8c9b8f34f2f992b2e6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:34.634480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35691aaf-5c89-45bb-b806-e5adc64e1d5a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:34.636063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 46/87] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:34 2022] GET /identity/v3/users/552b105a90954a8c9b8f34f2f992b2e6 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:34.636801 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691aaf-5c89-45bb-b806-e5adc64e1d5a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:34.655030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e969519-1dc9-4ae7-bc1a-09f545baff6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:34.655643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e969519-1dc9-4ae7-bc1a-09f545baff6b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:34.655923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e969519-1dc9-4ae7-bc1a-09f545baff6b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:34.657119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e969519-1dc9-4ae7-bc1a-09f545baff6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:34.657879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e969519-1dc9-4ae7-bc1a-09f545baff6b None admin] RBAC: Adding query filter params (role.id=102380322b574754b40ec23fe0394401, scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e, user.id=552b105a90954a8c9b8f34f2f992b2e6) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:34.658194 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e969519-1dc9-4ae7-bc1a-09f545baff6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:34.659626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e969519-1dc9-4ae7-bc1a-09f545baff6b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:34.664987 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 42/88] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:34 2022] GET /identity/v3/role_assignments?user.id=552b105a90954a8c9b8f34f2f992b2e6&scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e&role.id=102380322b574754b40ec23fe0394401 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:34.665621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e969519-1dc9-4ae7-bc1a-09f545baff6b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:34.680815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:34.761970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691aaf-5c89-45bb-b806-e5adc64e1d5a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:34.776416 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e969519-1dc9-4ae7-bc1a-09f545baff6b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:34.811317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb77334-9827-4374-a029-f145e34b42ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:34.811960 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb77334-9827-4374-a029-f145e34b42ea None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:34.812312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb77334-9827-4374-a029-f145e34b42ea None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:34.813269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb77334-9827-4374-a029-f145e34b42ea None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:34.814151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb77334-9827-4374-a029-f145e34b42ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:34.814700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c62b68-dbb0-4970-82db-a3abed4ba068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:34.815848 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c62b68-dbb0-4970-82db-a3abed4ba068 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:34.815950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb77334-9827-4374-a029-f145e34b42ea None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:34.816021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c62b68-dbb0-4970-82db-a3abed4ba068 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:34.816021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c62b68-dbb0-4970-82db-a3abed4ba068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:34.844947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:34.848311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 47/89] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:19:34 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:19:34.849190 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb77334-9827-4374-a029-f145e34b42ea None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:34.932805 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c62b68-dbb0-4970-82db-a3abed4ba068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:34.934999 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c62b68-dbb0-4970-82db-a3abed4ba068 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:34.948468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:34.970985 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb77334-9827-4374-a029-f145e34b42ea None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:35.012127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6eb4c-7d7b-4da6-b9fb-6f87f9326927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:35.013186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6eb4c-7d7b-4da6-b9fb-6f87f9326927 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:35.013674 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6eb4c-7d7b-4da6-b9fb-6f87f9326927 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:35.014132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6eb4c-7d7b-4da6-b9fb-6f87f9326927 None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:35.016851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6eb4c-7d7b-4da6-b9fb-6f87f9326927 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:35.018491 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6eb4c-7d7b-4da6-b9fb-6f87f9326927 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:35.020426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 48/90] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:34 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:35.021757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6eb4c-7d7b-4da6-b9fb-6f87f9326927 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:35.069405 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 43/91] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:35.070437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c62b68-dbb0-4970-82db-a3abed4ba068 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:35.144080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:35.153518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6eb4c-7d7b-4da6-b9fb-6f87f9326927 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:35.197404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc28be-237d-4d39-ae24-b188da276dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:35.198036 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc28be-237d-4d39-ae24-b188da276dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:35.198327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc28be-237d-4d39-ae24-b188da276dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:35.198609 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc28be-237d-4d39-ae24-b188da276dc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:35.207953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c62b68-dbb0-4970-82db-a3abed4ba068 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:35.234946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:35.261804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f7a2-7129-42a8-befd-45568d50bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:35.262785 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f7a2-7129-42a8-befd-45568d50bc54 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:35.263261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f7a2-7129-42a8-befd-45568d50bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:35.263728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f7a2-7129-42a8-befd-45568d50bc54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:35.264745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5f7a2-7129-42a8-befd-45568d50bc54 None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e, user.id=44865c547348438e8c2b72709661a2a7) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:35.265089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5f7a2-7129-42a8-befd-45568d50bc54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:35.267146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5f7a2-7129-42a8-befd-45568d50bc54 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:35.275656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 44/92] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:35 2022] GET /identity/v3/role_assignments?user.id=44865c547348438e8c2b72709661a2a7&scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:35.276945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f7a2-7129-42a8-befd-45568d50bc54 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:35.289453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc28be-237d-4d39-ae24-b188da276dc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:35.291039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc28be-237d-4d39-ae24-b188da276dc6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:35.408369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 49/93] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:35.414276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc28be-237d-4d39-ae24-b188da276dc6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:35.477112 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:35.551850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc28be-237d-4d39-ae24-b188da276dc6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:35.558499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f7a2-7129-42a8-befd-45568d50bc54 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:35.583027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:35.619039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4c4d4-835e-4815-8f51-57b71cce1acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:35.619757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4c4d4-835e-4815-8f51-57b71cce1acd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:35.619988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4c4d4-835e-4815-8f51-57b71cce1acd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:35.620270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4c4d4-835e-4815-8f51-57b71cce1acd None admin] PATH_INFO: `/v3/projects/4418ced0f5f34383affe47188d508916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:35.621787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4c4d4-835e-4815-8f51-57b71cce1acd None admin] RBAC: Authorizing `identity:get_project(project_id=4418ced0f5f34383affe47188d508916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:35.623667 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4c4d4-835e-4815-8f51-57b71cce1acd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:35.626364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 50/94] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:35 2022] GET /identity/v3/projects/4418ced0f5f34383affe47188d508916 => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:35.633952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4c4d4-835e-4815-8f51-57b71cce1acd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:35.642677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56814c5c-1de5-4a2d-905a-648ba0814931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:35.643496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56814c5c-1de5-4a2d-905a-648ba0814931 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:35.643886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56814c5c-1de5-4a2d-905a-648ba0814931 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:35.644267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56814c5c-1de5-4a2d-905a-648ba0814931 None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:35.645601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56814c5c-1de5-4a2d-905a-648ba0814931 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:35.647162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56814c5c-1de5-4a2d-905a-648ba0814931 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:35.653814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 45/95] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:35 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:35.657645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56814c5c-1de5-4a2d-905a-648ba0814931 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:35.756459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4c4d4-835e-4815-8f51-57b71cce1acd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:35.783438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:35.798815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af85332-8436-433f-96e4-4c24047322d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:35.799690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af85332-8436-433f-96e4-4c24047322d9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:35.800124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af85332-8436-433f-96e4-4c24047322d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:35.800550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af85332-8436-433f-96e4-4c24047322d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:35.801704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af85332-8436-433f-96e4-4c24047322d9 None admin] RBAC: Adding query filter params (role.id=102380322b574754b40ec23fe0394401, scope.project.id=4418ced0f5f34383affe47188d508916, user.id=552b105a90954a8c9b8f34f2f992b2e6) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:35.802294 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af85332-8436-433f-96e4-4c24047322d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:35.803898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af85332-8436-433f-96e4-4c24047322d9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:35.812815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 51/96] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:35 2022] GET /identity/v3/role_assignments?user.id=552b105a90954a8c9b8f34f2f992b2e6&scope.project.id=4418ced0f5f34383affe47188d508916&role.id=102380322b574754b40ec23fe0394401 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:35.855035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56814c5c-1de5-4a2d-905a-648ba0814931 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:35.893535 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de0016-5180-4cf7-82cb-cd969c65775c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:35.894172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de0016-5180-4cf7-82cb-cd969c65775c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:35.894463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de0016-5180-4cf7-82cb-cd969c65775c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:35.894746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de0016-5180-4cf7-82cb-cd969c65775c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:35.895563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de0016-5180-4cf7-82cb-cd969c65775c None admin] RBAC: Adding query filter params (role.id=30697c5bde894ea6b08f513a33e8b9ac, scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e, user.id=552b105a90954a8c9b8f34f2f992b2e6) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:35.895880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de0016-5180-4cf7-82cb-cd969c65775c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:35.897503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de0016-5180-4cf7-82cb-cd969c65775c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:35.903971 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 46/97] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:35 2022] GET /identity/v3/role_assignments?user.id=552b105a90954a8c9b8f34f2f992b2e6&scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e&role.id=30697c5bde894ea6b08f513a33e8b9ac => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:37.070280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961c619-9310-4da3-b920-4d87837e67d3 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:37.071286 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961c619-9310-4da3-b920-4d87837e67d3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:37.071802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961c619-9310-4da3-b920-4d87837e67d3 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:37.073402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 52/98] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:37.079356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1853132-8e57-4d23-9ff5-db9f2641b2ab None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:37.079755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1853132-8e57-4d23-9ff5-db9f2641b2ab None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:37.079921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1853132-8e57-4d23-9ff5-db9f2641b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:37.099936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c1853132-8e57-4d23-9ff5-db9f2641b2ab None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:37.101174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c1853132-8e57-4d23-9ff5-db9f2641b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:37.145482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:37.174543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 47/99] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:37.208138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961c619-9310-4da3-b920-4d87837e67d3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:37.362503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961c619-9310-4da3-b920-4d87837e67d3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:37.417664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396f377-abeb-4248-b210-f74e7186341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:37.418680 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396f377-abeb-4248-b210-f74e7186341c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:37.419168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396f377-abeb-4248-b210-f74e7186341c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:37.419643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396f377-abeb-4248-b210-f74e7186341c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:37.433955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396f377-abeb-4248-b210-f74e7186341c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f396f377-abeb-4248-b210-f74e7186341c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:37.440518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:37.441429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:37.442186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:37.442186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:37.442186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:37.442186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:37.442186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:37.442186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:37.442186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:37.442186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:37.442186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:37.442186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:37.442186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:37.442186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:37.445036 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 53/100] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:37.454359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1853132-8e57-4d23-9ff5-db9f2641b2ab None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:37.595268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1853132-8e57-4d23-9ff5-db9f2641b2ab None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:37.643896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb0d41-abd6-4617-80e7-272925787790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:37.644458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb0d41-abd6-4617-80e7-272925787790 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:37.644743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb0d41-abd6-4617-80e7-272925787790 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:37.645058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb0d41-abd6-4617-80e7-272925787790 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:37.645818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb0d41-abd6-4617-80e7-272925787790 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:37.646125 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb0d41-abd6-4617-80e7-272925787790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:37.647575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb0d41-abd6-4617-80e7-272925787790 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:37.661362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 48/101] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:37.666494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396f377-abeb-4248-b210-f74e7186341c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:37.739862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:37.808988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396f377-abeb-4248-b210-f74e7186341c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:37.853424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98868bee-253f-42d5-b2c7-31e5f6123eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:37.854077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98868bee-253f-42d5-b2c7-31e5f6123eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:37.854364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98868bee-253f-42d5-b2c7-31e5f6123eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:37.854639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98868bee-253f-42d5-b2c7-31e5f6123eb8 None admin] PATH_INFO: `/v3/users/552b105a90954a8c9b8f34f2f992b2e6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:37.861620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98868bee-253f-42d5-b2c7-31e5f6123eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=552b105a90954a8c9b8f34f2f992b2e6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:37.863069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98868bee-253f-42d5-b2c7-31e5f6123eb8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:37.864856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 54/102] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:37 2022] GET /identity/v3/users/552b105a90954a8c9b8f34f2f992b2e6 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:37.870231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb0d41-abd6-4617-80e7-272925787790 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:37.872747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bd49a-b3d1-4cb9-bfee-866bf05c7b9d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:37.873063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bd49a-b3d1-4cb9-bfee-866bf05c7b9d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:37.873406 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bd49a-b3d1-4cb9-bfee-866bf05c7b9d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:37.874960 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 55/103] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:19:37.881304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dbabd-2d81-456b-aa7f-5ad3694a38f2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:37.881597 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dbabd-2d81-456b-aa7f-5ad3694a38f2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:37.881886 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dbabd-2d81-456b-aa7f-5ad3694a38f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:37.914322 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-168dbabd-2d81-456b-aa7f-5ad3694a38f2 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:37.915764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-168dbabd-2d81-456b-aa7f-5ad3694a38f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:37.949272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:38.015973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 56/104] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:38.017615 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fbdb2-64d9-411c-8f2c-ac1de6616bef None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:38.018183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fbdb2-64d9-411c-8f2c-ac1de6616bef None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:38.018659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fbdb2-64d9-411c-8f2c-ac1de6616bef None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:38.020110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 57/105] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:38.025382 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aef92-a908-4a76-9295-645d515dafa5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:38.025904 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aef92-a908-4a76-9295-645d515dafa5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:38.026403 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aef92-a908-4a76-9295-645d515dafa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:38.058771 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb0d41-abd6-4617-80e7-272925787790 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:38.063172 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-318aef92-a908-4a76-9295-645d515dafa5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:38.064610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-318aef92-a908-4a76-9295-645d515dafa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:38.099168 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb091c47-ea38-454d-8139-795e46974b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:38.099842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb091c47-ea38-454d-8139-795e46974b8d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:38.100093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb091c47-ea38-454d-8139-795e46974b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:38.100367 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb091c47-ea38-454d-8139-795e46974b8d None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:38.101607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb091c47-ea38-454d-8139-795e46974b8d None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:38.104925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb091c47-ea38-454d-8139-795e46974b8d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:38.105113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 49/106] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:37 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:38.105902 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb091c47-ea38-454d-8139-795e46974b8d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:38.162889 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:38.221900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 58/107] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:38.228923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aef92-a908-4a76-9295-645d515dafa5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:38.291251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb091c47-ea38-454d-8139-795e46974b8d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:38.297821 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:38.361100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31270b61-6279-4191-b41f-18e9537855ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:38.363158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31270b61-6279-4191-b41f-18e9537855ec None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:38.363737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31270b61-6279-4191-b41f-18e9537855ec None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:38.364218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31270b61-6279-4191-b41f-18e9537855ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:38.377585 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31270b61-6279-4191-b41f-18e9537855ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-31270b61-6279-4191-b41f-18e9537855ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:38.384431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:38.385341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:38.386110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:38.386110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:38.386110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:38.386110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:38.386110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:38.386110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:38.386110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:38.386110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:38.386110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:38.386110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:38.386110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:38.386110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:38.391468 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 50/108] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:19:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:38.392549 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31270b61-6279-4191-b41f-18e9537855ec None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:38.450840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aef92-a908-4a76-9295-645d515dafa5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:38.507883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e175656-aeff-410c-8291-d89c0e45844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:38.508978 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e175656-aeff-410c-8291-d89c0e45844f None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:38.509583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e175656-aeff-410c-8291-d89c0e45844f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:38.510063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e175656-aeff-410c-8291-d89c0e45844f None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e/users/552b105a90954a8c9b8f34f2f992b2e6/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:38.512697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e175656-aeff-410c-8291-d89c0e45844f None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec256f5efb04aabbbfa6845545a0e2e, user_id=552b105a90954a8c9b8f34f2f992b2e6, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:38.514437 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e175656-aeff-410c-8291-d89c0e45844f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:38.541885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 59/109] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:19:38 2022] PUT /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e/users/552b105a90954a8c9b8f34f2f992b2e6/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:19:38.543240 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e175656-aeff-410c-8291-d89c0e45844f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:38.636207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:38.691918 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31270b61-6279-4191-b41f-18e9537855ec None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:38.801345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fd2b7-af4e-49d8-91e6-046822648244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:38.801345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fd2b7-af4e-49d8-91e6-046822648244 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:38.801345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fd2b7-af4e-49d8-91e6-046822648244 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:38.801345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fd2b7-af4e-49d8-91e6-046822648244 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:38.834185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e175656-aeff-410c-8291-d89c0e45844f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:38.846080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fd2b7-af4e-49d8-91e6-046822648244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ed6fd2b7-af4e-49d8-91e6-046822648244 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:38.854989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:38.855880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:38.856653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:38.856653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:38.856653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:38.856653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:38.856653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:38.856653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:38.856653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:38.856653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:38.856653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:38.856653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:38.856653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:19:38.856653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:38.861695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 51/110] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:38.863218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e2d8d-cc89-4b48-a95b-3ad930fd5959 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:38.863732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e2d8d-cc89-4b48-a95b-3ad930fd5959 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:38.864231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e2d8d-cc89-4b48-a95b-3ad930fd5959 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:38.868639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 52/111] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:38.870346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fa84f-8bcb-4a00-891a-6f5aead2449b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:38.870868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fa84f-8bcb-4a00-891a-6f5aead2449b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:38.871398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fa84f-8bcb-4a00-891a-6f5aead2449b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:38.873213 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 53/112] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:38.875904 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fa84f-8bcb-4a00-891a-6f5aead2449b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:38.889756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0b7c4-02f1-41f2-bcd7-5f30720cb1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:38.891230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0b7c4-02f1-41f2-bcd7-5f30720cb1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:38.891625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0b7c4-02f1-41f2-bcd7-5f30720cb1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:38.891909 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0b7c4-02f1-41f2-bcd7-5f30720cb1a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:38.892646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0b7c4-02f1-41f2-bcd7-5f30720cb1a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:38.892983 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0b7c4-02f1-41f2-bcd7-5f30720cb1a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:38.894407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0b7c4-02f1-41f2-bcd7-5f30720cb1a6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:38.903283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 60/113] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:38.906349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09a611-28d9-492b-b10b-5873aaeb6867 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:38.906863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09a611-28d9-492b-b10b-5873aaeb6867 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:38.907316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09a611-28d9-492b-b10b-5873aaeb6867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:38.939812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4f09a611-28d9-492b-b10b-5873aaeb6867 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:38.942136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:38.942268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4f09a611-28d9-492b-b10b-5873aaeb6867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:39.064686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 61/114] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:39.066655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c8624-869e-4cc4-9468-5776c57a0202 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:39.067083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c8624-869e-4cc4-9468-5776c57a0202 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:39.067490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c8624-869e-4cc4-9468-5776c57a0202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:39.094883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-328c8624-869e-4cc4-9468-5776c57a0202 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:39.096099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-328c8624-869e-4cc4-9468-5776c57a0202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:39.108831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fa84f-8bcb-4a00-891a-6f5aead2449b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:39.121351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:39.146705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a5a4-404c-4ca9-9369-b03ba6a92a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:39.147401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a5a4-404c-4ca9-9369-b03ba6a92a86 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:39.147693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a5a4-404c-4ca9-9369-b03ba6a92a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:39.148020 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a5a4-404c-4ca9-9369-b03ba6a92a86 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:39.148813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145a5a4-404c-4ca9-9369-b03ba6a92a86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:39.149159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145a5a4-404c-4ca9-9369-b03ba6a92a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:39.150795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145a5a4-404c-4ca9-9369-b03ba6a92a86 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:39.160994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 54/115] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:39.161847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a5a4-404c-4ca9-9369-b03ba6a92a86 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:39.177774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 62/116] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:39.179021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c8624-869e-4cc4-9468-5776c57a0202 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:39.266135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:39.282719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a5a4-404c-4ca9-9369-b03ba6a92a86 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:39.296316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c8624-869e-4cc4-9468-5776c57a0202 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:39.319174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333acae-d6ac-4e47-a1f4-198560aa419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:39.320008 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333acae-d6ac-4e47-a1f4-198560aa419e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:39.320294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333acae-d6ac-4e47-a1f4-198560aa419e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:39.320568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333acae-d6ac-4e47-a1f4-198560aa419e None admin] PATH_INFO: `/v3/users/44865c547348438e8c2b72709661a2a7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:39.321897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333acae-d6ac-4e47-a1f4-198560aa419e None admin] RBAC: Authorizing `identity:get_user(user_id=44865c547348438e8c2b72709661a2a7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:39.323381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333acae-d6ac-4e47-a1f4-198560aa419e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:39.324888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 55/117] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:39 2022] GET /identity/v3/users/44865c547348438e8c2b72709661a2a7 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:39.325661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333acae-d6ac-4e47-a1f4-198560aa419e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:39.336230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e6439-6efa-4f16-9fa0-982d8dc3045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:39.336888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e6439-6efa-4f16-9fa0-982d8dc3045c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:39.337209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e6439-6efa-4f16-9fa0-982d8dc3045c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:39.337490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e6439-6efa-4f16-9fa0-982d8dc3045c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:39.338884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e6439-6efa-4f16-9fa0-982d8dc3045c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:39.340358 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e6439-6efa-4f16-9fa0-982d8dc3045c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:39.347068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 63/118] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:39.347068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e6439-6efa-4f16-9fa0-982d8dc3045c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:39.377977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:39.440457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333acae-d6ac-4e47-a1f4-198560aa419e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:39.458707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e6439-6efa-4f16-9fa0-982d8dc3045c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:39.477240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff659048-088b-42f0-ba9d-6513f823a3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:39.477992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff659048-088b-42f0-ba9d-6513f823a3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:39.478281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff659048-088b-42f0-ba9d-6513f823a3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:39.478559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff659048-088b-42f0-ba9d-6513f823a3e3 None admin] PATH_INFO: `/v3/users/2b3f737e51674a38952151d03e46cf86` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:39.494651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa25c1-d6f6-4260-8cc7-101c9b95b8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:39.494825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff659048-088b-42f0-ba9d-6513f823a3e3 None admin] RBAC: Authorizing `identity:get_user(user_id=2b3f737e51674a38952151d03e46cf86)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:39.495296 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa25c1-d6f6-4260-8cc7-101c9b95b8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:39.495583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa25c1-d6f6-4260-8cc7-101c9b95b8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:39.495861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa25c1-d6f6-4260-8cc7-101c9b95b8a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:39.496178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff659048-088b-42f0-ba9d-6513f823a3e3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:39.502747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 56/119] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:39 2022] GET /identity/v3/users/2b3f737e51674a38952151d03e46cf86 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:39.502747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df88b-4a97-4583-a750-b033993bca44 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:39.502747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df88b-4a97-4583-a750-b033993bca44 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:39.502747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df88b-4a97-4583-a750-b033993bca44 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:39.502747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 57/120] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:39.502747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3df88b-4a97-4583-a750-b033993bca44 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:39.512834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa25c1-d6f6-4260-8cc7-101c9b95b8a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-bbfa25c1-d6f6-4260-8cc7-101c9b95b8a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:39.518352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:39.519205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:39.519992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 64/121] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:19:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:39.520640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa25c1-d6f6-4260-8cc7-101c9b95b8a1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:39.521638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:39.612148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:39.619296 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3df88b-4a97-4583-a750-b033993bca44 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:39.630029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa25c1-d6f6-4260-8cc7-101c9b95b8a1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:39.656109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af782d2e-51e3-44ad-b635-20fac7786d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:39.656946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af782d2e-51e3-44ad-b635-20fac7786d5f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:39.657251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af782d2e-51e3-44ad-b635-20fac7786d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:39.657517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af782d2e-51e3-44ad-b635-20fac7786d5f None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:39.658700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af782d2e-51e3-44ad-b635-20fac7786d5f None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:39.660157 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af782d2e-51e3-44ad-b635-20fac7786d5f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:39.661850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 58/122] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:39 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:39.662610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af782d2e-51e3-44ad-b635-20fac7786d5f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:39.673006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e148a-3cd9-4482-9fb6-d6664f2a788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:39.673633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e148a-3cd9-4482-9fb6-d6664f2a788c None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:39.673924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e148a-3cd9-4482-9fb6-d6664f2a788c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:39.674200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e148a-3cd9-4482-9fb6-d6664f2a788c None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:39.674896 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e148a-3cd9-4482-9fb6-d6664f2a788c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:39.676341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e148a-3cd9-4482-9fb6-d6664f2a788c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:39.705981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 65/123] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:19:39 2022] POST /identity/v3/projects => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:19:39.707347 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc548cb-8d3a-488a-8af4-ad01a3f5cd89 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:39.707689 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc548cb-8d3a-488a-8af4-ad01a3f5cd89 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:39.707973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc548cb-8d3a-488a-8af4-ad01a3f5cd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:39.739050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-bbc548cb-8d3a-488a-8af4-ad01a3f5cd89 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:39.740299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bbc548cb-8d3a-488a-8af4-ad01a3f5cd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:39.781209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:39.808824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af782d2e-51e3-44ad-b635-20fac7786d5f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:39.822299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 66/124] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:39.822996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc548cb-8d3a-488a-8af4-ad01a3f5cd89 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:39.879907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad4d39-7463-4a65-972b-2ac92630eadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:39.881787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad4d39-7463-4a65-972b-2ac92630eadc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:39.881787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad4d39-7463-4a65-972b-2ac92630eadc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:39.881787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad4d39-7463-4a65-972b-2ac92630eadc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:39.917822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:39.962498 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc548cb-8d3a-488a-8af4-ad01a3f5cd89 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:39.965812 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad4d39-7463-4a65-972b-2ac92630eadc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:39.967429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad4d39-7463-4a65-972b-2ac92630eadc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:40.000469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ee108-5694-4c81-8230-a56ad7beffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:40.001449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ee108-5694-4c81-8230-a56ad7beffe5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:40.002009 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ee108-5694-4c81-8230-a56ad7beffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:40.002299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ee108-5694-4c81-8230-a56ad7beffe5 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:40.003165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ee108-5694-4c81-8230-a56ad7beffe5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:40.003491 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ee108-5694-4c81-8230-a56ad7beffe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:40.005535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ee108-5694-4c81-8230-a56ad7beffe5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:40.016021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 67/125] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:19:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:40.017509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ee108-5694-4c81-8230-a56ad7beffe5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:40.067937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:40.096245 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 59/126] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:40.097335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad4d39-7463-4a65-972b-2ac92630eadc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:40.144771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ee108-5694-4c81-8230-a56ad7beffe5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:40.173155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:40.182556 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb39d7-522c-4c14-aee1-8110f74fc20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:40.184233 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb39d7-522c-4c14-aee1-8110f74fc20f None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:40.184734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb39d7-522c-4c14-aee1-8110f74fc20f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:40.185252 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb39d7-522c-4c14-aee1-8110f74fc20f None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e/users/44865c547348438e8c2b72709661a2a7/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:40.187605 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb39d7-522c-4c14-aee1-8110f74fc20f None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec256f5efb04aabbbfa6845545a0e2e, user_id=44865c547348438e8c2b72709661a2a7, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:40.189392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb39d7-522c-4c14-aee1-8110f74fc20f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:40.207992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 68/127] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:19:40 2022] PUT /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e/users/44865c547348438e8c2b72709661a2a7/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:19:40.209298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb39d7-522c-4c14-aee1-8110f74fc20f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:40.212878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad4d39-7463-4a65-972b-2ac92630eadc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:40.270679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18563465-df3d-4528-a2e1-111fc31c28e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:40.271411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18563465-df3d-4528-a2e1-111fc31c28e1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:40.271689 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18563465-df3d-4528-a2e1-111fc31c28e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:40.271966 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18563465-df3d-4528-a2e1-111fc31c28e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:40.295045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18563465-df3d-4528-a2e1-111fc31c28e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-18563465-df3d-4528-a2e1-111fc31c28e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:40.300554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:40.301484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:40.302297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:40.302297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:40.302297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:40.302297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:40.302297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:40.302297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:40.302297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:40.302297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:40.302297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:40.302297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:40.302297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:40.302297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:40.308429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 60/128] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:40.309750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18563465-df3d-4528-a2e1-111fc31c28e1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:40.337733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb39d7-522c-4c14-aee1-8110f74fc20f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:40.382023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26274300-b6ce-402e-aa66-4ca0d56b7ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:40.383028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274300-b6ce-402e-aa66-4ca0d56b7ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:40.383523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274300-b6ce-402e-aa66-4ca0d56b7ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:40.384175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274300-b6ce-402e-aa66-4ca0d56b7ab6 None admin] PATH_INFO: `/v3/users/552b105a90954a8c9b8f34f2f992b2e6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:40.385930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26274300-b6ce-402e-aa66-4ca0d56b7ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=552b105a90954a8c9b8f34f2f992b2e6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:40.389699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26274300-b6ce-402e-aa66-4ca0d56b7ab6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:40.393369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 69/129] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:40 2022] GET /identity/v3/users/552b105a90954a8c9b8f34f2f992b2e6 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:40.396131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26274300-b6ce-402e-aa66-4ca0d56b7ab6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:40.416691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:40.508567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18563465-df3d-4528-a2e1-111fc31c28e1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:40.513677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:40.579402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26274300-b6ce-402e-aa66-4ca0d56b7ab6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:40.581627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6703e-1065-44c0-b59c-ffbaf85e9881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:40.582280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6703e-1065-44c0-b59c-ffbaf85e9881 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:40.582563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6703e-1065-44c0-b59c-ffbaf85e9881 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:40.582840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6703e-1065-44c0-b59c-ffbaf85e9881 None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:40.584456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6703e-1065-44c0-b59c-ffbaf85e9881 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:40.585941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6703e-1065-44c0-b59c-ffbaf85e9881 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:40.588663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 61/130] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:40 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:40.589485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6703e-1065-44c0-b59c-ffbaf85e9881 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:40.651029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c78b0-ead6-4be1-8fa8-07accab9a6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:40.651580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c78b0-ead6-4be1-8fa8-07accab9a6cd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:40.651865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c78b0-ead6-4be1-8fa8-07accab9a6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:40.652142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c78b0-ead6-4be1-8fa8-07accab9a6cd None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:40.653654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c78b0-ead6-4be1-8fa8-07accab9a6cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:40.654179 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c78b0-ead6-4be1-8fa8-07accab9a6cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:40.656569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c78b0-ead6-4be1-8fa8-07accab9a6cd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:40.665807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 70/131] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:40.666963 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c78b0-ead6-4be1-8fa8-07accab9a6cd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:40.741334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6703e-1065-44c0-b59c-ffbaf85e9881 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:40.761265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:40.790033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c78b0-ead6-4be1-8fa8-07accab9a6cd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:40.813262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:40.828392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dfb06-b8e7-4478-9acd-8380cae170ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:40.829649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dfb06-b8e7-4478-9acd-8380cae170ec None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:40.830136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dfb06-b8e7-4478-9acd-8380cae170ec None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:40.830607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dfb06-b8e7-4478-9acd-8380cae170ec None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:40.832028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dfb06-b8e7-4478-9acd-8380cae170ec None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:40.833978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dfb06-b8e7-4478-9acd-8380cae170ec None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:40.834646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1f2e2-c36f-49cf-89ee-ae57e3bb375c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:40.835270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1f2e2-c36f-49cf-89ee-ae57e3bb375c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:40.835557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1f2e2-c36f-49cf-89ee-ae57e3bb375c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:40.835837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1f2e2-c36f-49cf-89ee-ae57e3bb375c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:40.836651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1f2e2-c36f-49cf-89ee-ae57e3bb375c None admin] RBAC: Adding query filter params (role.id=46e6b316a22d4082b00baed02609b6dc, scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e, user.id=2b3f737e51674a38952151d03e46cf86) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:40.836962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 62/132] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:40 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:40.837060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1f2e2-c36f-49cf-89ee-ae57e3bb375c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:40.837995 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dfb06-b8e7-4478-9acd-8380cae170ec None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:40.838439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1f2e2-c36f-49cf-89ee-ae57e3bb375c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:40.844782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 71/133] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:40 2022] GET /identity/v3/role_assignments?user.id=2b3f737e51674a38952151d03e46cf86&scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e&role.id=46e6b316a22d4082b00baed02609b6dc => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:40.851855 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33638-a7cc-45c8-b79f-841b5d1ddbf8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:40.852144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33638-a7cc-45c8-b79f-841b5d1ddbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:40.852420 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33638-a7cc-45c8-b79f-841b5d1ddbf8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:40.854117 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 72/134] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:40.854815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd33638-a7cc-45c8-b79f-841b5d1ddbf8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:41.007711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd33638-a7cc-45c8-b79f-841b5d1ddbf8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:41.012610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dfb06-b8e7-4478-9acd-8380cae170ec None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:41.048795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02576b1-6927-4f61-b974-d56bb3f414a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:41.049592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02576b1-6927-4f61-b974-d56bb3f414a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:41.049880 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02576b1-6927-4f61-b974-d56bb3f414a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:41.050191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02576b1-6927-4f61-b974-d56bb3f414a7 None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e/users/552b105a90954a8c9b8f34f2f992b2e6/roles/30697c5bde894ea6b08f513a33e8b9ac` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:41.052625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02576b1-6927-4f61-b974-d56bb3f414a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec256f5efb04aabbbfa6845545a0e2e, user_id=552b105a90954a8c9b8f34f2f992b2e6, role_id=30697c5bde894ea6b08f513a33e8b9ac)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:41.054228 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02576b1-6927-4f61-b974-d56bb3f414a7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:41.070309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70c2e5-9730-442f-b9f8-9d5682aa091b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:41.070808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 73/135] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:19:40 2022] PUT /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e/users/552b105a90954a8c9b8f34f2f992b2e6/roles/30697c5bde894ea6b08f513a33e8b9ac => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:19:41.071570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70c2e5-9730-442f-b9f8-9d5682aa091b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:41.072099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70c2e5-9730-442f-b9f8-9d5682aa091b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:41.072201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919549d0-14bc-4aa5-a24e-fe7c81c91630 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:41.072534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919549d0-14bc-4aa5-a24e-fe7c81c91630 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:41.072858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919549d0-14bc-4aa5-a24e-fe7c81c91630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:41.073125 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70c2e5-9730-442f-b9f8-9d5682aa091b None admin] PATH_INFO: `/v3/users/552b105a90954a8c9b8f34f2f992b2e6` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:41.074640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70c2e5-9730-442f-b9f8-9d5682aa091b None admin] RBAC: Authorizing `identity:get_user(user_id=552b105a90954a8c9b8f34f2f992b2e6)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:41.076514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70c2e5-9730-442f-b9f8-9d5682aa091b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:41.079546 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 63/136] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:40 2022] GET /identity/v3/users/552b105a90954a8c9b8f34f2f992b2e6 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:41.086092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70c2e5-9730-442f-b9f8-9d5682aa091b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:41.093552 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-919549d0-14bc-4aa5-a24e-fe7c81c91630 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:41.095929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-919549d0-14bc-4aa5-a24e-fe7c81c91630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:41.142449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:41.183136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:41.247590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 74/137] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:41.250874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70c2e5-9730-442f-b9f8-9d5682aa091b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:41.299628 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090fa21-b583-4c7d-84d4-8b7b9de13a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:41.300212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090fa21-b583-4c7d-84d4-8b7b9de13a1d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:41.300500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090fa21-b583-4c7d-84d4-8b7b9de13a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:41.300782 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090fa21-b583-4c7d-84d4-8b7b9de13a1d None admin] PATH_INFO: `/v3/projects/4418ced0f5f34383affe47188d508916` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:41.302011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090fa21-b583-4c7d-84d4-8b7b9de13a1d None admin] RBAC: Authorizing `identity:get_project(project_id=4418ced0f5f34383affe47188d508916)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:41.303462 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090fa21-b583-4c7d-84d4-8b7b9de13a1d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:41.304176 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919549d0-14bc-4aa5-a24e-fe7c81c91630 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:41.305202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 64/138] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:41 2022] GET /identity/v3/projects/4418ced0f5f34383affe47188d508916 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:41.318327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090fa21-b583-4c7d-84d4-8b7b9de13a1d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:41.449456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090fa21-b583-4c7d-84d4-8b7b9de13a1d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:41.465593 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:41.500098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a435ed6-6843-4406-8891-a504e71c2d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:41.501103 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435ed6-6843-4406-8891-a504e71c2d0c None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:41.501534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435ed6-6843-4406-8891-a504e71c2d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:41.501985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435ed6-6843-4406-8891-a504e71c2d0c None admin] PATH_INFO: `/v3/projects/4418ced0f5f34383affe47188d508916/users/552b105a90954a8c9b8f34f2f992b2e6/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:41.510238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a435ed6-6843-4406-8891-a504e71c2d0c None admin] RBAC: Authorizing `identity:create_grant(project_id=4418ced0f5f34383affe47188d508916, user_id=552b105a90954a8c9b8f34f2f992b2e6, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:41.511876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a435ed6-6843-4406-8891-a504e71c2d0c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:41.514380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919549d0-14bc-4aa5-a24e-fe7c81c91630 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:41.537962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 65/139] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:19:41 2022] PUT /identity/v3/projects/4418ced0f5f34383affe47188d508916/users/552b105a90954a8c9b8f34f2f992b2e6/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:19:41.560565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaac41-485b-428d-af7d-afa80c1a8237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:41.561192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaac41-485b-428d-af7d-afa80c1a8237 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:41.561475 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaac41-485b-428d-af7d-afa80c1a8237 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:41.561749 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaac41-485b-428d-af7d-afa80c1a8237 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:41.579222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaac41-485b-428d-af7d-afa80c1a8237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f5aaac41-485b-428d-af7d-afa80c1a8237 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:41.584241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:41.585135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:41.585912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:41.585912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:41.585912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:41.585912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:41.585912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:41.585912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:41.585912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:41.585912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:41.585912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:41.585912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:41.585912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:41.585912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:41.589042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 75/140] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:41.591607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a435ed6-6843-4406-8891-a504e71c2d0c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:41.753897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a435ed6-6843-4406-8891-a504e71c2d0c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:41.792434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317a313-a46c-4bca-8d60-d16bfa404ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:41.793121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317a313-a46c-4bca-8d60-d16bfa404ecc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:41.793406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317a313-a46c-4bca-8d60-d16bfa404ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:41.793681 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317a313-a46c-4bca-8d60-d16bfa404ecc None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:41.794400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317a313-a46c-4bca-8d60-d16bfa404ecc None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:41.794706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317a313-a46c-4bca-8d60-d16bfa404ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:41.796132 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317a313-a46c-4bca-8d60-d16bfa404ecc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:41.808652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 66/141] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:41.814156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaac41-485b-428d-af7d-afa80c1a8237 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:41.867572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:41.949458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaac41-485b-428d-af7d-afa80c1a8237 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:41.999071 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edf060-9a9d-42da-bc41-d3fd2b5d8f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:42.000424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edf060-9a9d-42da-bc41-d3fd2b5d8f66 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:42.000744 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edf060-9a9d-42da-bc41-d3fd2b5d8f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:42.001048 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edf060-9a9d-42da-bc41-d3fd2b5d8f66 None admin] PATH_INFO: `/v3/users/552b105a90954a8c9b8f34f2f992b2e6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:42.005625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edf060-9a9d-42da-bc41-d3fd2b5d8f66 None admin] RBAC: Authorizing `identity:get_user(user_id=552b105a90954a8c9b8f34f2f992b2e6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:42.007092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edf060-9a9d-42da-bc41-d3fd2b5d8f66 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:42.008950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 76/142] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:41 2022] GET /identity/v3/users/552b105a90954a8c9b8f34f2f992b2e6 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:42.014183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317a313-a46c-4bca-8d60-d16bfa404ecc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:42.069998 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:42.161111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317a313-a46c-4bca-8d60-d16bfa404ecc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:42.217621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd4cd0-5921-400e-b98e-d13c931566f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:42.218657 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd4cd0-5921-400e-b98e-d13c931566f0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:42.219141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd4cd0-5921-400e-b98e-d13c931566f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:42.219615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd4cd0-5921-400e-b98e-d13c931566f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:42.305530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd4cd0-5921-400e-b98e-d13c931566f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:42.307768 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd4cd0-5921-400e-b98e-d13c931566f0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:42.350784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:42.438445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 67/143] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:42.443975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edf060-9a9d-42da-bc41-d3fd2b5d8f66 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:42.581682 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:42.585700 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edf060-9a9d-42da-bc41-d3fd2b5d8f66 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:42.627073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd27a6-a4fc-491a-bbab-e24f3e5e8877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:42.627639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd27a6-a4fc-491a-bbab-e24f3e5e8877 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:42.627923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd27a6-a4fc-491a-bbab-e24f3e5e8877 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:42.628199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd27a6-a4fc-491a-bbab-e24f3e5e8877 None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:42.633609 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd27a6-a4fc-491a-bbab-e24f3e5e8877 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:42.635089 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd27a6-a4fc-491a-bbab-e24f3e5e8877 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:42.636763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 77/144] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:42 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:42.643283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd4cd0-5921-400e-b98e-d13c931566f0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:42.694430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645574-c49b-494a-8955-513262321803 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:42.694739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645574-c49b-494a-8955-513262321803 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:42.694984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645574-c49b-494a-8955-513262321803 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:42.696340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 78/145] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:42.704928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caf7a2-18b5-414f-a0f8-3659934f4cb5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:42.704928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caf7a2-18b5-414f-a0f8-3659934f4cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:42.704928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caf7a2-18b5-414f-a0f8-3659934f4cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:42.725244 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-20caf7a2-18b5-414f-a0f8-3659934f4cb5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:42.727125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-20caf7a2-18b5-414f-a0f8-3659934f4cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:42.814775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd4cd0-5921-400e-b98e-d13c931566f0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:42.861226 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 79/146] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:42.863024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724fdc-c3f2-4382-b751-aa50ea38fa02 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:42.863578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724fdc-c3f2-4382-b751-aa50ea38fa02 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:42.864054 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724fdc-c3f2-4382-b751-aa50ea38fa02 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:42.865522 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 80/147] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:42.871763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d7451-6294-4019-9165-7bb7fb6038e2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:42.872278 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d7451-6294-4019-9165-7bb7fb6038e2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:42.872774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d7451-6294-4019-9165-7bb7fb6038e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:42.886635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23cfa0-deab-43c2-9721-82da2d5dda79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:42.890788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23cfa0-deab-43c2-9721-82da2d5dda79 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:42.891336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23cfa0-deab-43c2-9721-82da2d5dda79 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:42.891825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23cfa0-deab-43c2-9721-82da2d5dda79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:42.892822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23cfa0-deab-43c2-9721-82da2d5dda79 None admin] RBAC: Adding query filter params (role.id=102380322b574754b40ec23fe0394401, scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e, user.id=552b105a90954a8c9b8f34f2f992b2e6) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:42.894607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23cfa0-deab-43c2-9721-82da2d5dda79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:42.896386 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23cfa0-deab-43c2-9721-82da2d5dda79 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:42.903286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:42.904741 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d05d7451-6294-4019-9165-7bb7fb6038e2 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:42.908631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d05d7451-6294-4019-9165-7bb7fb6038e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:42.912767 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 68/148] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:42 2022] GET /identity/v3/role_assignments?user.id=552b105a90954a8c9b8f34f2f992b2e6&scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e&role.id=102380322b574754b40ec23fe0394401 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:42.913934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23cfa0-deab-43c2-9721-82da2d5dda79 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:43.056804 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 81/149] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 06 01:19:43.086719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23cfa0-deab-43c2-9721-82da2d5dda79 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:43.095405 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d7451-6294-4019-9165-7bb7fb6038e2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:43.145582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:43.158612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d1d40-3a7f-4d71-beac-a0ab877ee309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:43.159289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d1d40-3a7f-4d71-beac-a0ab877ee309 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:43.159581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d1d40-3a7f-4d71-beac-a0ab877ee309 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:43.159861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d1d40-3a7f-4d71-beac-a0ab877ee309 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:43.180863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d1d40-3a7f-4d71-beac-a0ab877ee309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d48d1d40-3a7f-4d71-beac-a0ab877ee309 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:43.188318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:43.189501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:43.190674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 69/150] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:19:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:43.195763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d1d40-3a7f-4d71-beac-a0ab877ee309 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:43.294855 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d7451-6294-4019-9165-7bb7fb6038e2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:43.321705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:43.392979 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d1d40-3a7f-4d71-beac-a0ab877ee309 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:43.397707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c0064-64b6-4053-8474-6c5e7c63c7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:43.398628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c0064-64b6-4053-8474-6c5e7c63c7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:43.399113 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c0064-64b6-4053-8474-6c5e7c63c7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:43.399595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c0064-64b6-4053-8474-6c5e7c63c7d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:43.401036 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c0064-64b6-4053-8474-6c5e7c63c7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:43.402769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c0064-64b6-4053-8474-6c5e7c63c7d9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:43.404598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 82/151] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:43.419408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c0064-64b6-4053-8474-6c5e7c63c7d9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:43.455280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75ab1f-b7b6-4ffa-8c9d-d3794420ab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:43.455975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75ab1f-b7b6-4ffa-8c9d-d3794420ab94 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:43.456264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75ab1f-b7b6-4ffa-8c9d-d3794420ab94 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:43.456540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75ab1f-b7b6-4ffa-8c9d-d3794420ab94 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:43.457306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75ab1f-b7b6-4ffa-8c9d-d3794420ab94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:43.457622 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75ab1f-b7b6-4ffa-8c9d-d3794420ab94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:43.459004 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75ab1f-b7b6-4ffa-8c9d-d3794420ab94 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:43.467989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 70/152] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:43.477363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75ab1f-b7b6-4ffa-8c9d-d3794420ab94 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:43.539546 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:43.545650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c0064-64b6-4053-8474-6c5e7c63c7d9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:43.582660 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f12bc2-5c6f-45b9-b8f5-9d1e25759363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:43.583378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f12bc2-5c6f-45b9-b8f5-9d1e25759363 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:43.583710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f12bc2-5c6f-45b9-b8f5-9d1e25759363 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:43.583937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f12bc2-5c6f-45b9-b8f5-9d1e25759363 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:43.584730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f12bc2-5c6f-45b9-b8f5-9d1e25759363 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:43.586209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f12bc2-5c6f-45b9-b8f5-9d1e25759363 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:43.612436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 83/153] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:19:43 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:19:43.658832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75ab1f-b7b6-4ffa-8c9d-d3794420ab94 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:43.697600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:43.723667 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb11d7-cfd3-4178-be40-a9a1f54c9bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:43.724340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb11d7-cfd3-4178-be40-a9a1f54c9bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:43.724624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb11d7-cfd3-4178-be40-a9a1f54c9bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:43.724934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb11d7-cfd3-4178-be40-a9a1f54c9bc3 None admin] PATH_INFO: `/v3/users/44865c547348438e8c2b72709661a2a7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:43.726156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb11d7-cfd3-4178-be40-a9a1f54c9bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=44865c547348438e8c2b72709661a2a7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:43.727629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb11d7-cfd3-4178-be40-a9a1f54c9bc3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:43.729504 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 71/154] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:43 2022] GET /identity/v3/users/44865c547348438e8c2b72709661a2a7 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:43.735166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f12bc2-5c6f-45b9-b8f5-9d1e25759363 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:43.855804 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f12bc2-5c6f-45b9-b8f5-9d1e25759363 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:43.892309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b098eb-e0eb-417c-af3e-4d36ca076fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:43.892956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b098eb-e0eb-417c-af3e-4d36ca076fbc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:43.893243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b098eb-e0eb-417c-af3e-4d36ca076fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:43.893518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b098eb-e0eb-417c-af3e-4d36ca076fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:43.925480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:43.967684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b098eb-e0eb-417c-af3e-4d36ca076fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:43.969551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b098eb-e0eb-417c-af3e-4d36ca076fbc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:44.072325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 84/155] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:19:44.078065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb11d7-cfd3-4178-be40-a9a1f54c9bc3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:44.110866 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a18e6-49d9-43b8-949d-bb836343d98e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:44.111204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a18e6-49d9-43b8-949d-bb836343d98e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:44.111428 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a18e6-49d9-43b8-949d-bb836343d98e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:44.113189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 85/156] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:44.118803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8fbe5-cb92-4eb2-b265-a071ce069a7a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:44.119091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8fbe5-cb92-4eb2-b265-a071ce069a7a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:44.119366 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8fbe5-cb92-4eb2-b265-a071ce069a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:44.151673 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3ed8fbe5-cb92-4eb2-b265-a071ce069a7a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:44.153398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3ed8fbe5-cb92-4eb2-b265-a071ce069a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:44.207997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb11d7-cfd3-4178-be40-a9a1f54c9bc3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:44.224714 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:44.244923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c858c-c82c-4374-b6f3-5356be2209ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:44.245573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c858c-c82c-4374-b6f3-5356be2209ec None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:44.245855 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c858c-c82c-4374-b6f3-5356be2209ec None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:44.246205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c858c-c82c-4374-b6f3-5356be2209ec None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:44.247425 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c858c-c82c-4374-b6f3-5356be2209ec None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:44.248337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 86/157] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:44.248993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c858c-c82c-4374-b6f3-5356be2209ec None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:44.251336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 72/158] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:44 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:44.257526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8fbe5-cb92-4eb2-b265-a071ce069a7a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:44.274117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c858c-c82c-4374-b6f3-5356be2209ec None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:44.339433 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:44.389608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8fbe5-cb92-4eb2-b265-a071ce069a7a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:44.394613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c858c-c82c-4374-b6f3-5356be2209ec None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:44.430925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305a192-bdd8-4a86-9f7a-7352e426664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:44.431934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305a192-bdd8-4a86-9f7a-7352e426664e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:44.432281 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305a192-bdd8-4a86-9f7a-7352e426664e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:44.432566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305a192-bdd8-4a86-9f7a-7352e426664e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:44.433408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305a192-bdd8-4a86-9f7a-7352e426664e None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e, user.id=44865c547348438e8c2b72709661a2a7) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:44.433719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305a192-bdd8-4a86-9f7a-7352e426664e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:44.434808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bcd86-8fcf-4db8-b656-56d673dcd289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:44.435281 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305a192-bdd8-4a86-9f7a-7352e426664e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:44.435934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bcd86-8fcf-4db8-b656-56d673dcd289 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:44.436428 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bcd86-8fcf-4db8-b656-56d673dcd289 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:44.438740 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bcd86-8fcf-4db8-b656-56d673dcd289 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:44.447053 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 87/159] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:44 2022] GET /identity/v3/role_assignments?user.id=44865c547348438e8c2b72709661a2a7&scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:44.448569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146cf76-1005-4ad5-bad2-cc12f4327b17 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:44.448874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146cf76-1005-4ad5-bad2-cc12f4327b17 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:44.449184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146cf76-1005-4ad5-bad2-cc12f4327b17 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:44.450407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 88/160] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:44.451429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cb3cf-c6c9-44d4-bc1b-1dec803608d6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:44.453235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cb3cf-c6c9-44d4-bc1b-1dec803608d6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:44.453795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cb3cf-c6c9-44d4-bc1b-1dec803608d6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:44.454994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bcd86-8fcf-4db8-b656-56d673dcd289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:44.456239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 89/161] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-558bcd86-8fcf-4db8-b656-56d673dcd289 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:44.461383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:44.462438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:44.463407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:44.463407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:44.463407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:44.463407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:44.463407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:44.463407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:44.463407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:44.463407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:44.463407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:44.463407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:44.463407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:19:44.463407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:44.464202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571346b-1f47-4561-a7a3-2316fe35d8ed None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:44.464202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571346b-1f47-4561-a7a3-2316fe35d8ed None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:44.464202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571346b-1f47-4561-a7a3-2316fe35d8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:44.466137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 73/162] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:44.467666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78209ba5-d477-4c8e-a9ff-ca2a65a0741c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:44.467958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78209ba5-d477-4c8e-a9ff-ca2a65a0741c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:44.468808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78209ba5-d477-4c8e-a9ff-ca2a65a0741c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:44.493887 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-78209ba5-d477-4c8e-a9ff-ca2a65a0741c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:44.494077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a571346b-1f47-4561-a7a3-2316fe35d8ed None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:44.495179 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a571346b-1f47-4561-a7a3-2316fe35d8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:44.495782 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-78209ba5-d477-4c8e-a9ff-ca2a65a0741c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:44.547282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:44.574298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 90/163] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:44.575177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571346b-1f47-4561-a7a3-2316fe35d8ed None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:44.575952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 74/164] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:44.601898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78209ba5-d477-4c8e-a9ff-ca2a65a0741c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:44.680342 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:44.703097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571346b-1f47-4561-a7a3-2316fe35d8ed None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:44.744283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c6918-89ba-4581-8682-61d49c1574b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:44.744819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c6918-89ba-4581-8682-61d49c1574b5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:44.745127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c6918-89ba-4581-8682-61d49c1574b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:44.745402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c6918-89ba-4581-8682-61d49c1574b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:44.746155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c6918-89ba-4581-8682-61d49c1574b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:44.746425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c6918-89ba-4581-8682-61d49c1574b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:44.747792 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c6918-89ba-4581-8682-61d49c1574b5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:44.751780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78209ba5-d477-4c8e-a9ff-ca2a65a0741c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:44.756830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 91/165] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:44.757592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c6918-89ba-4581-8682-61d49c1574b5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:44.791845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3a591-4f6a-4d1f-86d4-6495f53eaefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:44.792994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3a591-4f6a-4d1f-86d4-6495f53eaefe None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:44.793548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3a591-4f6a-4d1f-86d4-6495f53eaefe None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:44.794028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3a591-4f6a-4d1f-86d4-6495f53eaefe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:44.802674 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:44.808335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3a591-4f6a-4d1f-86d4-6495f53eaefe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b1c3a591-4f6a-4d1f-86d4-6495f53eaefe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:44.815572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:44.816495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:44.817311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:44.817311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:44.817311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:44.817311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:44.817311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:44.817311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:44.817311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:44.817311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:44.817311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:44.817311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:44.817311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:44.817311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:44.819949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 75/166] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:44.825055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3a591-4f6a-4d1f-86d4-6495f53eaefe None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:44.870259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c6918-89ba-4581-8682-61d49c1574b5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:44.908640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754d916-1802-4642-a034-647b6f236e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:44.909349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754d916-1802-4642-a034-647b6f236e79 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:44.909634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754d916-1802-4642-a034-647b6f236e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:44.909909 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754d916-1802-4642-a034-647b6f236e79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:44.923360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754d916-1802-4642-a034-647b6f236e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d754d916-1802-4642-a034-647b6f236e79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:44.929956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:44.930839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:44.931665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 92/167] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:19:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:44.932331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754d916-1802-4642-a034-647b6f236e79 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:44.955929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3a591-4f6a-4d1f-86d4-6495f53eaefe None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:44.965224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:45.028491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b16c0a-bca6-4698-9993-5653fe89720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:45.029509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b16c0a-bca6-4698-9993-5653fe89720b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:45.031414 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b16c0a-bca6-4698-9993-5653fe89720b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:45.033569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b16c0a-bca6-4698-9993-5653fe89720b None admin] PATH_INFO: `/v3/users/2b3f737e51674a38952151d03e46cf86` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:45.036250 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b16c0a-bca6-4698-9993-5653fe89720b None admin] RBAC: Authorizing `identity:get_user(user_id=2b3f737e51674a38952151d03e46cf86)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:45.038840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b16c0a-bca6-4698-9993-5653fe89720b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:45.043075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 76/168] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:44 2022] GET /identity/v3/users/2b3f737e51674a38952151d03e46cf86 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:45.050252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b16c0a-bca6-4698-9993-5653fe89720b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:45.100861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:45.105912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754d916-1802-4642-a034-647b6f236e79 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:45.146505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df026ebd-cf38-40dc-8b69-c79b1e761642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:45.147695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df026ebd-cf38-40dc-8b69-c79b1e761642 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:45.148184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df026ebd-cf38-40dc-8b69-c79b1e761642 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:45.148661 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df026ebd-cf38-40dc-8b69-c79b1e761642 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:45.149697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df026ebd-cf38-40dc-8b69-c79b1e761642 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:45.150209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df026ebd-cf38-40dc-8b69-c79b1e761642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:45.152002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df026ebd-cf38-40dc-8b69-c79b1e761642 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:45.162207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 93/169] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:45.163389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df026ebd-cf38-40dc-8b69-c79b1e761642 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:45.212525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b16c0a-bca6-4698-9993-5653fe89720b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:45.273415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df026ebd-cf38-40dc-8b69-c79b1e761642 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:45.298601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8c7f3-9b96-4718-b217-8a70cbb8ac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:45.299149 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8c7f3-9b96-4718-b217-8a70cbb8ac42 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:45.299430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8c7f3-9b96-4718-b217-8a70cbb8ac42 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:45.299705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8c7f3-9b96-4718-b217-8a70cbb8ac42 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:45.300425 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8c7f3-9b96-4718-b217-8a70cbb8ac42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:45.300773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8c7f3-9b96-4718-b217-8a70cbb8ac42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:45.302134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8c7f3-9b96-4718-b217-8a70cbb8ac42 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:45.313890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1d4bc-7a3b-4458-8cc0-64d7ba7744ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:45.314871 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1d4bc-7a3b-4458-8cc0-64d7ba7744ba None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:45.315367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1d4bc-7a3b-4458-8cc0-64d7ba7744ba None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:45.315864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1d4bc-7a3b-4458-8cc0-64d7ba7744ba None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:45.317322 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1d4bc-7a3b-4458-8cc0-64d7ba7744ba None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:45.319199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1d4bc-7a3b-4458-8cc0-64d7ba7744ba None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:45.320300 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 77/170] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:19:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:45.321230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8c7f3-9b96-4718-b217-8a70cbb8ac42 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:45.321752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 94/171] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:45 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:45.328200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1d4bc-7a3b-4458-8cc0-64d7ba7744ba None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:45.360460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:45.439356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1d4bc-7a3b-4458-8cc0-64d7ba7744ba None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:45.449936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:45.478572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10855c-2af2-48e2-b10d-8b32d329626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:45.479555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10855c-2af2-48e2-b10d-8b32d329626d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:45.480039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10855c-2af2-48e2-b10d-8b32d329626d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:45.480536 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10855c-2af2-48e2-b10d-8b32d329626d None admin] PATH_INFO: `/v3/users/552b105a90954a8c9b8f34f2f992b2e6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:45.482033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10855c-2af2-48e2-b10d-8b32d329626d None admin] RBAC: Authorizing `identity:get_user(user_id=552b105a90954a8c9b8f34f2f992b2e6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:45.483739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10855c-2af2-48e2-b10d-8b32d329626d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:45.485613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 95/172] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:45 2022] GET /identity/v3/users/552b105a90954a8c9b8f34f2f992b2e6 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:45.486755 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10855c-2af2-48e2-b10d-8b32d329626d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:45.597978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8c7f3-9b96-4718-b217-8a70cbb8ac42 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:45.619426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:45.628315 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10855c-2af2-48e2-b10d-8b32d329626d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:45.673488 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ef971-f14c-47fa-ae73-0a666a7b1827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:45.674664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ef971-f14c-47fa-ae73-0a666a7b1827 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:45.675946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ef971-f14c-47fa-ae73-0a666a7b1827 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:45.677072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ef971-f14c-47fa-ae73-0a666a7b1827 None admin] PATH_INFO: `/v3/users/552b105a90954a8c9b8f34f2f992b2e6` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:45.679551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ef971-f14c-47fa-ae73-0a666a7b1827 None admin] RBAC: Authorizing `identity:get_user(user_id=552b105a90954a8c9b8f34f2f992b2e6)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:45.681420 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ef971-f14c-47fa-ae73-0a666a7b1827 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:45.683974 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 78/173] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:45 2022] GET /identity/v3/users/552b105a90954a8c9b8f34f2f992b2e6 => generated 275 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:45.685540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ef971-f14c-47fa-ae73-0a666a7b1827 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:45.692206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815fb4-aceb-4462-8d67-4b8fabc1e15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:45.693864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815fb4-aceb-4462-8d67-4b8fabc1e15f None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:45.694350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815fb4-aceb-4462-8d67-4b8fabc1e15f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:45.695037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1815fb4-aceb-4462-8d67-4b8fabc1e15f None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e/users/2b3f737e51674a38952151d03e46cf86/roles/46e6b316a22d4082b00baed02609b6dc` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:45.703140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1815fb4-aceb-4462-8d67-4b8fabc1e15f None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec256f5efb04aabbbfa6845545a0e2e, user_id=2b3f737e51674a38952151d03e46cf86, role_id=46e6b316a22d4082b00baed02609b6dc)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:45.704879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1815fb4-aceb-4462-8d67-4b8fabc1e15f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:45.725399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 96/174] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:19:45 2022] PUT /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e/users/2b3f737e51674a38952151d03e46cf86/roles/46e6b316a22d4082b00baed02609b6dc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:19:45.726548 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815fb4-aceb-4462-8d67-4b8fabc1e15f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:45.913585 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ef971-f14c-47fa-ae73-0a666a7b1827 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:45.919207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:45.958291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1815fb4-aceb-4462-8d67-4b8fabc1e15f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:45.978846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dfe4a-8778-4239-8c9e-c35a9da76b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:45.979480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dfe4a-8778-4239-8c9e-c35a9da76b3f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:45.979761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dfe4a-8778-4239-8c9e-c35a9da76b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:45.980039 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dfe4a-8778-4239-8c9e-c35a9da76b3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:46.003821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42f6b-f9ef-4a36-8782-7f2b9d8938b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:46.004449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42f6b-f9ef-4a36-8782-7f2b9d8938b8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:46.004731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42f6b-f9ef-4a36-8782-7f2b9d8938b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:46.005795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42f6b-f9ef-4a36-8782-7f2b9d8938b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:46.057147 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:46.104500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dfe4a-8778-4239-8c9e-c35a9da76b3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:46.106007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dfe4a-8778-4239-8c9e-c35a9da76b3f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:46.144534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a42f6b-f9ef-4a36-8782-7f2b9d8938b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:46.146226 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a42f6b-f9ef-4a36-8782-7f2b9d8938b8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:46.279526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 97/175] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:46.286237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42f6b-f9ef-4a36-8782-7f2b9d8938b8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:46.391592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:46.468953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42f6b-f9ef-4a36-8782-7f2b9d8938b8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:46.478494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 79/176] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 793 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:46.485908 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dfe4a-8778-4239-8c9e-c35a9da76b3f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:46.490042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:46.528599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab4548-f69d-4653-8827-ed83fe23a973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:46.529585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab4548-f69d-4653-8827-ed83fe23a973 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:46.530527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab4548-f69d-4653-8827-ed83fe23a973 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:46.530955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab4548-f69d-4653-8827-ed83fe23a973 None admin] PATH_INFO: `/v3/projects/4418ced0f5f34383affe47188d508916` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:46.533874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab4548-f69d-4653-8827-ed83fe23a973 None admin] RBAC: Authorizing `identity:get_project(project_id=4418ced0f5f34383affe47188d508916)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:46.535658 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab4548-f69d-4653-8827-ed83fe23a973 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:46.537876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 98/177] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:46 2022] GET /identity/v3/projects/4418ced0f5f34383affe47188d508916 => generated 312 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:46.543858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab4548-f69d-4653-8827-ed83fe23a973 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:46.736368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab4548-f69d-4653-8827-ed83fe23a973 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:46.743044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dfe4a-8778-4239-8c9e-c35a9da76b3f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:46.769318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:46.789088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf9e28-cea5-4e1c-9b17-d34aeacfc6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:46.789088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9e28-cea5-4e1c-9b17-d34aeacfc6bb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:46.789088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9e28-cea5-4e1c-9b17-d34aeacfc6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:46.789088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9e28-cea5-4e1c-9b17-d34aeacfc6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:46.789473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf9e28-cea5-4e1c-9b17-d34aeacfc6bb None admin] RBAC: Adding query filter params (role.id=102380322b574754b40ec23fe0394401, scope.project.id=4418ced0f5f34383affe47188d508916, user.id=552b105a90954a8c9b8f34f2f992b2e6) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:46.789473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf9e28-cea5-4e1c-9b17-d34aeacfc6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:46.789473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf9e28-cea5-4e1c-9b17-d34aeacfc6bb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:46.803083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 99/178] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:46 2022] GET /identity/v3/role_assignments?user.id=552b105a90954a8c9b8f34f2f992b2e6&scope.project.id=4418ced0f5f34383affe47188d508916&role.id=102380322b574754b40ec23fe0394401 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:46.836584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90b076-5451-4126-a457-1e8d91bfefd7 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:46.836996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90b076-5451-4126-a457-1e8d91bfefd7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:46.837283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90b076-5451-4126-a457-1e8d91bfefd7 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:46.837394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347820a0-e9cc-4ba8-96f2-815e9a4dbd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:46.838049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347820a0-e9cc-4ba8-96f2-815e9a4dbd33 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:46.838335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347820a0-e9cc-4ba8-96f2-815e9a4dbd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:46.838613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347820a0-e9cc-4ba8-96f2-815e9a4dbd33 None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:46.838709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 100/179] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:19:46.843364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347820a0-e9cc-4ba8-96f2-815e9a4dbd33 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:46.844060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024092-cedc-4077-82fc-49e01ea54f59 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:46.844355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024092-cedc-4077-82fc-49e01ea54f59 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:46.844637 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024092-cedc-4077-82fc-49e01ea54f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:46.844865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347820a0-e9cc-4ba8-96f2-815e9a4dbd33 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:46.846905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 80/180] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:46 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:46.852533 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347820a0-e9cc-4ba8-96f2-815e9a4dbd33 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:46.881010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e6024092-cedc-4077-82fc-49e01ea54f59 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:46.884084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e6024092-cedc-4077-82fc-49e01ea54f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:47.030061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:47.043652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 101/181] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:47.084775 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6024092-cedc-4077-82fc-49e01ea54f59 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:47.093632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347820a0-e9cc-4ba8-96f2-815e9a4dbd33 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:47.152657 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe6bd2-1de9-4556-a490-393385d60028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:47.153315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe6bd2-1de9-4556-a490-393385d60028 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:47.153599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe6bd2-1de9-4556-a490-393385d60028 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:47.153885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe6bd2-1de9-4556-a490-393385d60028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:47.159988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe6bd2-1de9-4556-a490-393385d60028 None admin] RBAC: Adding query filter params (role.id=30697c5bde894ea6b08f513a33e8b9ac, scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e, user.id=552b105a90954a8c9b8f34f2f992b2e6) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:47.160309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe6bd2-1de9-4556-a490-393385d60028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:47.161919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe6bd2-1de9-4556-a490-393385d60028 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:47.171831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 81/182] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:46 2022] GET /identity/v3/role_assignments?user.id=552b105a90954a8c9b8f34f2f992b2e6&scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e&role.id=30697c5bde894ea6b08f513a33e8b9ac => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:47.251723 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84a178-55a7-4c38-8f7b-b62782250c2c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:47.252038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84a178-55a7-4c38-8f7b-b62782250c2c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:47.252289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84a178-55a7-4c38-8f7b-b62782250c2c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:47.253685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 82/183] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:19:47.262830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888a987-ce4d-42cb-b211-6081404dc7b8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:47.263401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888a987-ce4d-42cb-b211-6081404dc7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:47.263866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888a987-ce4d-42cb-b211-6081404dc7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:47.267652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6024092-cedc-4077-82fc-49e01ea54f59 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:47.289747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:47.291898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2888a987-ce4d-42cb-b211-6081404dc7b8 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:47.293631 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2888a987-ce4d-42cb-b211-6081404dc7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:47.333541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea170e9-5cf0-41da-885b-2afefa25a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:47.334581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea170e9-5cf0-41da-885b-2afefa25a589 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:47.335055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea170e9-5cf0-41da-885b-2afefa25a589 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:47.335534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea170e9-5cf0-41da-885b-2afefa25a589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:47.360808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea170e9-5cf0-41da-885b-2afefa25a589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-bea170e9-5cf0-41da-885b-2afefa25a589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:47.370837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:47.371754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:47.372554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:47.372554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:47.372554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:47.372554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:47.372554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:47.372554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:47.372554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:47.372554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:47.372554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:47.372554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:47.372554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:47.372554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:47.381632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 102/184] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:19:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:19:47.384750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea170e9-5cf0-41da-885b-2afefa25a589 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:47.429579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 83/185] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:47.431450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d38b87-b6b9-4db4-9502-ebfdf7955b88 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:47.432249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d38b87-b6b9-4db4-9502-ebfdf7955b88 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:47.437384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d38b87-b6b9-4db4-9502-ebfdf7955b88 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:47.439134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 84/186] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:47.445135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fde71f-2138-407e-b2aa-a3979644c86b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:47.445629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fde71f-2138-407e-b2aa-a3979644c86b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:47.446133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fde71f-2138-407e-b2aa-a3979644c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:47.469957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-48fde71f-2138-407e-b2aa-a3979644c86b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:47.471452 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-48fde71f-2138-407e-b2aa-a3979644c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:47.538608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea170e9-5cf0-41da-885b-2afefa25a589 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:47.542516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:47.557081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 85/187] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:47.557973 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fde71f-2138-407e-b2aa-a3979644c86b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:47.584240 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2537d-bb3f-4032-be29-e3fcb51f9af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:47.584780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2537d-bb3f-4032-be29-e3fcb51f9af4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:47.585088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2537d-bb3f-4032-be29-e3fcb51f9af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:47.585362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2537d-bb3f-4032-be29-e3fcb51f9af4 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:47.586084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2537d-bb3f-4032-be29-e3fcb51f9af4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:47.586495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2537d-bb3f-4032-be29-e3fcb51f9af4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:47.588003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2537d-bb3f-4032-be29-e3fcb51f9af4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:47.597563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 103/188] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:47.598454 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2537d-bb3f-4032-be29-e3fcb51f9af4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:47.643287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:47.682742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fde71f-2138-407e-b2aa-a3979644c86b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:47.703988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2537d-bb3f-4032-be29-e3fcb51f9af4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:47.719758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ece50c-e8c6-4be4-9271-dffebad7da3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:47.720397 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ece50c-e8c6-4be4-9271-dffebad7da3a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:47.720679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ece50c-e8c6-4be4-9271-dffebad7da3a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:47.720982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ece50c-e8c6-4be4-9271-dffebad7da3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:47.722117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ece50c-e8c6-4be4-9271-dffebad7da3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:47.723548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ece50c-e8c6-4be4-9271-dffebad7da3a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:47.725184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 86/189] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:47.730110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ece50c-e8c6-4be4-9271-dffebad7da3a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:47.740448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fc82f-174e-499c-872a-651de73411c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:47.741246 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fc82f-174e-499c-872a-651de73411c4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:47.741532 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fc82f-174e-499c-872a-651de73411c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:47.741811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fc82f-174e-499c-872a-651de73411c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:47.752865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fc82f-174e-499c-872a-651de73411c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-070fc82f-174e-499c-872a-651de73411c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:47.758221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:47.759103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:47.759885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 104/190] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:19:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:47.760563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fc82f-174e-499c-872a-651de73411c4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:47.807201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:47.847647 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ece50c-e8c6-4be4-9271-dffebad7da3a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:47.864178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:47.868227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fc82f-174e-499c-872a-651de73411c4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:47.884227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378c9e-6368-4eb8-883c-ccc93bdb64c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:47.884867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378c9e-6368-4eb8-883c-ccc93bdb64c6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:47.885179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378c9e-6368-4eb8-883c-ccc93bdb64c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:47.885462 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9378c9e-6368-4eb8-883c-ccc93bdb64c6 None admin] PATH_INFO: `/v3/users/7db7dbc741b44025912fa58c4492e585` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:47.899617 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9378c9e-6368-4eb8-883c-ccc93bdb64c6 None admin] RBAC: Authorizing `identity:get_user(user_id=7db7dbc741b44025912fa58c4492e585)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:47.901101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9378c9e-6368-4eb8-883c-ccc93bdb64c6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:47.902990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 87/191] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:47 2022] GET /identity/v3/users/7db7dbc741b44025912fa58c4492e585 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:47.903538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378c9e-6368-4eb8-883c-ccc93bdb64c6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:47.906500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973044f8-9944-4a6c-9073-f843973ce899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:47.907417 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973044f8-9944-4a6c-9073-f843973ce899 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:47.907704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973044f8-9944-4a6c-9073-f843973ce899 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:47.908806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973044f8-9944-4a6c-9073-f843973ce899 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:47.909570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973044f8-9944-4a6c-9073-f843973ce899 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:47.910973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973044f8-9944-4a6c-9073-f843973ce899 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:47.934276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 105/192] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:19:47 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:19:47.945929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973044f8-9944-4a6c-9073-f843973ce899 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:48.036072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9378c9e-6368-4eb8-883c-ccc93bdb64c6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:48.063241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:48.078678 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d3ea2-0338-44b5-a22d-160c9e75ec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:48.079057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973044f8-9944-4a6c-9073-f843973ce899 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:48.079883 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d3ea2-0338-44b5-a22d-160c9e75ec67 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:48.080358 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d3ea2-0338-44b5-a22d-160c9e75ec67 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:48.080878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d3ea2-0338-44b5-a22d-160c9e75ec67 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:48.081952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d3ea2-0338-44b5-a22d-160c9e75ec67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:48.082491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d3ea2-0338-44b5-a22d-160c9e75ec67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:48.084272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d3ea2-0338-44b5-a22d-160c9e75ec67 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:48.095449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 88/193] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:19:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:48.100606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d3ea2-0338-44b5-a22d-160c9e75ec67 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:48.124566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080a9a6-63e2-40a8-82c1-82f74ddb5035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:48.125249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080a9a6-63e2-40a8-82c1-82f74ddb5035 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:48.125533 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080a9a6-63e2-40a8-82c1-82f74ddb5035 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:48.125811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080a9a6-63e2-40a8-82c1-82f74ddb5035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:48.159488 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:48.223865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080a9a6-63e2-40a8-82c1-82f74ddb5035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:48.226642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080a9a6-63e2-40a8-82c1-82f74ddb5035 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:48.239133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d3ea2-0338-44b5-a22d-160c9e75ec67 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:48.288392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc1f47-817b-4cde-87ec-d257a8a4d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:48.289165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc1f47-817b-4cde-87ec-d257a8a4d463 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:48.289451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc1f47-817b-4cde-87ec-d257a8a4d463 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:48.289731 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc1f47-817b-4cde-87ec-d257a8a4d463 None admin] PATH_INFO: `/v3/users/7db7dbc741b44025912fa58c4492e585` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:48.291708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc1f47-817b-4cde-87ec-d257a8a4d463 None admin] RBAC: Authorizing `identity:get_user(user_id=7db7dbc741b44025912fa58c4492e585)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:48.293935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc1f47-817b-4cde-87ec-d257a8a4d463 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:48.295761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 89/194] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:48 2022] GET /identity/v3/users/7db7dbc741b44025912fa58c4492e585 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:48.297487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad902d-3692-45f2-8897-56b3780f26c0 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:48.297777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad902d-3692-45f2-8897-56b3780f26c0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:48.298057 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad902d-3692-45f2-8897-56b3780f26c0 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:48.299315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 90/195] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:48.304612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba7798-e4a5-48f4-98fc-a4c5d369c667 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:48.304979 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba7798-e4a5-48f4-98fc-a4c5d369c667 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:48.305224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba7798-e4a5-48f4-98fc-a4c5d369c667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:48.324574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d4ba7798-e4a5-48f4-98fc-a4c5d369c667 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:48.326144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d4ba7798-e4a5-48f4-98fc-a4c5d369c667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:48.355145 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 106/196] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:48.355977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080a9a6-63e2-40a8-82c1-82f74ddb5035 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:48.389319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:48.419571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 91/197] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:48.420432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba7798-e4a5-48f4-98fc-a4c5d369c667 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:48.428354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:48.491344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080a9a6-63e2-40a8-82c1-82f74ddb5035 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:48.535084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba7798-e4a5-48f4-98fc-a4c5d369c667 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:48.542033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f8836-7a1d-43fa-9d84-5f8b2cdbbbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:48.543442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f8836-7a1d-43fa-9d84-5f8b2cdbbbeb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:48.543934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f8836-7a1d-43fa-9d84-5f8b2cdbbbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:48.544427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f8836-7a1d-43fa-9d84-5f8b2cdbbbeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:48.572781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebc57b-ceef-4e07-b218-3017eb93d410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:48.573482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebc57b-ceef-4e07-b218-3017eb93d410 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:48.573787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebc57b-ceef-4e07-b218-3017eb93d410 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:48.574110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebc57b-ceef-4e07-b218-3017eb93d410 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:48.575284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebc57b-ceef-4e07-b218-3017eb93d410 None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:48.576929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebc57b-ceef-4e07-b218-3017eb93d410 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:48.579249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 92/198] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:48 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:48.580017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebc57b-ceef-4e07-b218-3017eb93d410 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:48.640779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:48.642223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f8836-7a1d-43fa-9d84-5f8b2cdbbbeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:48.643797 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f8836-7a1d-43fa-9d84-5f8b2cdbbbeb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:48.693929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebc57b-ceef-4e07-b218-3017eb93d410 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:48.706020 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:48.732865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcef48-9fab-42de-b994-95054c5c5f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:48.733742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcef48-9fab-42de-b994-95054c5c5f83 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:48.734037 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcef48-9fab-42de-b994-95054c5c5f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:48.734311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcef48-9fab-42de-b994-95054c5c5f83 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:48.745214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcef48-9fab-42de-b994-95054c5c5f83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-36fcef48-9fab-42de-b994-95054c5c5f83 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:48.751106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:48.751997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:48.752795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 93/199] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:48.753501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcef48-9fab-42de-b994-95054c5c5f83 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:48.761785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 107/200] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:48.762801 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f8836-7a1d-43fa-9d84-5f8b2cdbbbeb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:48.862670 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcef48-9fab-42de-b994-95054c5c5f83 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:48.866988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f8836-7a1d-43fa-9d84-5f8b2cdbbbeb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:48.875112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:48.903819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a9466-a25d-41f5-be23-960d9873100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:48.904272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a9466-a25d-41f5-be23-960d9873100a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:48.904552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a9466-a25d-41f5-be23-960d9873100a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:48.904826 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a9466-a25d-41f5-be23-960d9873100a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:48.905699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a9466-a25d-41f5-be23-960d9873100a None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695, user.id=7db7dbc741b44025912fa58c4492e585) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:48.906011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a9466-a25d-41f5-be23-960d9873100a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:48.907118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f906a-50eb-4fd7-b4ed-1f30bda89271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:48.907461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a9466-a25d-41f5-be23-960d9873100a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:48.908066 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f906a-50eb-4fd7-b4ed-1f30bda89271 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:48.908493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f906a-50eb-4fd7-b4ed-1f30bda89271 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:48.908941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f906a-50eb-4fd7-b4ed-1f30bda89271 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:48.909808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f906a-50eb-4fd7-b4ed-1f30bda89271 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:48.910255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f906a-50eb-4fd7-b4ed-1f30bda89271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:48.911762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f906a-50eb-4fd7-b4ed-1f30bda89271 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:48.918098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 94/201] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:48 2022] GET /identity/v3/role_assignments?user.id=7db7dbc741b44025912fa58c4492e585&scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:48.918098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a9466-a25d-41f5-be23-960d9873100a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:48.933546 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 108/202] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:48.940188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f906a-50eb-4fd7-b4ed-1f30bda89271 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:48.977236 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:49.033773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a9466-a25d-41f5-be23-960d9873100a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:49.072151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885e283-9f4c-4ae1-87ac-54ec9bdca67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:49.072856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885e283-9f4c-4ae1-87ac-54ec9bdca67f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:49.073166 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885e283-9f4c-4ae1-87ac-54ec9bdca67f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:49.073440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885e283-9f4c-4ae1-87ac-54ec9bdca67f None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:49.074623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885e283-9f4c-4ae1-87ac-54ec9bdca67f None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:49.076219 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885e283-9f4c-4ae1-87ac-54ec9bdca67f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:49.078586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 95/203] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:48 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:49.084724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885e283-9f4c-4ae1-87ac-54ec9bdca67f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:49.155475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:49.157539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f906a-50eb-4fd7-b4ed-1f30bda89271 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:49.209629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c074550-9e75-40ed-89e5-3fabd7f40a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:49.210629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c074550-9e75-40ed-89e5-3fabd7f40a32 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:49.211093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c074550-9e75-40ed-89e5-3fabd7f40a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:49.211545 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c074550-9e75-40ed-89e5-3fabd7f40a32 None admin] PATH_INFO: `/v3/users/2b3f737e51674a38952151d03e46cf86` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:49.212978 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c074550-9e75-40ed-89e5-3fabd7f40a32 None admin] RBAC: Authorizing `identity:get_user(user_id=2b3f737e51674a38952151d03e46cf86)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:49.214600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c074550-9e75-40ed-89e5-3fabd7f40a32 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:49.216580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 109/204] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:48 2022] GET /identity/v3/users/2b3f737e51674a38952151d03e46cf86 => generated 289 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:49.220963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885e283-9f4c-4ae1-87ac-54ec9bdca67f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:49.222473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c074550-9e75-40ed-89e5-3fabd7f40a32 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:49.261096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5cc1e-9e63-4c8c-860b-daef59096edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:49.261096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5cc1e-9e63-4c8c-860b-daef59096edf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:49.261096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5cc1e-9e63-4c8c-860b-daef59096edf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:49.261096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5cc1e-9e63-4c8c-860b-daef59096edf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:49.261500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5cc1e-9e63-4c8c-860b-daef59096edf None admin] RBAC: Adding query filter params (role.id=30697c5bde894ea6b08f513a33e8b9ac, scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695, user.id=7db7dbc741b44025912fa58c4492e585) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:49.261500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5cc1e-9e63-4c8c-860b-daef59096edf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:49.261500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5cc1e-9e63-4c8c-860b-daef59096edf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:49.274934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 96/205] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:49 2022] GET /identity/v3/role_assignments?user.id=7db7dbc741b44025912fa58c4492e585&scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695&role.id=30697c5bde894ea6b08f513a33e8b9ac => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:49.352789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:49.372014 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c074550-9e75-40ed-89e5-3fabd7f40a32 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:49.436177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d8f2c-a91f-45be-be63-d535241f42d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:49.437391 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d8f2c-a91f-45be-be63-d535241f42d1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:49.437789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d8f2c-a91f-45be-be63-d535241f42d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:49.438067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d8f2c-a91f-45be-be63-d535241f42d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:49.543479 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d8f2c-a91f-45be-be63-d535241f42d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:49.545431 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d8f2c-a91f-45be-be63-d535241f42d1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:49.678028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:49.700371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 110/206] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:19:49.706876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5cc1e-9e63-4c8c-860b-daef59096edf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:49.824964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5cc1e-9e63-4c8c-860b-daef59096edf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:49.833250 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:49.861215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2948f-1690-4ee6-9b1b-2ac60346348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:49.861863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2948f-1690-4ee6-9b1b-2ac60346348b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:49.862143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2948f-1690-4ee6-9b1b-2ac60346348b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:49.862416 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2948f-1690-4ee6-9b1b-2ac60346348b None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:49.863582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2948f-1690-4ee6-9b1b-2ac60346348b None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:49.865050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2948f-1690-4ee6-9b1b-2ac60346348b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:49.867086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 97/207] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:49 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:49.872852 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d8f2c-a91f-45be-be63-d535241f42d1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:50.016537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d8f2c-a91f-45be-be63-d535241f42d1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:50.059835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80381f-ff64-4b6b-a16b-3edb3b59ad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:50.060458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80381f-ff64-4b6b-a16b-3edb3b59ad6a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:50.060739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80381f-ff64-4b6b-a16b-3edb3b59ad6a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:50.061035 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80381f-ff64-4b6b-a16b-3edb3b59ad6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:50.062009 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80381f-ff64-4b6b-a16b-3edb3b59ad6a None admin] RBAC: Adding query filter params (role.id=46e6b316a22d4082b00baed02609b6dc, scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e, user.id=2b3f737e51674a38952151d03e46cf86) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:50.062320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80381f-ff64-4b6b-a16b-3edb3b59ad6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:50.063843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80381f-ff64-4b6b-a16b-3edb3b59ad6a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:50.070151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 111/208] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:49 2022] GET /identity/v3/role_assignments?user.id=2b3f737e51674a38952151d03e46cf86&scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e&role.id=46e6b316a22d4082b00baed02609b6dc => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:50.442454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87e2e4-f96a-4b62-a7de-b30b2b201cb4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:50.444382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87e2e4-f96a-4b62-a7de-b30b2b201cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:50.444382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87e2e4-f96a-4b62-a7de-b30b2b201cb4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:50.444382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 98/209] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:50.450500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6abd87-2af2-4a23-b6d5-6608fabc2b51 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:50.450958 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6abd87-2af2-4a23-b6d5-6608fabc2b51 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:50.451398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6abd87-2af2-4a23-b6d5-6608fabc2b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:50.472984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fd6abd87-2af2-4a23-b6d5-6608fabc2b51 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:50.474425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fd6abd87-2af2-4a23-b6d5-6608fabc2b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:50.524105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:50.532334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03451b82-182f-4c84-8d58-75c830fabbb9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:50.532624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03451b82-182f-4c84-8d58-75c830fabbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:50.532924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03451b82-182f-4c84-8d58-75c830fabbb9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:50.534522 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 99/210] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:50.541790 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce04eb2-8456-4008-9f60-e632d7438fc3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:50.542265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce04eb2-8456-4008-9f60-e632d7438fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:50.542664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce04eb2-8456-4008-9f60-e632d7438fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:50.548064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 112/211] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:50.563996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8ce04eb2-8456-4008-9f60-e632d7438fc3 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:50.565550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8ce04eb2-8456-4008-9f60-e632d7438fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:50.574430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6abd87-2af2-4a23-b6d5-6608fabc2b51 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:50.641613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 100/212] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:50.665745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce04eb2-8456-4008-9f60-e632d7438fc3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:50.692486 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6abd87-2af2-4a23-b6d5-6608fabc2b51 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:50.729257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437146d-6429-4888-9568-2fa29ef7bdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:50.729919 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437146d-6429-4888-9568-2fa29ef7bdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:50.730205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437146d-6429-4888-9568-2fa29ef7bdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:50.730487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437146d-6429-4888-9568-2fa29ef7bdc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:50.743342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437146d-6429-4888-9568-2fa29ef7bdc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5437146d-6429-4888-9568-2fa29ef7bdc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:50.748456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:50.750175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:50.751335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:50.751335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:50.751335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:50.751335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:50.751335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:50.751335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:50.751335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:50.751335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:50.751335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:50.751335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:50.751335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:50.751335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:50.753432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 113/213] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:19:50.759011 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437146d-6429-4888-9568-2fa29ef7bdc9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:50.799189 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce04eb2-8456-4008-9f60-e632d7438fc3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:50.801666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:50.811202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:50.836252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711527db-04ec-489c-a8ff-f956908e0550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:50.836929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711527db-04ec-489c-a8ff-f956908e0550 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:50.837234 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711527db-04ec-489c-a8ff-f956908e0550 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:50.837509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711527db-04ec-489c-a8ff-f956908e0550 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:50.838659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711527db-04ec-489c-a8ff-f956908e0550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:50.840101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711527db-04ec-489c-a8ff-f956908e0550 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:50.846347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 101/214] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:50.847272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711527db-04ec-489c-a8ff-f956908e0550 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:50.880719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437146d-6429-4888-9568-2fa29ef7bdc9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:50.918938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a6df0-0d63-437f-8a39-20021583f0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:50.919777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a6df0-0d63-437f-8a39-20021583f0fa None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:50.920197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a6df0-0d63-437f-8a39-20021583f0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:50.920608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a6df0-0d63-437f-8a39-20021583f0fa None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:50.921656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a6df0-0d63-437f-8a39-20021583f0fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:50.922183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a6df0-0d63-437f-8a39-20021583f0fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:50.923752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a6df0-0d63-437f-8a39-20021583f0fa None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:50.938467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 114/215] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:50.939648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a6df0-0d63-437f-8a39-20021583f0fa None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:50.958248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711527db-04ec-489c-a8ff-f956908e0550 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:50.993339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac25d8f-bb76-4d4a-9d3b-57ba5654a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:50.993992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac25d8f-bb76-4d4a-9d3b-57ba5654a416 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:50.994275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac25d8f-bb76-4d4a-9d3b-57ba5654a416 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:50.994609 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac25d8f-bb76-4d4a-9d3b-57ba5654a416 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:50.995304 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac25d8f-bb76-4d4a-9d3b-57ba5654a416 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:50.996860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac25d8f-bb76-4d4a-9d3b-57ba5654a416 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:51.022077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 102/216] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:19:50 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:19:51.049619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a6df0-0d63-437f-8a39-20021583f0fa None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:51.051805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:51.089629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb01f24-83d7-4dd4-adb4-72837fb36b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:51.090698 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb01f24-83d7-4dd4-adb4-72837fb36b94 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:51.091174 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb01f24-83d7-4dd4-adb4-72837fb36b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:51.091639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb01f24-83d7-4dd4-adb4-72837fb36b94 None admin] PATH_INFO: `/v3/users/28450ddee7384175ba983ef8e2d61f0e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:51.107656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb01f24-83d7-4dd4-adb4-72837fb36b94 None admin] RBAC: Authorizing `identity:get_user(user_id=28450ddee7384175ba983ef8e2d61f0e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:51.109762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb01f24-83d7-4dd4-adb4-72837fb36b94 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:51.111952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 115/217] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:50 2022] GET /identity/v3/users/28450ddee7384175ba983ef8e2d61f0e => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:51.118916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac25d8f-bb76-4d4a-9d3b-57ba5654a416 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:51.155708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:51.241119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac25d8f-bb76-4d4a-9d3b-57ba5654a416 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:51.276715 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d5d3b-3933-4b8c-a9b2-e49d263d427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:51.277370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d5d3b-3933-4b8c-a9b2-e49d263d427e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:51.277649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d5d3b-3933-4b8c-a9b2-e49d263d427e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:51.277921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d5d3b-3933-4b8c-a9b2-e49d263d427e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:51.348198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d5d3b-3933-4b8c-a9b2-e49d263d427e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:51.349705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d5d3b-3933-4b8c-a9b2-e49d263d427e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:51.386343 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:51.394364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daf84b-fcf4-4f58-97ec-9765248ced5f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:51.395765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daf84b-fcf4-4f58-97ec-9765248ced5f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:51.396254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daf84b-fcf4-4f58-97ec-9765248ced5f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:51.398184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 116/218] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:51.404877 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e35a2a-3761-475c-b65d-488f488ea928 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:51.405830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e35a2a-3761-475c-b65d-488f488ea928 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:51.406100 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e35a2a-3761-475c-b65d-488f488ea928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:51.429099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-79e35a2a-3761-475c-b65d-488f488ea928 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:51.430560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-79e35a2a-3761-475c-b65d-488f488ea928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:51.480548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 103/219] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:51.488984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d5d3b-3933-4b8c-a9b2-e49d263d427e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:51.506566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 117/220] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:51.530954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e35a2a-3761-475c-b65d-488f488ea928 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:51.605552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d5d3b-3933-4b8c-a9b2-e49d263d427e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:51.637509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:51.647339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c05ce-1625-45c5-970a-a776fb4a0e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:51.648220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c05ce-1625-45c5-970a-a776fb4a0e7b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:51.648822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c05ce-1625-45c5-970a-a776fb4a0e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:51.649139 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c05ce-1625-45c5-970a-a776fb4a0e7b None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:51.650344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c05ce-1625-45c5-970a-a776fb4a0e7b None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:51.651974 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:51.652153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c05ce-1625-45c5-970a-a776fb4a0e7b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:51.655320 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 104/221] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:51 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:51.663409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c05ce-1625-45c5-970a-a776fb4a0e7b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:51.663706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e35a2a-3761-475c-b65d-488f488ea928 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:51.715220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd35a9a-4634-4105-a8d4-a939524caf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:51.715869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd35a9a-4634-4105-a8d4-a939524caf61 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:51.716156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd35a9a-4634-4105-a8d4-a939524caf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:51.716437 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd35a9a-4634-4105-a8d4-a939524caf61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:51.728480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd35a9a-4634-4105-a8d4-a939524caf61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4bd35a9a-4634-4105-a8d4-a939524caf61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:51.734116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:51.735192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:51.736085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 118/222] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:19:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:51.736890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92923716-6bdd-4818-bfc9-e4acd36fd074 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:51.737071 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92923716-6bdd-4818-bfc9-e4acd36fd074 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:51.737354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92923716-6bdd-4818-bfc9-e4acd36fd074 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:51.738724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 119/223] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:51.744019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92923716-6bdd-4818-bfc9-e4acd36fd074 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:51.791774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c05ce-1625-45c5-970a-a776fb4a0e7b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:51.829906 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b101cbe-2b0d-4063-b212-9f8ac68e6a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:51.831282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b101cbe-2b0d-4063-b212-9f8ac68e6a8e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:51.831739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b101cbe-2b0d-4063-b212-9f8ac68e6a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:51.832187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b101cbe-2b0d-4063-b212-9f8ac68e6a8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:51.833370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b101cbe-2b0d-4063-b212-9f8ac68e6a8e None admin] RBAC: Adding query filter params (role.id=102380322b574754b40ec23fe0394401, scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695, user.id=28450ddee7384175ba983ef8e2d61f0e) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:51.833903 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b101cbe-2b0d-4063-b212-9f8ac68e6a8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:51.835587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b101cbe-2b0d-4063-b212-9f8ac68e6a8e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:51.842157 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 105/224] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:51 2022] GET /identity/v3/role_assignments?user.id=28450ddee7384175ba983ef8e2d61f0e&scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695&role.id=102380322b574754b40ec23fe0394401 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:51.843835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296c2ad-6740-4647-bf5a-82723148b098 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:51.844350 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296c2ad-6740-4647-bf5a-82723148b098 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:51.844839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296c2ad-6740-4647-bf5a-82723148b098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:51.864629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e296c2ad-6740-4647-bf5a-82723148b098 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:51.866304 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e296c2ad-6740-4647-bf5a-82723148b098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:51.898963 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92923716-6bdd-4818-bfc9-e4acd36fd074 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:51.933541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:51.942184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 106/225] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:51.966365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296c2ad-6740-4647-bf5a-82723148b098 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:51.970143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c3230-2e4c-469b-ae40-7513a932bfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:51.970895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c3230-2e4c-469b-ae40-7513a932bfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:51.972091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c3230-2e4c-469b-ae40-7513a932bfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:51.972091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c3230-2e4c-469b-ae40-7513a932bfd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:51.972292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c3230-2e4c-469b-ae40-7513a932bfd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:51.976943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c3230-2e4c-469b-ae40-7513a932bfd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:51.976943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c3230-2e4c-469b-ae40-7513a932bfd7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:51.983778 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 120/226] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:51.992536 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c3230-2e4c-469b-ae40-7513a932bfd7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:52.024479 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:52.135547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296c2ad-6740-4647-bf5a-82723148b098 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:52.147288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c3230-2e4c-469b-ae40-7513a932bfd7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:52.175414 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38774a-7789-4ee1-a0a7-3678fb653e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:52.176064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38774a-7789-4ee1-a0a7-3678fb653e60 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:52.176343 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38774a-7789-4ee1-a0a7-3678fb653e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:52.176614 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38774a-7789-4ee1-a0a7-3678fb653e60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:52.200739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38774a-7789-4ee1-a0a7-3678fb653e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:52.208223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a0c0e-f9e7-444f-8218-a32b2ca1747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:52.208927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a0c0e-f9e7-444f-8218-a32b2ca1747f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:52.209228 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a0c0e-f9e7-444f-8218-a32b2ca1747f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:52.209503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a0c0e-f9e7-444f-8218-a32b2ca1747f None admin] PATH_INFO: `/v3/users/7db7dbc741b44025912fa58c4492e585` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:52.210725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a0c0e-f9e7-444f-8218-a32b2ca1747f None admin] RBAC: Authorizing `identity:get_user(user_id=7db7dbc741b44025912fa58c4492e585)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:52.212242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a0c0e-f9e7-444f-8218-a32b2ca1747f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-bb38774a-7789-4ee1-a0a7-3678fb653e60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:52.213199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:52.214066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:52.214869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:52.214869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:52.214869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:52.214869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:52.214869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:52.214869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:52.214869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:52.214869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:52.214869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:52.214869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:52.214869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:19:52.214869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:52.215474 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 121/227] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:51 2022] GET /identity/v3/users/7db7dbc741b44025912fa58c4492e585 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:52.215548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 107/228] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:19:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:19:52.220665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a0c0e-f9e7-444f-8218-a32b2ca1747f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:52.221825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38774a-7789-4ee1-a0a7-3678fb653e60 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:52.313305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:52.339582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a0c0e-f9e7-444f-8218-a32b2ca1747f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:52.380220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e737da-7e6a-4129-bfe7-68f51b52e145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:52.380867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e737da-7e6a-4129-bfe7-68f51b52e145 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:52.381259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e737da-7e6a-4129-bfe7-68f51b52e145 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:52.381532 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e737da-7e6a-4129-bfe7-68f51b52e145 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:52.383017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e737da-7e6a-4129-bfe7-68f51b52e145 None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:52.384726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e737da-7e6a-4129-bfe7-68f51b52e145 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:52.386769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 122/229] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:52 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:52.391385 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:52.394270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e737da-7e6a-4129-bfe7-68f51b52e145 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:52.491282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38774a-7789-4ee1-a0a7-3678fb653e60 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:52.510867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e737da-7e6a-4129-bfe7-68f51b52e145 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:52.535918 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b544bd-c482-4bc8-80f7-6544e2f95843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:52.536869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b544bd-c482-4bc8-80f7-6544e2f95843 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:52.537418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b544bd-c482-4bc8-80f7-6544e2f95843 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:52.537903 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b544bd-c482-4bc8-80f7-6544e2f95843 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:52.538816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b544bd-c482-4bc8-80f7-6544e2f95843 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:52.539317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b544bd-c482-4bc8-80f7-6544e2f95843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:52.540881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b544bd-c482-4bc8-80f7-6544e2f95843 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:52.549845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abae9e0-670f-4841-afca-a2e953d514fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:52.551079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abae9e0-670f-4841-afca-a2e953d514fb None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:52.551480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abae9e0-670f-4841-afca-a2e953d514fb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:52.551698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 108/230] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:19:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:52.551919 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abae9e0-670f-4841-afca-a2e953d514fb None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695/users/7db7dbc741b44025912fa58c4492e585/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:52.554133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abae9e0-670f-4841-afca-a2e953d514fb None admin] RBAC: Authorizing `identity:create_grant(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695, user_id=7db7dbc741b44025912fa58c4492e585, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:52.555619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abae9e0-670f-4841-afca-a2e953d514fb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:52.556722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b544bd-c482-4bc8-80f7-6544e2f95843 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:52.584061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 123/231] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:19:52 2022] PUT /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695/users/7db7dbc741b44025912fa58c4492e585/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:19:52.673483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b544bd-c482-4bc8-80f7-6544e2f95843 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:52.692930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:52.727082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1da3f8-d92d-43ac-9ab6-ab5930dfa9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:52.728145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1da3f8-d92d-43ac-9ab6-ab5930dfa9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:52.728632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1da3f8-d92d-43ac-9ab6-ab5930dfa9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:52.729145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1da3f8-d92d-43ac-9ab6-ab5930dfa9c3 None admin] PATH_INFO: `/v3/users/7db7dbc741b44025912fa58c4492e585` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:52.730750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1da3f8-d92d-43ac-9ab6-ab5930dfa9c3 None admin] RBAC: Authorizing `identity:get_user(user_id=7db7dbc741b44025912fa58c4492e585)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:52.732441 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1da3f8-d92d-43ac-9ab6-ab5930dfa9c3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:52.734771 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 109/232] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:52 2022] GET /identity/v3/users/7db7dbc741b44025912fa58c4492e585 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:52.740598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abae9e0-670f-4841-afca-a2e953d514fb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:52.761297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:52.859080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abae9e0-670f-4841-afca-a2e953d514fb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:52.897822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8448176-939d-4e4a-b228-a089a43745b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:52.898465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8448176-939d-4e4a-b228-a089a43745b4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:52.898747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8448176-939d-4e4a-b228-a089a43745b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:52.899020 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8448176-939d-4e4a-b228-a089a43745b4 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:52.900329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8448176-939d-4e4a-b228-a089a43745b4 None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:52.901808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8448176-939d-4e4a-b228-a089a43745b4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:52.903670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 124/233] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:52 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:52.909496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1da3f8-d92d-43ac-9ab6-ab5930dfa9c3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:53.032215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1da3f8-d92d-43ac-9ab6-ab5930dfa9c3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:53.075753 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd385a-d224-49d0-b0f8-d153f0975ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:53.076440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd385a-d224-49d0-b0f8-d153f0975ea2 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:53.076723 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd385a-d224-49d0-b0f8-d153f0975ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:53.077530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd385a-d224-49d0-b0f8-d153f0975ea2 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695/users/7db7dbc741b44025912fa58c4492e585/roles/30697c5bde894ea6b08f513a33e8b9ac` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:53.079933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd385a-d224-49d0-b0f8-d153f0975ea2 None admin] RBAC: Authorizing `identity:create_grant(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695, user_id=7db7dbc741b44025912fa58c4492e585, role_id=30697c5bde894ea6b08f513a33e8b9ac)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:53.081471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd385a-d224-49d0-b0f8-d153f0975ea2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:53.111691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 110/234] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:19:52 2022] PUT /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695/users/7db7dbc741b44025912fa58c4492e585/roles/30697c5bde894ea6b08f513a33e8b9ac => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:19:53.755832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeeb4b-b34c-49a2-9f3f-376ac88d52f8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:53.756250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeeb4b-b34c-49a2-9f3f-376ac88d52f8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:53.756533 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabeeb4b-b34c-49a2-9f3f-376ac88d52f8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:53.757925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 125/235] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:53.763137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634e6d0-1fa2-4122-97ee-b76d175abf5d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:53.763435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634e6d0-1fa2-4122-97ee-b76d175abf5d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:53.763710 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634e6d0-1fa2-4122-97ee-b76d175abf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:53.783195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d634e6d0-1fa2-4122-97ee-b76d175abf5d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:53.784395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d634e6d0-1fa2-4122-97ee-b76d175abf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:53.836387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:53.888756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 111/236] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:53.925516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeeb4b-b34c-49a2-9f3f-376ac88d52f8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:54.008780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb11a9-d76b-418f-92c3-c3242a83dea1 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:54.009312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb11a9-d76b-418f-92c3-c3242a83dea1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:54.009390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb11a9-d76b-418f-92c3-c3242a83dea1 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:54.010711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 112/237] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:19:54.017484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d9ff9-3178-446d-84e0-0fa41beb7c00 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:54.017764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d9ff9-3178-446d-84e0-0fa41beb7c00 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:54.018044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d9ff9-3178-446d-84e0-0fa41beb7c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:54.033259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:54.040003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-643d9ff9-3178-446d-84e0-0fa41beb7c00 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:54.041444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-643d9ff9-3178-446d-84e0-0fa41beb7c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:54.072130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabeeb4b-b34c-49a2-9f3f-376ac88d52f8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:54.142872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 113/238] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:54.165962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d9ff9-3178-446d-84e0-0fa41beb7c00 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:54.169592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fe4f2-c047-4dfb-bd31-6fef9f15b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:54.170507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fe4f2-c047-4dfb-bd31-6fef9f15b480 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:54.171045 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fe4f2-c047-4dfb-bd31-6fef9f15b480 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:54.171718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fe4f2-c047-4dfb-bd31-6fef9f15b480 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:54.175422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fe4f2-c047-4dfb-bd31-6fef9f15b480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:54.177137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fe4f2-c047-4dfb-bd31-6fef9f15b480 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:54.179254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 126/239] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:54.184457 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fe4f2-c047-4dfb-bd31-6fef9f15b480 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:54.316446 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fe4f2-c047-4dfb-bd31-6fef9f15b480 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:54.334042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:54.337229 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d9ff9-3178-446d-84e0-0fa41beb7c00 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:54.364815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068ed8b-bd99-4ffa-ac13-acbc83fe8477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:54.365467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068ed8b-bd99-4ffa-ac13-acbc83fe8477 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:54.365752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068ed8b-bd99-4ffa-ac13-acbc83fe8477 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:54.366034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068ed8b-bd99-4ffa-ac13-acbc83fe8477 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:54.366972 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068ed8b-bd99-4ffa-ac13-acbc83fe8477 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:54.369018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068ed8b-bd99-4ffa-ac13-acbc83fe8477 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:54.379385 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036a732-da94-4d4d-a262-72922ed7c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:54.380321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036a732-da94-4d4d-a262-72922ed7c379 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:54.380814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036a732-da94-4d4d-a262-72922ed7c379 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:54.381334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036a732-da94-4d4d-a262-72922ed7c379 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:54.393597 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:54.395464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036a732-da94-4d4d-a262-72922ed7c379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:54.400012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 127/240] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:19:54 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:19:54.401441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce97ac-ec3f-47cc-b2db-3281e9e4cb4f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:54.401650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce97ac-ec3f-47cc-b2db-3281e9e4cb4f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:54.402221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce97ac-ec3f-47cc-b2db-3281e9e4cb4f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-3036a732-da94-4d4d-a262-72922ed7c379 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:54.405336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:54.406311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:54.407152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:54.407152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:54.407152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:54.407152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:54.407152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:54.407152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:54.407152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:54.407152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:54.407152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:54.407152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:54.407152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:19:54.407152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:54.408648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 128/241] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:54.409923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 114/242] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:54.410564 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b4184-9181-4ed8-ae39-120bb1c882e5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:54.410924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b4184-9181-4ed8-ae39-120bb1c882e5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:54.411366 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b4184-9181-4ed8-ae39-120bb1c882e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:54.418622 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036a732-da94-4d4d-a262-72922ed7c379 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:54.436979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-957b4184-9181-4ed8-ae39-120bb1c882e5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:54.436979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-957b4184-9181-4ed8-ae39-120bb1c882e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:54.525638 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 129/243] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:54.565937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b4184-9181-4ed8-ae39-120bb1c882e5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:54.599172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036a732-da94-4d4d-a262-72922ed7c379 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:54.642463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee567c2-e3ee-42d7-82e1-5769ae96879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:54.643095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee567c2-e3ee-42d7-82e1-5769ae96879d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:54.643379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee567c2-e3ee-42d7-82e1-5769ae96879d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:54.643766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee567c2-e3ee-42d7-82e1-5769ae96879d None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:54.644553 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee567c2-e3ee-42d7-82e1-5769ae96879d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:54.644982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee567c2-e3ee-42d7-82e1-5769ae96879d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:54.646433 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee567c2-e3ee-42d7-82e1-5769ae96879d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:54.656237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 115/244] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:54.661720 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee567c2-e3ee-42d7-82e1-5769ae96879d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:54.692936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:54.714478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b4184-9181-4ed8-ae39-120bb1c882e5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:54.753336 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:54.760118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa387558-7923-4130-a032-a297bd764dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:54.760790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa387558-7923-4130-a032-a297bd764dda None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:54.761114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa387558-7923-4130-a032-a297bd764dda None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:54.761389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa387558-7923-4130-a032-a297bd764dda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:54.776210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa387558-7923-4130-a032-a297bd764dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-fa387558-7923-4130-a032-a297bd764dda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:54.782424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:54.783349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:54.784178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 130/245] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:19:54.789311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa387558-7923-4130-a032-a297bd764dda None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:54.800320 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee567c2-e3ee-42d7-82e1-5769ae96879d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:54.848165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b68d76-c6c6-4d2b-816d-f7acfc284d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:54.849134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b68d76-c6c6-4d2b-816d-f7acfc284d67 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:54.849891 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b68d76-c6c6-4d2b-816d-f7acfc284d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:54.850933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b68d76-c6c6-4d2b-816d-f7acfc284d67 None admin] PATH_INFO: `/v3/users/943299d32a90452f9553303ab906fc84` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:54.872619 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b68d76-c6c6-4d2b-816d-f7acfc284d67 None admin] RBAC: Authorizing `identity:get_user(user_id=943299d32a90452f9553303ab906fc84)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:54.875576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b68d76-c6c6-4d2b-816d-f7acfc284d67 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:54.879068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 116/246] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:54 2022] GET /identity/v3/users/943299d32a90452f9553303ab906fc84 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:54.883671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b68d76-c6c6-4d2b-816d-f7acfc284d67 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:54.935859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa387558-7923-4130-a032-a297bd764dda None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:54.990831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97ed89-7c2a-4be9-807f-ce157f2ebcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:54.991585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97ed89-7c2a-4be9-807f-ce157f2ebcac None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:54.991941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97ed89-7c2a-4be9-807f-ce157f2ebcac None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:54.992711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97ed89-7c2a-4be9-807f-ce157f2ebcac None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:54.993482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97ed89-7c2a-4be9-807f-ce157f2ebcac None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:54.993800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97ed89-7c2a-4be9-807f-ce157f2ebcac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:54.995431 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97ed89-7c2a-4be9-807f-ce157f2ebcac None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:55.007282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 131/247] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:55.011802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:55.013910 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97ed89-7c2a-4be9-807f-ce157f2ebcac None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:55.036885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b68d76-c6c6-4d2b-816d-f7acfc284d67 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:55.072637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de4f3f-f8df-4f7d-937e-4c9368b3ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:55.073322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de4f3f-f8df-4f7d-937e-4c9368b3ad01 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:55.073605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de4f3f-f8df-4f7d-937e-4c9368b3ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:55.073877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de4f3f-f8df-4f7d-937e-4c9368b3ad01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:55.076355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:55.132357 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97ed89-7c2a-4be9-807f-ce157f2ebcac None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:55.149752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de4f3f-f8df-4f7d-937e-4c9368b3ad01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:55.151320 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de4f3f-f8df-4f7d-937e-4c9368b3ad01 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:55.171930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae578e9-a07d-4924-809f-d623743eb5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:55.173040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae578e9-a07d-4924-809f-d623743eb5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:55.173538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae578e9-a07d-4924-809f-d623743eb5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:55.174009 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae578e9-a07d-4924-809f-d623743eb5d3 None admin] PATH_INFO: `/v3/users/28450ddee7384175ba983ef8e2d61f0e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:55.175416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae578e9-a07d-4924-809f-d623743eb5d3 None admin] RBAC: Authorizing `identity:get_user(user_id=28450ddee7384175ba983ef8e2d61f0e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:55.177191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae578e9-a07d-4924-809f-d623743eb5d3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:55.179549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 132/248] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:55 2022] GET /identity/v3/users/28450ddee7384175ba983ef8e2d61f0e => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:55.184672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae578e9-a07d-4924-809f-d623743eb5d3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:55.263491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:55.292649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 117/249] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:19:55.293985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce459124-ebd2-4214-9031-371e3f8cf5d4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:55.294275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce459124-ebd2-4214-9031-371e3f8cf5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:55.294552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce459124-ebd2-4214-9031-371e3f8cf5d4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:55.297180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 118/250] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:55.303036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce459124-ebd2-4214-9031-371e3f8cf5d4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:55.330252 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae578e9-a07d-4924-809f-d623743eb5d3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:55.370908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:55.399384 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73584655-c9b8-4f90-bc92-54df2012147f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:55.399958 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73584655-c9b8-4f90-bc92-54df2012147f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:55.400245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73584655-c9b8-4f90-bc92-54df2012147f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:55.400525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73584655-c9b8-4f90-bc92-54df2012147f None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:55.401827 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73584655-c9b8-4f90-bc92-54df2012147f None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:55.404407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73584655-c9b8-4f90-bc92-54df2012147f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:55.406548 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 133/251] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:55 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:55.407560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea27fc-a778-459f-aa24-41c5417a1ca1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:55.407853 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea27fc-a778-459f-aa24-41c5417a1ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:55.408130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea27fc-a778-459f-aa24-41c5417a1ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:55.445953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9eea27fc-a778-459f-aa24-41c5417a1ca1 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:55.447161 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9eea27fc-a778-459f-aa24-41c5417a1ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:55.474957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce459124-ebd2-4214-9031-371e3f8cf5d4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:55.517400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494aa127-410c-476e-a37f-1781ab99914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:55.518059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494aa127-410c-476e-a37f-1781ab99914c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:55.518343 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494aa127-410c-476e-a37f-1781ab99914c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:55.518623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494aa127-410c-476e-a37f-1781ab99914c None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:55.522803 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494aa127-410c-476e-a37f-1781ab99914c None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:55.525774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494aa127-410c-476e-a37f-1781ab99914c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:55.527503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 119/252] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:55 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:55.528789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494aa127-410c-476e-a37f-1781ab99914c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:55.597147 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 134/253] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:55.597835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea27fc-a778-459f-aa24-41c5417a1ca1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:55.632560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:55.743764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494aa127-410c-476e-a37f-1781ab99914c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:55.793091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea27fc-a778-459f-aa24-41c5417a1ca1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:55.801151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125376d-6d40-40dc-967d-99fcfc7dc8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:55.802369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125376d-6d40-40dc-967d-99fcfc7dc8f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:55.802741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125376d-6d40-40dc-967d-99fcfc7dc8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:55.803029 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125376d-6d40-40dc-967d-99fcfc7dc8f6 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695/users/28450ddee7384175ba983ef8e2d61f0e/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:55.805951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125376d-6d40-40dc-967d-99fcfc7dc8f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695, user_id=28450ddee7384175ba983ef8e2d61f0e, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:55.808282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125376d-6d40-40dc-967d-99fcfc7dc8f6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:55.812943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:55.829030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 120/254] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:19:55 2022] PUT /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695/users/28450ddee7384175ba983ef8e2d61f0e/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:19:55.830458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125376d-6d40-40dc-967d-99fcfc7dc8f6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:55.836413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1f2d2-d635-4254-a1bf-6daefd0cabf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:55.837212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1f2d2-d635-4254-a1bf-6daefd0cabf4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:55.837565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1f2d2-d635-4254-a1bf-6daefd0cabf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:55.837912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1f2d2-d635-4254-a1bf-6daefd0cabf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:55.838863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1f2d2-d635-4254-a1bf-6daefd0cabf4 None admin] RBAC: Adding query filter params (role.id=46e6b316a22d4082b00baed02609b6dc, scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695, user.id=943299d32a90452f9553303ab906fc84) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:55.839243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1f2d2-d635-4254-a1bf-6daefd0cabf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:55.841601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1f2d2-d635-4254-a1bf-6daefd0cabf4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:55.850299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 135/255] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:55 2022] GET /identity/v3/role_assignments?user.id=943299d32a90452f9553303ab906fc84&scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695&role.id=46e6b316a22d4082b00baed02609b6dc => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:55.858759 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41c733-ede7-4f4d-bc21-db59a4744a22 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:55.859045 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41c733-ede7-4f4d-bc21-db59a4744a22 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:55.859414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41c733-ede7-4f4d-bc21-db59a4744a22 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:55.861227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 136/256] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:55.877369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51bf77-1ef5-402b-b8c4-4be8753ab102 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:55.877693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51bf77-1ef5-402b-b8c4-4be8753ab102 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:55.878069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51bf77-1ef5-402b-b8c4-4be8753ab102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:55.916631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4e51bf77-1ef5-402b-b8c4-4be8753ab102 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:55.918027 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4e51bf77-1ef5-402b-b8c4-4be8753ab102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:55.968369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125376d-6d40-40dc-967d-99fcfc7dc8f6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:55.981041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:56.014809 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 137/257] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:19:56.026686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c5b5a-a99f-450e-82b1-8cc74930f9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:56.027418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c5b5a-a99f-450e-82b1-8cc74930f9bf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:56.027709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c5b5a-a99f-450e-82b1-8cc74930f9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:56.027988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c5b5a-a99f-450e-82b1-8cc74930f9bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:56.038818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51bf77-1ef5-402b-b8c4-4be8753ab102 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:56.046235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c5b5a-a99f-450e-82b1-8cc74930f9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ff3c5b5a-a99f-450e-82b1-8cc74930f9bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:56.051807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:56.053964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:56.055885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 121/258] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:19:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:56.061442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c5b5a-a99f-450e-82b1-8cc74930f9bf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:56.162012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51bf77-1ef5-402b-b8c4-4be8753ab102 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:56.176661 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:56.178184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c5b5a-a99f-450e-82b1-8cc74930f9bf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:56.202671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9874cc6-78cc-43b7-9bfe-683158dd986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:56.203422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9874cc6-78cc-43b7-9bfe-683158dd986c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:56.203706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9874cc6-78cc-43b7-9bfe-683158dd986c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:56.204078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9874cc6-78cc-43b7-9bfe-683158dd986c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:56.215177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9874cc6-78cc-43b7-9bfe-683158dd986c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:56.216105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0646a-a072-4894-8e3c-368ec27de517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:56.216736 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0646a-a072-4894-8e3c-368ec27de517 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:56.217038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0646a-a072-4894-8e3c-368ec27de517 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:56.217318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0646a-a072-4894-8e3c-368ec27de517 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:56.218765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0646a-a072-4894-8e3c-368ec27de517 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:56.219025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0646a-a072-4894-8e3c-368ec27de517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:56.220423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0646a-a072-4894-8e3c-368ec27de517 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d9874cc6-78cc-43b7-9bfe-683158dd986c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:56.221383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:56.223372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:56.225416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 138/259] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:19:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:19:56.230257 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 122/260] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:56.231310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9874cc6-78cc-43b7-9bfe-683158dd986c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:56.236490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0646a-a072-4894-8e3c-368ec27de517 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:56.297384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:56.380719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9874cc6-78cc-43b7-9bfe-683158dd986c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:56.419639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0646a-a072-4894-8e3c-368ec27de517 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:56.419985 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cea548-5ab4-403a-b9c3-4061c9a01832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:56.420778 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cea548-5ab4-403a-b9c3-4061c9a01832 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:56.421191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cea548-5ab4-403a-b9c3-4061c9a01832 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:56.421470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cea548-5ab4-403a-b9c3-4061c9a01832 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:56.422296 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cea548-5ab4-403a-b9c3-4061c9a01832 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:56.422604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cea548-5ab4-403a-b9c3-4061c9a01832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:56.423984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cea548-5ab4-403a-b9c3-4061c9a01832 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:56.433309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 139/261] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:19:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:56.439858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cea548-5ab4-403a-b9c3-4061c9a01832 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:56.457798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6fb47-1edd-4b9e-89f2-79b252d16f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:56.458349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6fb47-1edd-4b9e-89f2-79b252d16f44 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:56.458632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6fb47-1edd-4b9e-89f2-79b252d16f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:56.458904 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6fb47-1edd-4b9e-89f2-79b252d16f44 None admin] PATH_INFO: `/v3/users/7db7dbc741b44025912fa58c4492e585` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:56.460286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6fb47-1edd-4b9e-89f2-79b252d16f44 None admin] RBAC: Authorizing `identity:get_user(user_id=7db7dbc741b44025912fa58c4492e585)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:56.461752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6fb47-1edd-4b9e-89f2-79b252d16f44 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:56.463699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 123/262] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:56 2022] GET /identity/v3/users/7db7dbc741b44025912fa58c4492e585 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:56.470572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6fb47-1edd-4b9e-89f2-79b252d16f44 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:56.494447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:56.620179 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cea548-5ab4-403a-b9c3-4061c9a01832 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:56.656636 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:56.661811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e604d-83b4-48d7-83d7-80c7c709188d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:56.663842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e604d-83b4-48d7-83d7-80c7c709188d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:56.664126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e604d-83b4-48d7-83d7-80c7c709188d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:56.664402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e604d-83b4-48d7-83d7-80c7c709188d None admin] PATH_INFO: `/v3/users/7db7dbc741b44025912fa58c4492e585` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:56.666430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6fb47-1edd-4b9e-89f2-79b252d16f44 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:56.668615 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e604d-83b4-48d7-83d7-80c7c709188d None admin] RBAC: Authorizing `identity:get_user(user_id=7db7dbc741b44025912fa58c4492e585)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:56.670375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e604d-83b4-48d7-83d7-80c7c709188d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:56.673902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 140/263] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:56 2022] GET /identity/v3/users/7db7dbc741b44025912fa58c4492e585 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:56.680927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e604d-83b4-48d7-83d7-80c7c709188d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:56.766582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aa476-1484-43e2-acdc-578548a07303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:56.767241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aa476-1484-43e2-acdc-578548a07303 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:56.767530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aa476-1484-43e2-acdc-578548a07303 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:56.767810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aa476-1484-43e2-acdc-578548a07303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:56.792730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e604d-83b4-48d7-83d7-80c7c709188d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:56.794335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:56.832098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11baf9-76cc-42a5-9eaa-087ae7548674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:56.832724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11baf9-76cc-42a5-9eaa-087ae7548674 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:56.833033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11baf9-76cc-42a5-9eaa-087ae7548674 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:56.833309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11baf9-76cc-42a5-9eaa-087ae7548674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:56.907914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11baf9-76cc-42a5-9eaa-087ae7548674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:56.909323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11baf9-76cc-42a5-9eaa-087ae7548674 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:56.931266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54aa476-1484-43e2-acdc-578548a07303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:56.932540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54aa476-1484-43e2-acdc-578548a07303 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:57.021890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 141/264] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:57.027531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11baf9-76cc-42a5-9eaa-087ae7548674 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:57.029513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:57.132940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:57.144705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11baf9-76cc-42a5-9eaa-087ae7548674 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:57.145315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 124/265] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:19:57.152164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aa476-1484-43e2-acdc-578548a07303 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:57.188949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99913d-1dbe-40dc-80eb-ab3dc1b82227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:57.189468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99913d-1dbe-40dc-80eb-ab3dc1b82227 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:57.189749 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99913d-1dbe-40dc-80eb-ab3dc1b82227 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:57.190173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99913d-1dbe-40dc-80eb-ab3dc1b82227 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:57.191340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99913d-1dbe-40dc-80eb-ab3dc1b82227 None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:57.192789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99913d-1dbe-40dc-80eb-ab3dc1b82227 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:57.194903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 142/266] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:57 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:57.200445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99913d-1dbe-40dc-80eb-ab3dc1b82227 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:57.288593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:57.305999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99913d-1dbe-40dc-80eb-ab3dc1b82227 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:57.342123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3c73c-b198-46f4-8bfe-6c702f616d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:57.342855 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3c73c-b198-46f4-8bfe-6c702f616d94 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:57.343142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3c73c-b198-46f4-8bfe-6c702f616d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:57.343417 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3c73c-b198-46f4-8bfe-6c702f616d94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:57.344338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3c73c-b198-46f4-8bfe-6c702f616d94 None admin] RBAC: Adding query filter params (role.id=30697c5bde894ea6b08f513a33e8b9ac, scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695, user.id=7db7dbc741b44025912fa58c4492e585) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:57.344652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3c73c-b198-46f4-8bfe-6c702f616d94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:57.346133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3c73c-b198-46f4-8bfe-6c702f616d94 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:57.352438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 143/267] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:57 2022] GET /identity/v3/role_assignments?user.id=7db7dbc741b44025912fa58c4492e585&scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695&role.id=30697c5bde894ea6b08f513a33e8b9ac => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:57.385352 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aa476-1484-43e2-acdc-578548a07303 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:57.441547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068ddc1-8e3c-4397-948d-6a54dc28cd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:57.442514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068ddc1-8e3c-4397-948d-6a54dc28cd44 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:57.442981 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068ddc1-8e3c-4397-948d-6a54dc28cd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:57.443454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068ddc1-8e3c-4397-948d-6a54dc28cd44 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:57.444892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068ddc1-8e3c-4397-948d-6a54dc28cd44 None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:57.446594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068ddc1-8e3c-4397-948d-6a54dc28cd44 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:57.448640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 125/268] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:57 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:57.455072 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3c73c-b198-46f4-8bfe-6c702f616d94 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:57.573195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3c73c-b198-46f4-8bfe-6c702f616d94 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:57.609957 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6cc51-1f8c-4c59-a3e3-05e001177b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:57.610675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6cc51-1f8c-4c59-a3e3-05e001177b2b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:57.610959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6cc51-1f8c-4c59-a3e3-05e001177b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:57.611235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6cc51-1f8c-4c59-a3e3-05e001177b2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:57.612029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6cc51-1f8c-4c59-a3e3-05e001177b2b None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695, user.id=7db7dbc741b44025912fa58c4492e585) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:57.612337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6cc51-1f8c-4c59-a3e3-05e001177b2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:57.613783 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6cc51-1f8c-4c59-a3e3-05e001177b2b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:57.615632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:57.620450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 144/269] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:19:57 2022] GET /identity/v3/role_assignments?user.id=7db7dbc741b44025912fa58c4492e585&scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:58.020643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851fa7c-f2b3-45f7-a26b-e22f0cb6169b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.021033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851fa7c-f2b3-45f7-a26b-e22f0cb6169b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.021252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851fa7c-f2b3-45f7-a26b-e22f0cb6169b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.022622 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 126/270] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:58.028844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305741b-3fc6-481c-bdc4-bb615b7ec06e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.029330 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305741b-3fc6-481c-bdc4-bb615b7ec06e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.029519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305741b-3fc6-481c-bdc4-bb615b7ec06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.048968 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1305741b-3fc6-481c-bdc4-bb615b7ec06e None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:58.050223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1305741b-3fc6-481c-bdc4-bb615b7ec06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:58.126568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 145/271] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:58.137354 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceac3c-1e7c-4459-b758-a8effe4f4f47 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.137796 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceac3c-1e7c-4459-b758-a8effe4f4f47 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.137971 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceac3c-1e7c-4459-b758-a8effe4f4f47 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.140533 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 127/272] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:58.145659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4eb9a-4402-46e4-8796-08b991bd0f7b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.145950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4eb9a-4402-46e4-8796-08b991bd0f7b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.146225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4eb9a-4402-46e4-8796-08b991bd0f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.158911 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceac3c-1e7c-4459-b758-a8effe4f4f47 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:58.165788 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-65d4eb9a-4402-46e4-8796-08b991bd0f7b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:58.166969 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-65d4eb9a-4402-46e4-8796-08b991bd0f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:58.241851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 146/273] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:58.249293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:58.268081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4eb9a-4402-46e4-8796-08b991bd0f7b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:58.288561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceac3c-1e7c-4459-b758-a8effe4f4f47 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:58.324679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a4f2c-03d3-4cc0-81da-fa445e0a60ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:58.325648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a4f2c-03d3-4cc0-81da-fa445e0a60ff None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.326141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a4f2c-03d3-4cc0-81da-fa445e0a60ff None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.326415 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a4f2c-03d3-4cc0-81da-fa445e0a60ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.328275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a4f2c-03d3-4cc0-81da-fa445e0a60ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:58.329768 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a4f2c-03d3-4cc0-81da-fa445e0a60ff None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:58.331324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 128/274] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:19:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:58.336873 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a4f2c-03d3-4cc0-81da-fa445e0a60ff None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:58.341255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:58.396561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4eb9a-4402-46e4-8796-08b991bd0f7b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:58.432413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f05545-8c24-44a2-8f88-d673c027d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:58.433120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f05545-8c24-44a2-8f88-d673c027d6aa None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.433401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f05545-8c24-44a2-8f88-d673c027d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.433675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f05545-8c24-44a2-8f88-d673c027d6aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.444971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f05545-8c24-44a2-8f88-d673c027d6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-73f05545-8c24-44a2-8f88-d673c027d6aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:58.449873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:58.450765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:58.451623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 147/275] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:58.457848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f05545-8c24-44a2-8f88-d673c027d6aa None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:58.476947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a4f2c-03d3-4cc0-81da-fa445e0a60ff None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:58.514774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e8e00-6c7f-478a-8619-118cc8306c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:58.515811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e8e00-6c7f-478a-8619-118cc8306c1d None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.516159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e8e00-6c7f-478a-8619-118cc8306c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.516534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e8e00-6c7f-478a-8619-118cc8306c1d None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.517322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e8e00-6c7f-478a-8619-118cc8306c1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:58.519156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e8e00-6c7f-478a-8619-118cc8306c1d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:58.528036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:58.553280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 129/276] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:19:58 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:19:58.575085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f05545-8c24-44a2-8f88-d673c027d6aa None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:58.596959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:58.616594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0477f-cd00-49c7-8bd8-c2689a66de72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:58.617209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd821b53-1d34-4355-9c74-586aa80df5a3 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.617346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0477f-cd00-49c7-8bd8-c2689a66de72 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.617513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0477f-cd00-49c7-8bd8-c2689a66de72 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.617791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0477f-cd00-49c7-8bd8-c2689a66de72 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.618361 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd821b53-1d34-4355-9c74-586aa80df5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.618590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0477f-cd00-49c7-8bd8-c2689a66de72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:58.618905 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0477f-cd00-49c7-8bd8-c2689a66de72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:58.619350 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd821b53-1d34-4355-9c74-586aa80df5a3 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.620337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0477f-cd00-49c7-8bd8-c2689a66de72 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:58.621395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 130/277] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:19:58.629498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49652bc8-bd65-403c-bb49-9a7d8ddcf287 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.629498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49652bc8-bd65-403c-bb49-9a7d8ddcf287 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.629498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49652bc8-bd65-403c-bb49-9a7d8ddcf287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.630517 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 148/278] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:58.636937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0477f-cd00-49c7-8bd8-c2689a66de72 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:58.648631 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-49652bc8-bd65-403c-bb49-9a7d8ddcf287 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:58.649956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-49652bc8-bd65-403c-bb49-9a7d8ddcf287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:58.745355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 131/279] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:58.763485 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0477f-cd00-49c7-8bd8-c2689a66de72 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:58.769988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49652bc8-bd65-403c-bb49-9a7d8ddcf287 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:58.805184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43721c2c-a6ea-4898-84dc-48b294bdbba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:58.805759 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43721c2c-a6ea-4898-84dc-48b294bdbba6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.806044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43721c2c-a6ea-4898-84dc-48b294bdbba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.806322 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43721c2c-a6ea-4898-84dc-48b294bdbba6 None admin] PATH_INFO: `/v3/users/a0b2e2651d5e4ecfbb184e2bb9d29cde` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.823825 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43721c2c-a6ea-4898-84dc-48b294bdbba6 None admin] RBAC: Authorizing `identity:get_user(user_id=a0b2e2651d5e4ecfbb184e2bb9d29cde)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:58.825827 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43721c2c-a6ea-4898-84dc-48b294bdbba6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:58.831948 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 149/280] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:58 2022] GET /identity/v3/users/a0b2e2651d5e4ecfbb184e2bb9d29cde => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:58.833014 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43721c2c-a6ea-4898-84dc-48b294bdbba6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:58.884518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:58.896681 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49652bc8-bd65-403c-bb49-9a7d8ddcf287 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:58.923184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:58.951605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf9a98-560c-4300-b765-78d9e98120ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:58.952886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf9a98-560c-4300-b765-78d9e98120ed None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.953196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf9a98-560c-4300-b765-78d9e98120ed None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.953478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf9a98-560c-4300-b765-78d9e98120ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.964407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf9a98-560c-4300-b765-78d9e98120ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-6eaf9a98-560c-4300-b765-78d9e98120ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:58.970081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:58.970955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:19:58.971774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 132/281] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:19:58.972449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a598f-8fb6-4adb-a39e-201fc95f716f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:58.972713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a598f-8fb6-4adb-a39e-201fc95f716f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:58.973205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a598f-8fb6-4adb-a39e-201fc95f716f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:58.974473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 133/282] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:58.975047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43721c2c-a6ea-4898-84dc-48b294bdbba6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:58.979211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a598f-8fb6-4adb-a39e-201fc95f716f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:59.012065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aa067-8156-489e-a187-139a55630336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:59.012938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa067-8156-489e-a187-139a55630336 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:59.013464 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa067-8156-489e-a187-139a55630336 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:59.013886 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa067-8156-489e-a187-139a55630336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:59.015831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aa067-8156-489e-a187-139a55630336 None admin] RBAC: Adding query filter params (role.id=102380322b574754b40ec23fe0394401, user.id=a0b2e2651d5e4ecfbb184e2bb9d29cde, scope.system=all) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:59.016289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aa067-8156-489e-a187-139a55630336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:59.017954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aa067-8156-489e-a187-139a55630336 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:59.023707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 150/283] 10.222.0.15 () {56 vars in 1308 bytes} [Sat Aug 6 01:19:58 2022] GET /identity/v3/role_assignments?user.id=a0b2e2651d5e4ecfbb184e2bb9d29cde&scope.system=all&role.id=102380322b574754b40ec23fe0394401 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:59.032932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc981ce1-56ce-48c8-9139-8a676f339c94 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:59.032932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc981ce1-56ce-48c8-9139-8a676f339c94 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:59.032932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc981ce1-56ce-48c8-9139-8a676f339c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:59.058716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-dc981ce1-56ce-48c8-9139-8a676f339c94 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:59.059841 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-dc981ce1-56ce-48c8-9139-8a676f339c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:59.137938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 151/284] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:19:59.150550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a598f-8fb6-4adb-a39e-201fc95f716f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:59.168960 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc981ce1-56ce-48c8-9139-8a676f339c94 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:59.211450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33e9f5-c836-411e-aacd-17741f7594a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:59.212479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33e9f5-c836-411e-aacd-17741f7594a3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:59.212988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33e9f5-c836-411e-aacd-17741f7594a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:59.213500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33e9f5-c836-411e-aacd-17741f7594a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:59.214442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33e9f5-c836-411e-aacd-17741f7594a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:59.214953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33e9f5-c836-411e-aacd-17741f7594a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:59.216589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33e9f5-c836-411e-aacd-17741f7594a3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:59.226900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:59.227096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 134/285] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:59.237941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33e9f5-c836-411e-aacd-17741f7594a3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:59.303627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:59.322324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc981ce1-56ce-48c8-9139-8a676f339c94 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:59.364397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1a2c7-4e59-4dd7-840a-ab3659c52d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:59.365200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1a2c7-4e59-4dd7-840a-ab3659c52d49 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:59.365489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1a2c7-4e59-4dd7-840a-ab3659c52d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:59.365791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1a2c7-4e59-4dd7-840a-ab3659c52d49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:59.377056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33e9f5-c836-411e-aacd-17741f7594a3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:59.378758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1a2c7-4e59-4dd7-840a-ab3659c52d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-61f1a2c7-4e59-4dd7-840a-ab3659c52d49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:19:59.384122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:19:59.385029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:19:59.385818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 152/286] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:19:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:19:59.394066 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1a2c7-4e59-4dd7-840a-ab3659c52d49 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:59.433272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed287-47d7-4d62-bbfa-11b0fc2d2d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:59.433925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed287-47d7-4d62-bbfa-11b0fc2d2d30 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:59.434200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed287-47d7-4d62-bbfa-11b0fc2d2d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:59.434470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed287-47d7-4d62-bbfa-11b0fc2d2d30 None admin] PATH_INFO: `/v3/users/28450ddee7384175ba983ef8e2d61f0e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:59.436815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eed287-47d7-4d62-bbfa-11b0fc2d2d30 None admin] RBAC: Authorizing `identity:get_user(user_id=28450ddee7384175ba983ef8e2d61f0e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:59.438285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eed287-47d7-4d62-bbfa-11b0fc2d2d30 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:59.439904 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 135/287] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:59 2022] GET /identity/v3/users/28450ddee7384175ba983ef8e2d61f0e => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:59.446590 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed287-47d7-4d62-bbfa-11b0fc2d2d30 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:59.560437 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1a2c7-4e59-4dd7-840a-ab3659c52d49 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:59.577539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:59.620507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f4066-3d51-49ee-8a27-15c0152d0d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:59.621153 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4066-3d51-49ee-8a27-15c0152d0d98 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:59.621434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4066-3d51-49ee-8a27-15c0152d0d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:59.621703 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4066-3d51-49ee-8a27-15c0152d0d98 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:59.622424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f4066-3d51-49ee-8a27-15c0152d0d98 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:19:59.622729 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f4066-3d51-49ee-8a27-15c0152d0d98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:59.630025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f4066-3d51-49ee-8a27-15c0152d0d98 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:59.647790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 153/288] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:19:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:19:59.651780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed287-47d7-4d62-bbfa-11b0fc2d2d30 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:59.653280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f4066-3d51-49ee-8a27-15c0152d0d98 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:59.673307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:59.749622 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af6dfa-c47e-43b0-9219-0a8c942ca008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:59.750256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af6dfa-c47e-43b0-9219-0a8c942ca008 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:59.750541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af6dfa-c47e-43b0-9219-0a8c942ca008 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:59.750814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af6dfa-c47e-43b0-9219-0a8c942ca008 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:59.772333 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f4066-3d51-49ee-8a27-15c0152d0d98 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:59.844051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af6dfa-c47e-43b0-9219-0a8c942ca008 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:59.845949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af6dfa-c47e-43b0-9219-0a8c942ca008 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:59.865598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38dba3-1573-40af-b13c-9bf74f52e3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:59.866259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38dba3-1573-40af-b13c-9bf74f52e3cd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:59.866537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38dba3-1573-40af-b13c-9bf74f52e3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:59.866828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38dba3-1573-40af-b13c-9bf74f52e3cd None admin] PATH_INFO: `/v3/users/943299d32a90452f9553303ab906fc84` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:59.868049 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38dba3-1573-40af-b13c-9bf74f52e3cd None admin] RBAC: Authorizing `identity:get_user(user_id=943299d32a90452f9553303ab906fc84)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:59.869703 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38dba3-1573-40af-b13c-9bf74f52e3cd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:59.871147 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 154/289] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:19:59 2022] GET /identity/v3/users/943299d32a90452f9553303ab906fc84 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:19:59.877162 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38dba3-1573-40af-b13c-9bf74f52e3cd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:59.929256 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:00.004861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 136/290] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:19:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:00.011888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af6dfa-c47e-43b0-9219-0a8c942ca008 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:00.037612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:00.046731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38dba3-1573-40af-b13c-9bf74f52e3cd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:00.097372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6d20d-925e-493c-b330-a40d75aab61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:00.097946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6d20d-925e-493c-b330-a40d75aab61a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:00.098228 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6d20d-925e-493c-b330-a40d75aab61a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:00.098500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6d20d-925e-493c-b330-a40d75aab61a None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:00.099740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6d20d-925e-493c-b330-a40d75aab61a None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:00.101211 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6d20d-925e-493c-b330-a40d75aab61a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:00.102860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 155/291] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:19:59 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:00.108988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6d20d-925e-493c-b330-a40d75aab61a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:00.219362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af6dfa-c47e-43b0-9219-0a8c942ca008 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:00.274322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b0a75-44a7-456c-a906-d21bd652aa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:00.274964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b0a75-44a7-456c-a906-d21bd652aa89 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:00.275245 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b0a75-44a7-456c-a906-d21bd652aa89 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:00.275516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b0a75-44a7-456c-a906-d21bd652aa89 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:00.277713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b0a75-44a7-456c-a906-d21bd652aa89 None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:00.278186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:00.279168 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b0a75-44a7-456c-a906-d21bd652aa89 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:00.286384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 137/292] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:00 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:00.287544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b0a75-44a7-456c-a906-d21bd652aa89 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:00.294970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6d20d-925e-493c-b330-a40d75aab61a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:00.372795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856488de-0b86-4c2e-be21-11d56bcbb1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:00.373510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856488de-0b86-4c2e-be21-11d56bcbb1c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:00.374134 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856488de-0b86-4c2e-be21-11d56bcbb1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:00.374670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856488de-0b86-4c2e-be21-11d56bcbb1c2 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695/users/943299d32a90452f9553303ab906fc84/roles/46e6b316a22d4082b00baed02609b6dc` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:00.378268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856488de-0b86-4c2e-be21-11d56bcbb1c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695, user_id=943299d32a90452f9553303ab906fc84, role_id=46e6b316a22d4082b00baed02609b6dc)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:00.379949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856488de-0b86-4c2e-be21-11d56bcbb1c2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:00.411958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:00.431391 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 156/293] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:20:00 2022] PUT /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695/users/943299d32a90452f9553303ab906fc84/roles/46e6b316a22d4082b00baed02609b6dc => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:00.440932 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b0a75-44a7-456c-a906-d21bd652aa89 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:00.490370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f40678-e782-4094-9f3c-265528f11f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:00.491012 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f40678-e782-4094-9f3c-265528f11f2a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:00.491297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f40678-e782-4094-9f3c-265528f11f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:00.491575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f40678-e782-4094-9f3c-265528f11f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:00.492397 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f40678-e782-4094-9f3c-265528f11f2a None admin] RBAC: Adding query filter params (role.id=102380322b574754b40ec23fe0394401, scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695, user.id=28450ddee7384175ba983ef8e2d61f0e) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:00.492713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f40678-e782-4094-9f3c-265528f11f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:00.494237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f40678-e782-4094-9f3c-265528f11f2a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:00.509462 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 138/294] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:00 2022] GET /identity/v3/role_assignments?user.id=28450ddee7384175ba983ef8e2d61f0e&scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695&role.id=102380322b574754b40ec23fe0394401 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:01.032563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d50efd-4704-4f7e-9782-a5b869352342 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.032958 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d50efd-4704-4f7e-9782-a5b869352342 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.033157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d50efd-4704-4f7e-9782-a5b869352342 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.034527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 157/295] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:01.039718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f4d84-4d1f-4dd4-8f30-52944810f3f6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.040014 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f4d84-4d1f-4dd4-8f30-52944810f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.040294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f4d84-4d1f-4dd4-8f30-52944810f3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.062053 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a81f4d84-4d1f-4dd4-8f30-52944810f3f6 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:01.063261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a81f4d84-4d1f-4dd4-8f30-52944810f3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:01.089079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d8a03-24b2-4845-8fd9-03fc16a659e4 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.089572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d8a03-24b2-4845-8fd9-03fc16a659e4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.089801 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d8a03-24b2-4845-8fd9-03fc16a659e4 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.092985 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 158/296] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:01.099455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12a277-4a76-46d9-a959-c9387c546d63 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.099738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12a277-4a76-46d9-a959-c9387c546d63 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.100019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12a277-4a76-46d9-a959-c9387c546d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.129969 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5f12a277-4a76-46d9-a959-c9387c546d63 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:01.137174 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5f12a277-4a76-46d9-a959-c9387c546d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:01.146574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 139/297] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:01.171951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f4d84-4d1f-4dd4-8f30-52944810f3f6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:01.212711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 159/298] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:01.237737 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12a277-4a76-46d9-a959-c9387c546d63 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:01.249596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:01.285221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f4d84-4d1f-4dd4-8f30-52944810f3f6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:01.323317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b54d8-69f4-4662-a10a-177acddeab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:01.324085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b54d8-69f4-4662-a10a-177acddeab0c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.324373 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b54d8-69f4-4662-a10a-177acddeab0c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.324646 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b54d8-69f4-4662-a10a-177acddeab0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.340077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b54d8-69f4-4662-a10a-177acddeab0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:01.341591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-303b54d8-69f4-4662-a10a-177acddeab0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:01.347930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:01.348804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:01.349643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:01.349643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:01.349643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:01.349643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:01.349643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:01.349643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:01.349643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:01.349643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:01.349643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:01.349643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:01.349643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:20:01.349643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:01.353298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 140/299] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:01.359641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b54d8-69f4-4662-a10a-177acddeab0c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:01.380965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12a277-4a76-46d9-a959-c9387c546d63 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:01.420079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56debfbf-05ec-4280-abbf-f4764366d98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:01.421511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56debfbf-05ec-4280-abbf-f4764366d98b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.422004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56debfbf-05ec-4280-abbf-f4764366d98b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.422574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56debfbf-05ec-4280-abbf-f4764366d98b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.423988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56debfbf-05ec-4280-abbf-f4764366d98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:01.425899 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56debfbf-05ec-4280-abbf-f4764366d98b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:01.428097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 160/300] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:01.436478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56debfbf-05ec-4280-abbf-f4764366d98b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:01.486790 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b54d8-69f4-4662-a10a-177acddeab0c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:01.519681 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:01.526363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e07631-b069-4b7d-9d8a-dbe54d3cb118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:01.527224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e07631-b069-4b7d-9d8a-dbe54d3cb118 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.527894 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e07631-b069-4b7d-9d8a-dbe54d3cb118 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.528267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e07631-b069-4b7d-9d8a-dbe54d3cb118 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.529253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e07631-b069-4b7d-9d8a-dbe54d3cb118 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:01.530245 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e07631-b069-4b7d-9d8a-dbe54d3cb118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:01.531727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e07631-b069-4b7d-9d8a-dbe54d3cb118 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:01.541018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 141/301] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:20:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:01.550656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e07631-b069-4b7d-9d8a-dbe54d3cb118 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:01.553379 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56debfbf-05ec-4280-abbf-f4764366d98b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:01.591733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5918d-8c82-41f7-9f7a-7f8c983fd2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:01.593410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5918d-8c82-41f7-9f7a-7f8c983fd2d3 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.593749 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5918d-8c82-41f7-9f7a-7f8c983fd2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.594026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5918d-8c82-41f7-9f7a-7f8c983fd2d3 None admin] PATH_INFO: `/v3/groups` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.594758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5918d-8c82-41f7-9f7a-7f8c983fd2d3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:01.596308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5918d-8c82-41f7-9f7a-7f8c983fd2d3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:01.613493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 161/302] 10.222.0.15 () {60 vars in 1134 bytes} [Sat Aug 6 01:20:01 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:20:01.614742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d1d3e-285d-4dd3-a302-671e696460f7 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.615039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d1d3e-285d-4dd3-a302-671e696460f7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.615501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d1d3e-285d-4dd3-a302-671e696460f7 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.616863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 162/303] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:01.622680 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb606ef7-0912-420e-9d72-41e05685cb8a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.622971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb606ef7-0912-420e-9d72-41e05685cb8a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.623827 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb606ef7-0912-420e-9d72-41e05685cb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.647995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-cb606ef7-0912-420e-9d72-41e05685cb8a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:01.649107 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cb606ef7-0912-420e-9d72-41e05685cb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:01.651473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:01.685229 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e07631-b069-4b7d-9d8a-dbe54d3cb118 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:01.729571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f242104-97a1-4589-ae8a-3e945c782c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:01.736142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 163/304] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:01.736262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f242104-97a1-4589-ae8a-3e945c782c5f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.736262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f242104-97a1-4589-ae8a-3e945c782c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.736262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f242104-97a1-4589-ae8a-3e945c782c5f None admin] PATH_INFO: `/v3/users/6b8f3ca1136e4a2c916e6536cae593ef` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.753457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f242104-97a1-4589-ae8a-3e945c782c5f None admin] RBAC: Authorizing `identity:get_user(user_id=6b8f3ca1136e4a2c916e6536cae593ef)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:01.755018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f242104-97a1-4589-ae8a-3e945c782c5f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:01.757096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 142/305] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:20:01 2022] GET /identity/v3/users/6b8f3ca1136e4a2c916e6536cae593ef => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:01.759615 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb606ef7-0912-420e-9d72-41e05685cb8a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:01.762395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f242104-97a1-4589-ae8a-3e945c782c5f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:01.820931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:01.875897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f242104-97a1-4589-ae8a-3e945c782c5f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:01.878225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb606ef7-0912-420e-9d72-41e05685cb8a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:01.916432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805c812-c7c6-4804-8bd4-369befad5965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:01.917450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805c812-c7c6-4804-8bd4-369befad5965 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.917954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805c812-c7c6-4804-8bd4-369befad5965 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.918457 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805c812-c7c6-4804-8bd4-369befad5965 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.923614 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39933035-89c4-49ec-be00-3f4436df8180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:01.924337 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39933035-89c4-49ec-be00-3f4436df8180 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:01.924883 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39933035-89c4-49ec-be00-3f4436df8180 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:01.925422 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39933035-89c4-49ec-be00-3f4436df8180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:01.926318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39933035-89c4-49ec-be00-3f4436df8180 None admin] RBAC: Adding query filter params (role.id=46e6b316a22d4082b00baed02609b6dc, user.id=6b8f3ca1136e4a2c916e6536cae593ef, scope.system=all) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:01.926741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39933035-89c4-49ec-be00-3f4436df8180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:01.927963 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:01.930013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39933035-89c4-49ec-be00-3f4436df8180 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:01.932563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805c812-c7c6-4804-8bd4-369befad5965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:01.937222 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 143/306] 10.222.0.15 () {56 vars in 1308 bytes} [Sat Aug 6 01:20:01 2022] GET /identity/v3/role_assignments?user.id=6b8f3ca1136e4a2c916e6536cae593ef&scope.system=all&role.id=46e6b316a22d4082b00baed02609b6dc => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a805c812-c7c6-4804-8bd4-369befad5965 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:01.939287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:01.940243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:01.941097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:01.941097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:01.941097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:01.941097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:01.941097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:01.941097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:01.941097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:01.941097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:01.941097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:01.941097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:01.941097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:01.941097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:01.948441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 164/307] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:01.950178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39933035-89c4-49ec-be00-3f4436df8180 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:02.069054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39933035-89c4-49ec-be00-3f4436df8180 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:02.089367 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:02.111177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41494b-0563-4232-b1af-170e93e9b18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:02.111807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41494b-0563-4232-b1af-170e93e9b18f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:02.112087 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41494b-0563-4232-b1af-170e93e9b18f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:02.112360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41494b-0563-4232-b1af-170e93e9b18f None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:02.113110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41494b-0563-4232-b1af-170e93e9b18f None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:02.113414 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41494b-0563-4232-b1af-170e93e9b18f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:02.114781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41494b-0563-4232-b1af-170e93e9b18f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:02.124140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 144/308] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:20:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:02.129718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805c812-c7c6-4804-8bd4-369befad5965 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:02.238585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805c812-c7c6-4804-8bd4-369befad5965 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:02.274913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66deaf-174b-41af-abba-dd3d4cbe2f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:02.275570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66deaf-174b-41af-abba-dd3d4cbe2f6a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:02.275830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66deaf-174b-41af-abba-dd3d4cbe2f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:02.276101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66deaf-174b-41af-abba-dd3d4cbe2f6a None admin] PATH_INFO: `/v3/users/a0b2e2651d5e4ecfbb184e2bb9d29cde` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:02.277306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66deaf-174b-41af-abba-dd3d4cbe2f6a None admin] RBAC: Authorizing `identity:get_user(user_id=a0b2e2651d5e4ecfbb184e2bb9d29cde)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:02.278746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66deaf-174b-41af-abba-dd3d4cbe2f6a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:02.281235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 165/309] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:20:02 2022] GET /identity/v3/users/a0b2e2651d5e4ecfbb184e2bb9d29cde => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:02.286597 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41494b-0563-4232-b1af-170e93e9b18f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:02.391454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41494b-0563-4232-b1af-170e93e9b18f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:02.427806 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af754fdc-01c5-438b-8f2f-19043df19156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:02.428475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af754fdc-01c5-438b-8f2f-19043df19156 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:02.428757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af754fdc-01c5-438b-8f2f-19043df19156 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:02.429073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af754fdc-01c5-438b-8f2f-19043df19156 None admin] PATH_INFO: `/v3/system/users/a0b2e2651d5e4ecfbb184e2bb9d29cde/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:02.430521 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af754fdc-01c5-438b-8f2f-19043df19156 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a0b2e2651d5e4ecfbb184e2bb9d29cde, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:02.431895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af754fdc-01c5-438b-8f2f-19043df19156 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:02.444645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 145/310] 10.222.0.15 () {58 vars in 1334 bytes} [Sat Aug 6 01:20:02 2022] PUT /identity/v3/system/users/a0b2e2651d5e4ecfbb184e2bb9d29cde/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:02.638843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1583f-13da-4c31-a8be-af69b5b2fa7a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:02.639741 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1583f-13da-4c31-a8be-af69b5b2fa7a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:02.640186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1583f-13da-4c31-a8be-af69b5b2fa7a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:02.641531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 166/311] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:02.646706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e66a8-d597-4aa6-a786-1a528ca1658d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:02.647144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e66a8-d597-4aa6-a786-1a528ca1658d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:02.647427 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e66a8-d597-4aa6-a786-1a528ca1658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:02.665746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c51e66a8-d597-4aa6-a786-1a528ca1658d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:02.666919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c51e66a8-d597-4aa6-a786-1a528ca1658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:02.704350 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:02.739502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 146/312] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:02.762094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1583f-13da-4c31-a8be-af69b5b2fa7a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:02.831490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:02.874865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1583f-13da-4c31-a8be-af69b5b2fa7a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:02.911509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dfc2a-e085-48f1-b2e3-f68a96910b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:02.912068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dfc2a-e085-48f1-b2e3-f68a96910b55 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:02.912348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dfc2a-e085-48f1-b2e3-f68a96910b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:02.912617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dfc2a-e085-48f1-b2e3-f68a96910b55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:02.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dfc2a-e085-48f1-b2e3-f68a96910b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-ac6dfc2a-e085-48f1-b2e3-f68a96910b55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:02.930028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:02.930895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:02.931694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 167/313] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:02.938881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e66a8-d597-4aa6-a786-1a528ca1658d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:03.048085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e66a8-d597-4aa6-a786-1a528ca1658d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:03.083065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71cb2c-801d-4bba-96a8-5e351cfa5593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:03.083829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71cb2c-801d-4bba-96a8-5e351cfa5593 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:03.084116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71cb2c-801d-4bba-96a8-5e351cfa5593 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:03.084393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71cb2c-801d-4bba-96a8-5e351cfa5593 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:03.085140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71cb2c-801d-4bba-96a8-5e351cfa5593 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:03.085450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71cb2c-801d-4bba-96a8-5e351cfa5593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:03.086821 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71cb2c-801d-4bba-96a8-5e351cfa5593 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:03.100571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 147/314] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:20:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:03.102101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dfc2a-e085-48f1-b2e3-f68a96910b55 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:03.213892 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dfc2a-e085-48f1-b2e3-f68a96910b55 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:03.240824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:03.251140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db032cb6-f26a-40f7-81c7-8539bc1ee7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:03.252132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db032cb6-f26a-40f7-81c7-8539bc1ee7ab None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:03.252802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db032cb6-f26a-40f7-81c7-8539bc1ee7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:03.253105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db032cb6-f26a-40f7-81c7-8539bc1ee7ab None admin] PATH_INFO: `/v3/users/943299d32a90452f9553303ab906fc84` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:03.254276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db032cb6-f26a-40f7-81c7-8539bc1ee7ab None admin] RBAC: Authorizing `identity:get_user(user_id=943299d32a90452f9553303ab906fc84)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:03.255717 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db032cb6-f26a-40f7-81c7-8539bc1ee7ab None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:03.257640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 168/315] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:20:03 2022] GET /identity/v3/users/943299d32a90452f9553303ab906fc84 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:03.263015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71cb2c-801d-4bba-96a8-5e351cfa5593 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:03.300031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:03.380088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71cb2c-801d-4bba-96a8-5e351cfa5593 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:03.415753 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4654d90-0f5d-4e73-9204-da6c520212e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:03.416382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4654d90-0f5d-4e73-9204-da6c520212e1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:03.416666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4654d90-0f5d-4e73-9204-da6c520212e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:03.416966 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4654d90-0f5d-4e73-9204-da6c520212e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:03.487922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4654d90-0f5d-4e73-9204-da6c520212e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:03.489340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4654d90-0f5d-4e73-9204-da6c520212e1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:03.525707 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:03.592593 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 148/316] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:03.598060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db032cb6-f26a-40f7-81c7-8539bc1ee7ab None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:03.714238 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db032cb6-f26a-40f7-81c7-8539bc1ee7ab None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:03.750440 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8c1e4-7697-4dc2-bf3f-20f80a663253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:03.751007 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8c1e4-7697-4dc2-bf3f-20f80a663253 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:03.751288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8c1e4-7697-4dc2-bf3f-20f80a663253 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:03.751563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8c1e4-7697-4dc2-bf3f-20f80a663253 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:03.752967 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8c1e4-7697-4dc2-bf3f-20f80a663253 None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:03.754581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8c1e4-7697-4dc2-bf3f-20f80a663253 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:03.756412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 169/317] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:03 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:03.762334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4654d90-0f5d-4e73-9204-da6c520212e1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:03.787763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be402dc0-9049-437c-a23f-6b2fe1f350da None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:03.788078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be402dc0-9049-437c-a23f-6b2fe1f350da None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:03.788323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be402dc0-9049-437c-a23f-6b2fe1f350da None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:03.789941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 170/318] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:03.794664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa6aa5-fd9d-45ea-97dc-98106c2d4b22 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:03.794957 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa6aa5-fd9d-45ea-97dc-98106c2d4b22 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:03.795865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa6aa5-fd9d-45ea-97dc-98106c2d4b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:03.814313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d8aa6aa5-fd9d-45ea-97dc-98106c2d4b22 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:03.815646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d8aa6aa5-fd9d-45ea-97dc-98106c2d4b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:03.869688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4654d90-0f5d-4e73-9204-da6c520212e1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:03.876844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:03.897310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 171/319] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:03.908292 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85c8d6-97ca-43cc-b79a-4d9bf453b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:03.908931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85c8d6-97ca-43cc-b79a-4d9bf453b069 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:03.909228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85c8d6-97ca-43cc-b79a-4d9bf453b069 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:03.909500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85c8d6-97ca-43cc-b79a-4d9bf453b069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:03.910290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85c8d6-97ca-43cc-b79a-4d9bf453b069 None admin] RBAC: Adding query filter params (role.id=46e6b316a22d4082b00baed02609b6dc, scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695, user.id=943299d32a90452f9553303ab906fc84) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:03.910600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85c8d6-97ca-43cc-b79a-4d9bf453b069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:03.912035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85c8d6-97ca-43cc-b79a-4d9bf453b069 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:03.913659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa6aa5-fd9d-45ea-97dc-98106c2d4b22 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:03.914282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:03.924388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 149/320] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:03 2022] GET /identity/v3/role_assignments?user.id=943299d32a90452f9553303ab906fc84&scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695&role.id=46e6b316a22d4082b00baed02609b6dc => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:04.012644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802ae36-9522-4cec-ae85-b67e4f53b3a2 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:04.012987 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802ae36-9522-4cec-ae85-b67e4f53b3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:04.013153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802ae36-9522-4cec-ae85-b67e4f53b3a2 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:04.015241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 150/321] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:20:04.020854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94be6c-e7e7-46df-847b-cc42d6d82c45 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:04.021159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94be6c-e7e7-46df-847b-cc42d6d82c45 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:04.021442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94be6c-e7e7-46df-847b-cc42d6d82c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:04.030377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa6aa5-fd9d-45ea-97dc-98106c2d4b22 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:04.040215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8a94be6c-e7e7-46df-847b-cc42d6d82c45 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:04.041553 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8a94be6c-e7e7-46df-847b-cc42d6d82c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:04.067705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8529f-9c8a-433a-ba9a-a65c8b6060cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:04.068357 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8529f-9c8a-433a-ba9a-a65c8b6060cf None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:04.068637 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8529f-9c8a-433a-ba9a-a65c8b6060cf None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:04.068931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8529f-9c8a-433a-ba9a-a65c8b6060cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:04.070103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8529f-9c8a-433a-ba9a-a65c8b6060cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:04.071553 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8529f-9c8a-433a-ba9a-a65c8b6060cf None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:04.073521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 172/322] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:04.080428 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8529f-9c8a-433a-ba9a-a65c8b6060cf None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:04.119027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 151/323] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:04.141379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94be6c-e7e7-46df-847b-cc42d6d82c45 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:04.145156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:04.190847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8529f-9c8a-433a-ba9a-a65c8b6060cf None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:04.233671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b8e54-8fcf-48cc-b9f5-a6e4c0e0e20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:04.235362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b8e54-8fcf-48cc-b9f5-a6e4c0e0e20e None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:04.235790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b8e54-8fcf-48cc-b9f5-a6e4c0e0e20e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:04.236235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b8e54-8fcf-48cc-b9f5-a6e4c0e0e20e None admin] PATH_INFO: `/v3/groups` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:04.237416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b8e54-8fcf-48cc-b9f5-a6e4c0e0e20e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:04.239612 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b8e54-8fcf-48cc-b9f5-a6e4c0e0e20e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:04.259365 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 173/324] 10.222.0.15 () {60 vars in 1134 bytes} [Sat Aug 6 01:20:04 2022] POST /identity/v3/groups => generated 226 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:20:04.260085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94be6c-e7e7-46df-847b-cc42d6d82c45 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:04.291574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:04.301616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f164f7-cd72-4def-af1f-b10dcda87c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:04.302266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f164f7-cd72-4def-af1f-b10dcda87c71 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:04.303011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f164f7-cd72-4def-af1f-b10dcda87c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:04.303295 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f164f7-cd72-4def-af1f-b10dcda87c71 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:04.316518 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f164f7-cd72-4def-af1f-b10dcda87c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f4f164f7-cd72-4def-af1f-b10dcda87c71 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:04.321967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:04.322942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:04.323755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:04.323755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:04.323755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:04.323755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:04.323755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:04.323755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:04.323755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:04.323755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:04.323755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:04.323755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:04.323755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:20:04.323755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:04.325069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 152/325] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:04.329485 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b8e54-8fcf-48cc-b9f5-a6e4c0e0e20e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:04.443459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b8e54-8fcf-48cc-b9f5-a6e4c0e0e20e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:04.462908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:04.479247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3a296-6529-4b11-82ae-7fd088927c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:04.479869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3a296-6529-4b11-82ae-7fd088927c45 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:04.480187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3a296-6529-4b11-82ae-7fd088927c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:04.480428 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3a296-6529-4b11-82ae-7fd088927c45 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:04.481180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3a296-6529-4b11-82ae-7fd088927c45 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:04.481486 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3a296-6529-4b11-82ae-7fd088927c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:04.483414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3a296-6529-4b11-82ae-7fd088927c45 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:04.492085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 174/326] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:20:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:04.497883 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f164f7-cd72-4def-af1f-b10dcda87c71 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:04.609075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f164f7-cd72-4def-af1f-b10dcda87c71 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:04.645026 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64ce37-870e-476e-84eb-ca0c4e0451d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:04.645680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64ce37-870e-476e-84eb-ca0c4e0451d8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:04.645966 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64ce37-870e-476e-84eb-ca0c4e0451d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:04.646244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64ce37-870e-476e-84eb-ca0c4e0451d8 None admin] PATH_INFO: `/v3/users/6b8f3ca1136e4a2c916e6536cae593ef` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:04.647448 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64ce37-870e-476e-84eb-ca0c4e0451d8 None admin] RBAC: Authorizing `identity:get_user(user_id=6b8f3ca1136e4a2c916e6536cae593ef)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:04.649005 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64ce37-870e-476e-84eb-ca0c4e0451d8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:04.650626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 153/327] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:20:04 2022] GET /identity/v3/users/6b8f3ca1136e4a2c916e6536cae593ef => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:04.657121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3a296-6529-4b11-82ae-7fd088927c45 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:04.675564 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24d90e-ccfd-4997-b542-341c0bbe7116 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:04.675879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24d90e-ccfd-4997-b542-341c0bbe7116 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:04.676121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24d90e-ccfd-4997-b542-341c0bbe7116 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:04.677651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 154/328] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:20:04.682508 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871234f-0d54-45d9-b405-09d9818e4787 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:04.682796 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871234f-0d54-45d9-b405-09d9818e4787 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:04.683076 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871234f-0d54-45d9-b405-09d9818e4787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:04.702528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9871234f-0d54-45d9-b405-09d9818e4787 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:04.703926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9871234f-0d54-45d9-b405-09d9818e4787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:04.772228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:04.798840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3a296-6529-4b11-82ae-7fd088927c45 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:04.799809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 155/329] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:04.830217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871234f-0d54-45d9-b405-09d9818e4787 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:04.837901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e57123-9882-4687-ade6-77eb6de184a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:04.839344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e57123-9882-4687-ade6-77eb6de184a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:04.839804 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e57123-9882-4687-ade6-77eb6de184a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:04.840271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e57123-9882-4687-ade6-77eb6de184a7 None admin] PATH_INFO: `/v3/system/users/6b8f3ca1136e4a2c916e6536cae593ef/roles/46e6b316a22d4082b00baed02609b6dc` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:04.843930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e57123-9882-4687-ade6-77eb6de184a7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6b8f3ca1136e4a2c916e6536cae593ef, role_id=46e6b316a22d4082b00baed02609b6dc)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:04.845862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e57123-9882-4687-ade6-77eb6de184a7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:04.861468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 175/330] 10.222.0.15 () {58 vars in 1334 bytes} [Sat Aug 6 01:20:04 2022] PUT /identity/v3/system/users/6b8f3ca1136e4a2c916e6536cae593ef/roles/46e6b316a22d4082b00baed02609b6dc => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:04.965128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871234f-0d54-45d9-b405-09d9818e4787 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:05.006596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff145-b0ae-4367-aba3-f933a5681cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:05.007253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff145-b0ae-4367-aba3-f933a5681cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:05.007530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff145-b0ae-4367-aba3-f933a5681cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:05.007797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff145-b0ae-4367-aba3-f933a5681cf1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:05.020814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ff145-b0ae-4367-aba3-f933a5681cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f76ff145-b0ae-4367-aba3-f933a5681cf1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:05.025869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:05.026783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:05.027596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 156/331] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:05.035671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e57123-9882-4687-ade6-77eb6de184a7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:05.089959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:05.148300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e57123-9882-4687-ade6-77eb6de184a7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:05.187555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67955b10-2e3e-483f-b9fa-9ba41e7359b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:05.191874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67955b10-2e3e-483f-b9fa-9ba41e7359b0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:05.191874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67955b10-2e3e-483f-b9fa-9ba41e7359b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:05.191874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67955b10-2e3e-483f-b9fa-9ba41e7359b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:05.191874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67955b10-2e3e-483f-b9fa-9ba41e7359b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:05.191874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67955b10-2e3e-483f-b9fa-9ba41e7359b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:05.191874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67955b10-2e3e-483f-b9fa-9ba41e7359b0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:05.200859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 176/332] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:20:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:05.207617 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff145-b0ae-4367-aba3-f933a5681cf1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:05.260608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:05.325388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff145-b0ae-4367-aba3-f933a5681cf1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:05.380931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec4839-b69a-4c8d-803c-061d21a9fa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:05.381591 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec4839-b69a-4c8d-803c-061d21a9fa08 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:05.381875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec4839-b69a-4c8d-803c-061d21a9fa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:05.382153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec4839-b69a-4c8d-803c-061d21a9fa08 None admin] PATH_INFO: `/v3/users/a0b2e2651d5e4ecfbb184e2bb9d29cde` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:05.383341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec4839-b69a-4c8d-803c-061d21a9fa08 None admin] RBAC: Authorizing `identity:get_user(user_id=a0b2e2651d5e4ecfbb184e2bb9d29cde)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:05.384939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec4839-b69a-4c8d-803c-061d21a9fa08 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:05.387599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 157/333] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:20:05 2022] GET /identity/v3/users/a0b2e2651d5e4ecfbb184e2bb9d29cde => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:05.393652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67955b10-2e3e-483f-b9fa-9ba41e7359b0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:05.531104 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67955b10-2e3e-483f-b9fa-9ba41e7359b0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:05.545928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:05.573766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d997e1-265e-40c4-bacc-33edc6b1e466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:05.574393 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d997e1-265e-40c4-bacc-33edc6b1e466 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:05.574672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d997e1-265e-40c4-bacc-33edc6b1e466 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:05.574944 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d997e1-265e-40c4-bacc-33edc6b1e466 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:05.575745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d997e1-265e-40c4-bacc-33edc6b1e466 None admin] RBAC: Adding query filter params (role.id=102380322b574754b40ec23fe0394401, user.id=a0b2e2651d5e4ecfbb184e2bb9d29cde, scope.system=all) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:05.576055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d997e1-265e-40c4-bacc-33edc6b1e466 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:05.578133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d997e1-265e-40c4-bacc-33edc6b1e466 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:05.592806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 177/334] 10.222.0.15 () {56 vars in 1308 bytes} [Sat Aug 6 01:20:05 2022] GET /identity/v3/role_assignments?user.id=a0b2e2651d5e4ecfbb184e2bb9d29cde&scope.system=all&role.id=102380322b574754b40ec23fe0394401 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:06.606946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d74ca8-a267-4dc8-ae75-62530211468e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:06.608534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d74ca8-a267-4dc8-ae75-62530211468e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:06.609064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d74ca8-a267-4dc8-ae75-62530211468e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:06.610890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 158/335] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:06.616939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d938926-b30f-4050-968b-c70a6b3dcba0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:06.617938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d938926-b30f-4050-968b-c70a6b3dcba0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:06.618438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d938926-b30f-4050-968b-c70a6b3dcba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:06.640645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7d938926-b30f-4050-968b-c70a6b3dcba0 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:06.641914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7d938926-b30f-4050-968b-c70a6b3dcba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:06.728954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 178/336] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:06.762051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d74ca8-a267-4dc8-ae75-62530211468e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:06.908396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d74ca8-a267-4dc8-ae75-62530211468e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:06.927951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:06.953008 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb25472-81f4-481c-ae64-0a337d96cd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:06.953674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb25472-81f4-481c-ae64-0a337d96cd8d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:06.953958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb25472-81f4-481c-ae64-0a337d96cd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:06.954235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb25472-81f4-481c-ae64-0a337d96cd8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:06.973861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb25472-81f4-481c-ae64-0a337d96cd8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4bb25472-81f4-481c-ae64-0a337d96cd8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:06.979160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:06.980085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:06.980878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 159/337] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:06.989843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d938926-b30f-4050-968b-c70a6b3dcba0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:07.119407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:07.126239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d938926-b30f-4050-968b-c70a6b3dcba0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:07.167323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8d9f3-3ca6-48a7-8b2d-3ad403f074fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:07.167870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d9f3-3ca6-48a7-8b2d-3ad403f074fc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:07.168160 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d9f3-3ca6-48a7-8b2d-3ad403f074fc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:07.168439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8d9f3-3ca6-48a7-8b2d-3ad403f074fc None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:07.169199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8d9f3-3ca6-48a7-8b2d-3ad403f074fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:07.169512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8d9f3-3ca6-48a7-8b2d-3ad403f074fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:07.171427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8d9f3-3ca6-48a7-8b2d-3ad403f074fc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:07.184563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 179/338] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:20:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:07.191014 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb25472-81f4-481c-ae64-0a337d96cd8d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:07.315981 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb25472-81f4-481c-ae64-0a337d96cd8d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:07.344091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdba28-a804-415b-88fe-3e25b02cac9c None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:07.344733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdba28-a804-415b-88fe-3e25b02cac9c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:07.345271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdba28-a804-415b-88fe-3e25b02cac9c None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:07.353225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 180/339] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:07.354622 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9396200-d0c8-4b5b-9d8f-95323ddeaf71 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:07.355114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9396200-d0c8-4b5b-9d8f-95323ddeaf71 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:07.355590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9396200-d0c8-4b5b-9d8f-95323ddeaf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:07.365044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18c6ea-7416-4b85-9c93-9348e74c3da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:07.365690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18c6ea-7416-4b85-9c93-9348e74c3da9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:07.365974 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18c6ea-7416-4b85-9c93-9348e74c3da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:07.366248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18c6ea-7416-4b85-9c93-9348e74c3da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:07.393953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b9396200-d0c8-4b5b-9d8f-95323ddeaf71 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:07.395490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b9396200-d0c8-4b5b-9d8f-95323ddeaf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:07.441333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:07.477587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18c6ea-7416-4b85-9c93-9348e74c3da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:07.479351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18c6ea-7416-4b85-9c93-9348e74c3da9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:07.547151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 181/340] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:07.588021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9396200-d0c8-4b5b-9d8f-95323ddeaf71 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:07.615502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 160/341] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:07.621376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18c6ea-7416-4b85-9c93-9348e74c3da9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:07.710604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:07.730430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:07.744984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9396200-d0c8-4b5b-9d8f-95323ddeaf71 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:07.749679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18c6ea-7416-4b85-9c93-9348e74c3da9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:07.784489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d457f7-fec2-4944-8c86-1e9ad3567385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:07.786179 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d457f7-fec2-4944-8c86-1e9ad3567385 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:07.786616 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d457f7-fec2-4944-8c86-1e9ad3567385 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:07.787060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d457f7-fec2-4944-8c86-1e9ad3567385 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:07.799368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d457f7-fec2-4944-8c86-1e9ad3567385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:07.802959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7251df3-e1fc-4a75-aef2-eeb6317732b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:07.803608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7251df3-e1fc-4a75-aef2-eeb6317732b5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:07.803887 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7251df3-e1fc-4a75-aef2-eeb6317732b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:07.804161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7251df3-e1fc-4a75-aef2-eeb6317732b5 None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-04d457f7-fec2-4944-8c86-1e9ad3567385 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:07.805858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:07.806885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:07.807835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:07.807835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:07.807835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:07.807835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:07.807835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:07.807835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:07.807835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:07.807835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:07.807835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:07.807835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:07.807835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:07.807835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:07.809605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7251df3-e1fc-4a75-aef2-eeb6317732b5 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:07.810262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 182/342] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:20:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:07.811791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7251df3-e1fc-4a75-aef2-eeb6317732b5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:07.814627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 161/343] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:07 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:07.819103 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7251df3-e1fc-4a75-aef2-eeb6317732b5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:07.819298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d457f7-fec2-4944-8c86-1e9ad3567385 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:07.963942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7251df3-e1fc-4a75-aef2-eeb6317732b5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:07.970255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d457f7-fec2-4944-8c86-1e9ad3567385 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:08.015686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b95348-de81-493b-9637-356999f0cc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:08.016592 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b95348-de81-493b-9637-356999f0cc75 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:08.017055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b95348-de81-493b-9637-356999f0cc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:08.017466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b95348-de81-493b-9637-356999f0cc75 None admin] PATH_INFO: `/v3/groups/c2bd198a952645c090e18434714d16bd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:08.021050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15e35c-a194-4328-89e9-1d4f609205c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:08.021940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15e35c-a194-4328-89e9-1d4f609205c0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:08.021940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15e35c-a194-4328-89e9-1d4f609205c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:08.022203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15e35c-a194-4328-89e9-1d4f609205c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:08.022923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15e35c-a194-4328-89e9-1d4f609205c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:08.023224 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15e35c-a194-4328-89e9-1d4f609205c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:08.024994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15e35c-a194-4328-89e9-1d4f609205c0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:08.025699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b95348-de81-493b-9637-356999f0cc75 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bd198a952645c090e18434714d16bd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:08.027499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b95348-de81-493b-9637-356999f0cc75 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:08.033403 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 162/344] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:07 2022] GET /identity/v3/groups/c2bd198a952645c090e18434714d16bd => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:08.033973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 183/345] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:08.042270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b95348-de81-493b-9637-356999f0cc75 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:08.044716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15e35c-a194-4328-89e9-1d4f609205c0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:08.060860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:08.061247 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:08.162634 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b95348-de81-493b-9637-356999f0cc75 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:08.201398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf00ac5-48dd-40b0-9ea3-d8ff8f8858e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:08.202432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf00ac5-48dd-40b0-9ea3-d8ff8f8858e1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:08.202855 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf00ac5-48dd-40b0-9ea3-d8ff8f8858e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:08.203277 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf00ac5-48dd-40b0-9ea3-d8ff8f8858e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:08.203782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15e35c-a194-4328-89e9-1d4f609205c0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:08.253470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fabed2-af3e-461b-8ffc-4cfcf5238fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:08.254323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fabed2-af3e-461b-8ffc-4cfcf5238fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:08.254754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fabed2-af3e-461b-8ffc-4cfcf5238fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:08.255180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fabed2-af3e-461b-8ffc-4cfcf5238fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:08.256127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fabed2-af3e-461b-8ffc-4cfcf5238fb4 None admin] RBAC: Adding query filter params (group.id=c2bd198a952645c090e18434714d16bd, role.id=102380322b574754b40ec23fe0394401, scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:08.256602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fabed2-af3e-461b-8ffc-4cfcf5238fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:08.258218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fabed2-af3e-461b-8ffc-4cfcf5238fb4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:08.265122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 184/346] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 6 01:20:08 2022] GET /identity/v3/role_assignments?group.id=c2bd198a952645c090e18434714d16bd&scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e&role.id=102380322b574754b40ec23fe0394401 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:08.266543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e5618-f355-43b0-84ba-805f0c562f39 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:08.266992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e5618-f355-43b0-84ba-805f0c562f39 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:08.267427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e5618-f355-43b0-84ba-805f0c562f39 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:08.271146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 185/347] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:08.274418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621e47-93da-4da9-b6d1-71c190c97411 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:08.274966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621e47-93da-4da9-b6d1-71c190c97411 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:08.275448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621e47-93da-4da9-b6d1-71c190c97411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:08.280706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf00ac5-48dd-40b0-9ea3-d8ff8f8858e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:08.282235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf00ac5-48dd-40b0-9ea3-d8ff8f8858e1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:08.293677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:08.305930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-99621e47-93da-4da9-b6d1-71c190c97411 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:08.307577 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-99621e47-93da-4da9-b6d1-71c190c97411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:08.413680 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 186/348] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:08.426869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ee0d-7cce-40a3-ad29-1ce3c046a69e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:08.427299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ee0d-7cce-40a3-ad29-1ce3c046a69e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:08.427806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ee0d-7cce-40a3-ad29-1ce3c046a69e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:08.429456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 187/349] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:08.438430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb2af7-f8ce-48bc-825a-9e001986203b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:08.439036 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb2af7-f8ce-48bc-825a-9e001986203b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:08.439518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb2af7-f8ce-48bc-825a-9e001986203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:08.457303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:08.480172 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e5cb2af7-f8ce-48bc-825a-9e001986203b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:08.485580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e5cb2af7-f8ce-48bc-825a-9e001986203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:08.539536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 163/350] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:20:08.540312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf00ac5-48dd-40b0-9ea3-d8ff8f8858e1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:08.637966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 188/351] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:08.640141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb2af7-f8ce-48bc-825a-9e001986203b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:08.752049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf00ac5-48dd-40b0-9ea3-d8ff8f8858e1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:08.757153 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb2af7-f8ce-48bc-825a-9e001986203b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:08.765535 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:08.802253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efc5c2-efae-403b-8723-613a12cc8c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:08.803134 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efc5c2-efae-403b-8723-613a12cc8c09 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:08.803563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efc5c2-efae-403b-8723-613a12cc8c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:08.803996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efc5c2-efae-403b-8723-613a12cc8c09 None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:08.804179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c4e2c-785d-4458-b258-1e6e27a05ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:08.805190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c4e2c-785d-4458-b258-1e6e27a05ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:08.805613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c4e2c-785d-4458-b258-1e6e27a05ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:08.806049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c4e2c-785d-4458-b258-1e6e27a05ec4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:08.806171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efc5c2-efae-403b-8723-613a12cc8c09 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:08.807590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efc5c2-efae-403b-8723-613a12cc8c09 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:08.809438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 189/352] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:08 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:08.810334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efc5c2-efae-403b-8723-613a12cc8c09 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:08.820928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:08.824444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c4e2c-785d-4458-b258-1e6e27a05ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c96c4e2c-785d-4458-b258-1e6e27a05ec4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:08.836438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:08.837423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:08.838243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:08.838243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:08.838243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:08.838243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:08.838243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:08.838243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:08.838243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:08.838243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:08.838243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:08.838243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:08.838243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:20:08.838243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:08.838858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 164/353] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:08.839459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c4e2c-785d-4458-b258-1e6e27a05ec4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:09.021436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efc5c2-efae-403b-8723-613a12cc8c09 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:09.036884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c4e2c-785d-4458-b258-1e6e27a05ec4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:09.081823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b30358-e224-49a1-8d80-bcd42253663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:09.084670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b30358-e224-49a1-8d80-bcd42253663a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.084986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b30358-e224-49a1-8d80-bcd42253663a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.085270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b30358-e224-49a1-8d80-bcd42253663a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.089615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3139d5d-d557-4e8f-a940-cb3fc0dff5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:09.090269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3139d5d-d557-4e8f-a940-cb3fc0dff5ee None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.090806 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3139d5d-d557-4e8f-a940-cb3fc0dff5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.091100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3139d5d-d557-4e8f-a940-cb3fc0dff5ee None admin] PATH_INFO: `/v3/groups/c2bd198a952645c090e18434714d16bd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.092842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3139d5d-d557-4e8f-a940-cb3fc0dff5ee None admin] RBAC: Authorizing `identity:get_group(group_id=c2bd198a952645c090e18434714d16bd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:09.094772 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3139d5d-d557-4e8f-a940-cb3fc0dff5ee None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:09.096657 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 165/354] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:08 2022] GET /identity/v3/groups/c2bd198a952645c090e18434714d16bd => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:09.097055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b30358-e224-49a1-8d80-bcd42253663a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:09.097635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3139d5d-d557-4e8f-a940-cb3fc0dff5ee None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-04b30358-e224-49a1-8d80-bcd42253663a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:09.106900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:09.108325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:09.109452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:09.109452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:09.109452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:09.109452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:09.109452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:09.109452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:09.109452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:09.109452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:09.109452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:09.109452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:09.109452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:09.109452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:09.112181 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 190/355] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:09.113966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacfb07-f906-42a1-b8f8-062c908be9f4 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.114742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacfb07-f906-42a1-b8f8-062c908be9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.115172 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacfb07-f906-42a1-b8f8-062c908be9f4 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.117767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 191/356] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:09.118625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacfb07-f906-42a1-b8f8-062c908be9f4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:09.147644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:09.219195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:09.239575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3139d5d-d557-4e8f-a940-cb3fc0dff5ee None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:09.271671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacfb07-f906-42a1-b8f8-062c908be9f4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:09.278330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d16e66-0de9-4edc-8cb9-e30075d98030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:09.278961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d16e66-0de9-4edc-8cb9-e30075d98030 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.279413 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d16e66-0de9-4edc-8cb9-e30075d98030 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.279641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d16e66-0de9-4edc-8cb9-e30075d98030 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.280368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d16e66-0de9-4edc-8cb9-e30075d98030 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:09.280679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d16e66-0de9-4edc-8cb9-e30075d98030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:09.282152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d16e66-0de9-4edc-8cb9-e30075d98030 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:09.297048 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 166/357] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:20:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:09.298355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d16e66-0de9-4edc-8cb9-e30075d98030 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:09.332344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7452027-a0ea-44d7-b487-248e177567e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:09.332888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7452027-a0ea-44d7-b487-248e177567e2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.333189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7452027-a0ea-44d7-b487-248e177567e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.333460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7452027-a0ea-44d7-b487-248e177567e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.334948 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7452027-a0ea-44d7-b487-248e177567e2 None admin] RBAC: Adding query filter params (group.id=c2bd198a952645c090e18434714d16bd, role.id=30697c5bde894ea6b08f513a33e8b9ac, scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:09.335258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7452027-a0ea-44d7-b487-248e177567e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:09.336671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7452027-a0ea-44d7-b487-248e177567e2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:09.343529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 192/358] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 6 01:20:09 2022] GET /identity/v3/role_assignments?group.id=c2bd198a952645c090e18434714d16bd&scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e&role.id=30697c5bde894ea6b08f513a33e8b9ac => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:09.344650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3c27d-0df9-468b-b96e-4e0c32288ba5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.344852 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3c27d-0df9-468b-b96e-4e0c32288ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.345161 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3c27d-0df9-468b-b96e-4e0c32288ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.369983 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-74c3c27d-0df9-468b-b96e-4e0c32288ba5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:09.371590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-74c3c27d-0df9-468b-b96e-4e0c32288ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:09.425162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:09.432456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d16e66-0de9-4edc-8cb9-e30075d98030 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:09.451691 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 193/359] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:09.452168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3c27d-0df9-468b-b96e-4e0c32288ba5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:09.524102 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d80e5b-9cee-4337-9a29-23618cddaeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:09.524745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80e5b-9cee-4337-9a29-23618cddaeaa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.525067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80e5b-9cee-4337-9a29-23618cddaeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.525334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80e5b-9cee-4337-9a29-23618cddaeaa None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.526063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d80e5b-9cee-4337-9a29-23618cddaeaa None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:09.526368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d80e5b-9cee-4337-9a29-23618cddaeaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:09.530003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d80e5b-9cee-4337-9a29-23618cddaeaa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:09.544416 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 167/360] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:20:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:09.545905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d80e5b-9cee-4337-9a29-23618cddaeaa None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:09.565251 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:09.635482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3c27d-0df9-468b-b96e-4e0c32288ba5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:09.683411 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b3503-2874-437c-8d24-284e107d23a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:09.684314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b3503-2874-437c-8d24-284e107d23a0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.684597 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b3503-2874-437c-8d24-284e107d23a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.684869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b3503-2874-437c-8d24-284e107d23a0 None admin] PATH_INFO: `/v3/users/6b8f3ca1136e4a2c916e6536cae593ef` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.686355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d80e5b-9cee-4337-9a29-23618cddaeaa None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:09.686686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b3503-2874-437c-8d24-284e107d23a0 None admin] RBAC: Authorizing `identity:get_user(user_id=6b8f3ca1136e4a2c916e6536cae593ef)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:09.688415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b3503-2874-437c-8d24-284e107d23a0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:09.691298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 194/361] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:20:09 2022] GET /identity/v3/users/6b8f3ca1136e4a2c916e6536cae593ef => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:09.692181 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b3503-2874-437c-8d24-284e107d23a0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:09.730824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1cb65-f65c-48e5-81a9-345975e12a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:09.731939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1cb65-f65c-48e5-81a9-345975e12a8f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.732435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1cb65-f65c-48e5-81a9-345975e12a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.732735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1cb65-f65c-48e5-81a9-345975e12a8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.746812 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1cb65-f65c-48e5-81a9-345975e12a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-49b1cb65-f65c-48e5-81a9-345975e12a8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:09.755750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:09.757127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:09.757924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:09.757924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:09.757924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:09.757924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:09.757924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:09.757924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:09.757924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:09.757924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:09.757924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:09.757924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:09.757924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:09.757924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:09.759956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 168/362] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:20:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:09.759956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635aa83-64f0-44fe-b4ea-41b94bf67078 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.759956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635aa83-64f0-44fe-b4ea-41b94bf67078 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.760359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635aa83-64f0-44fe-b4ea-41b94bf67078 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.765998 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 169/363] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:09.766817 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635aa83-64f0-44fe-b4ea-41b94bf67078 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:09.801568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:09.833287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b3503-2874-437c-8d24-284e107d23a0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:09.861144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:09.873950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08632b-b364-49ad-89af-1372119c938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:09.874676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08632b-b364-49ad-89af-1372119c938e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.874961 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08632b-b364-49ad-89af-1372119c938e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.875232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08632b-b364-49ad-89af-1372119c938e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.906159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635aa83-64f0-44fe-b4ea-41b94bf67078 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:09.947510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c9e0a-ce65-4fe5-97ab-bd9283da747b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:09.948141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c9e0a-ce65-4fe5-97ab-bd9283da747b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.948520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c9e0a-ce65-4fe5-97ab-bd9283da747b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.948797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c9e0a-ce65-4fe5-97ab-bd9283da747b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.949628 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c9e0a-ce65-4fe5-97ab-bd9283da747b None admin] RBAC: Adding query filter params (role.id=46e6b316a22d4082b00baed02609b6dc, user.id=6b8f3ca1136e4a2c916e6536cae593ef, scope.system=all) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:09.949935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c9e0a-ce65-4fe5-97ab-bd9283da747b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:09.950775 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08632b-b364-49ad-89af-1372119c938e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:09.951688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c9e0a-ce65-4fe5-97ab-bd9283da747b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:09.952310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08632b-b364-49ad-89af-1372119c938e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:09.965328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 170/364] 10.222.0.15 () {56 vars in 1308 bytes} [Sat Aug 6 01:20:09 2022] GET /identity/v3/role_assignments?user.id=6b8f3ca1136e4a2c916e6536cae593ef&scope.system=all&role.id=46e6b316a22d4082b00baed02609b6dc => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:09.967603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528ab95-d50e-44c8-b549-1b637be6a700 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:09.967884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528ab95-d50e-44c8-b549-1b637be6a700 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:09.968163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528ab95-d50e-44c8-b549-1b637be6a700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:09.988863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b528ab95-d50e-44c8-b549-1b637be6a700 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:09.990254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b528ab95-d50e-44c8-b549-1b637be6a700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:10.069024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 195/365] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:10.069600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08632b-b364-49ad-89af-1372119c938e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:10.075520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 171/366] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:10.077086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528ab95-d50e-44c8-b549-1b637be6a700 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:10.086096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:10.102197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:10.190764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08632b-b364-49ad-89af-1372119c938e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:10.191678 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528ab95-d50e-44c8-b549-1b637be6a700 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:10.230124 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f849f-f9d9-4b06-ba0d-e4fb6a55b536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:10.230790 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f849f-f9d9-4b06-ba0d-e4fb6a55b536 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:10.231076 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f849f-f9d9-4b06-ba0d-e4fb6a55b536 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:10.231344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f849f-f9d9-4b06-ba0d-e4fb6a55b536 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:10.231910 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634f06d-a662-4346-ba23-92ab7c47bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:10.233338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634f06d-a662-4346-ba23-92ab7c47bc94 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:10.233479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f849f-f9d9-4b06-ba0d-e4fb6a55b536 None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:10.233663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634f06d-a662-4346-ba23-92ab7c47bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:10.233943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634f06d-a662-4346-ba23-92ab7c47bc94 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:10.234687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634f06d-a662-4346-ba23-92ab7c47bc94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:10.234995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634f06d-a662-4346-ba23-92ab7c47bc94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:10.235704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f849f-f9d9-4b06-ba0d-e4fb6a55b536 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:10.236388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634f06d-a662-4346-ba23-92ab7c47bc94 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:10.237899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 172/367] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:10 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:10.238925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f849f-f9d9-4b06-ba0d-e4fb6a55b536 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:10.250808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 196/368] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:10.256681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634f06d-a662-4346-ba23-92ab7c47bc94 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:10.327676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:10.354693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f849f-f9d9-4b06-ba0d-e4fb6a55b536 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:10.356968 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:10.374601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634f06d-a662-4346-ba23-92ab7c47bc94 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:10.396606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f4330-9c5a-4543-b518-68ee25e3fa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:10.397308 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f4330-9c5a-4543-b518-68ee25e3fa6a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:10.397680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f4330-9c5a-4543-b518-68ee25e3fa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:10.397960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f4330-9c5a-4543-b518-68ee25e3fa6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:10.409619 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f4330-9c5a-4543-b518-68ee25e3fa6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:10.412693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36084fdc-ecd7-49a5-b0f1-af6e3b04679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:10.413476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36084fdc-ecd7-49a5-b0f1-af6e3b04679e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:10.413913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36084fdc-ecd7-49a5-b0f1-af6e3b04679e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:10.414294 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36084fdc-ecd7-49a5-b0f1-af6e3b04679e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-944f4330-9c5a-4543-b518-68ee25e3fa6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:10.414698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:10.415632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:10.416599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 173/369] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:20:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:10.417587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f4330-9c5a-4543-b518-68ee25e3fa6a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:10.493991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36084fdc-ecd7-49a5-b0f1-af6e3b04679e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:10.495591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36084fdc-ecd7-49a5-b0f1-af6e3b04679e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:10.530480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f4330-9c5a-4543-b518-68ee25e3fa6a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:10.568011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b8505-ec20-4fc3-b883-19351c97ff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:10.568957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b8505-ec20-4fc3-b883-19351c97ff13 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:10.569376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b8505-ec20-4fc3-b883-19351c97ff13 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:10.569788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b8505-ec20-4fc3-b883-19351c97ff13 None admin] PATH_INFO: `/v3/groups/c2bd198a952645c090e18434714d16bd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:10.571269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b8505-ec20-4fc3-b883-19351c97ff13 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bd198a952645c090e18434714d16bd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:10.572936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b8505-ec20-4fc3-b883-19351c97ff13 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:10.574973 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 174/370] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:10 2022] GET /identity/v3/groups/c2bd198a952645c090e18434714d16bd => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:10.575881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b8505-ec20-4fc3-b883-19351c97ff13 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:10.579315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:10.588353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:10.608676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 197/371] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:20:10.609885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36084fdc-ecd7-49a5-b0f1-af6e3b04679e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:10.689398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b8505-ec20-4fc3-b883-19351c97ff13 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:10.723557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36084fdc-ecd7-49a5-b0f1-af6e3b04679e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:10.727017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280212d-a45f-49a3-bfe7-3c3f025a99ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:10.727803 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280212d-a45f-49a3-bfe7-3c3f025a99ee None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:10.728305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280212d-a45f-49a3-bfe7-3c3f025a99ee None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:10.728718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280212d-a45f-49a3-bfe7-3c3f025a99ee None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:10.729657 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280212d-a45f-49a3-bfe7-3c3f025a99ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:10.730109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280212d-a45f-49a3-bfe7-3c3f025a99ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:10.731633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280212d-a45f-49a3-bfe7-3c3f025a99ee None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:10.741791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 175/372] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:10.742953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280212d-a45f-49a3-bfe7-3c3f025a99ee None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:10.761168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c398-7843-459c-9bb3-ebb23311948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:10.761713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c398-7843-459c-9bb3-ebb23311948d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:10.762023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c398-7843-459c-9bb3-ebb23311948d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:10.762269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c398-7843-459c-9bb3-ebb23311948d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:10.763078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835c398-7843-459c-9bb3-ebb23311948d None admin] RBAC: Adding query filter params (group.id=c2bd198a952645c090e18434714d16bd, role.id=102380322b574754b40ec23fe0394401, scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:10.763499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835c398-7843-459c-9bb3-ebb23311948d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:10.765414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835c398-7843-459c-9bb3-ebb23311948d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:10.771490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 198/373] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 6 01:20:10 2022] GET /identity/v3/role_assignments?group.id=c2bd198a952645c090e18434714d16bd&scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695&role.id=102380322b574754b40ec23fe0394401 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:10.772402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c398-7843-459c-9bb3-ebb23311948d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:10.817024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:10.834787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:10.866451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280212d-a45f-49a3-bfe7-3c3f025a99ee None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:10.892237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c398-7843-459c-9bb3-ebb23311948d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:10.905957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc49e9-2b9a-4bb2-aed3-f490455306b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:10.906959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc49e9-2b9a-4bb2-aed3-f490455306b6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:10.907475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc49e9-2b9a-4bb2-aed3-f490455306b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:10.907998 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc49e9-2b9a-4bb2-aed3-f490455306b6 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:10.909516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc49e9-2b9a-4bb2-aed3-f490455306b6 None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:10.911230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc49e9-2b9a-4bb2-aed3-f490455306b6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:10.913493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 176/374] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:10 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:10.922826 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc49e9-2b9a-4bb2-aed3-f490455306b6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:10.940874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d018bd6-74a0-47ce-bf8e-75737d73ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:10.941574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d018bd6-74a0-47ce-bf8e-75737d73ba3f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:10.941858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d018bd6-74a0-47ce-bf8e-75737d73ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:10.942181 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d018bd6-74a0-47ce-bf8e-75737d73ba3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:11.043571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d018bd6-74a0-47ce-bf8e-75737d73ba3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:11.046294 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d018bd6-74a0-47ce-bf8e-75737d73ba3f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:11.073997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc49e9-2b9a-4bb2-aed3-f490455306b6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:11.104726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:11.110236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:11.117595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5463ebc-9e06-44d6-ad01-58c3a56c11ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:11.118705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5463ebc-9e06-44d6-ad01-58c3a56c11ba None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:11.119276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5463ebc-9e06-44d6-ad01-58c3a56c11ba None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:11.119787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5463ebc-9e06-44d6-ad01-58c3a56c11ba None admin] PATH_INFO: `/v3/groups/c2bd198a952645c090e18434714d16bd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:11.121328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5463ebc-9e06-44d6-ad01-58c3a56c11ba None admin] RBAC: Authorizing `identity:get_group(group_id=c2bd198a952645c090e18434714d16bd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:11.124182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5463ebc-9e06-44d6-ad01-58c3a56c11ba None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:11.126550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 177/375] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:10 2022] GET /identity/v3/groups/c2bd198a952645c090e18434714d16bd => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:11.132560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5463ebc-9e06-44d6-ad01-58c3a56c11ba None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:11.167582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 199/376] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:11.169033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc46622-01d7-47bb-9246-a53fc3842301 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:11.169506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc46622-01d7-47bb-9246-a53fc3842301 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:11.169612 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc46622-01d7-47bb-9246-a53fc3842301 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:11.171049 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 200/377] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:11.175949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc46622-01d7-47bb-9246-a53fc3842301 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:11.247006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5463ebc-9e06-44d6-ad01-58c3a56c11ba None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:11.285915 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ea956-7a60-4afd-9b52-1b1fcbe0dc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:11.286702 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ea956-7a60-4afd-9b52-1b1fcbe0dc1b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:11.287099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ea956-7a60-4afd-9b52-1b1fcbe0dc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:11.287482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ea956-7a60-4afd-9b52-1b1fcbe0dc1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:11.287736 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc46622-01d7-47bb-9246-a53fc3842301 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:11.288492 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ea956-7a60-4afd-9b52-1b1fcbe0dc1b None admin] RBAC: Adding query filter params (group.id=c2bd198a952645c090e18434714d16bd, role.id=30697c5bde894ea6b08f513a33e8b9ac, scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:11.288934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ea956-7a60-4afd-9b52-1b1fcbe0dc1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:11.291346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ea956-7a60-4afd-9b52-1b1fcbe0dc1b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:11.298370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 178/378] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 6 01:20:11 2022] GET /identity/v3/role_assignments?group.id=c2bd198a952645c090e18434714d16bd&scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695&role.id=30697c5bde894ea6b08f513a33e8b9ac => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:11.299776 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0d58c-afd5-4831-a3bb-603f1dc5d8fb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:11.300170 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0d58c-afd5-4831-a3bb-603f1dc5d8fb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:11.300553 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0d58c-afd5-4831-a3bb-603f1dc5d8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:11.331409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75728506-f791-4ead-a932-cbbea816f06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:11.332474 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75728506-f791-4ead-a932-cbbea816f06e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:11.333032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75728506-f791-4ead-a932-cbbea816f06e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:11.333523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75728506-f791-4ead-a932-cbbea816f06e None admin] PATH_INFO: `/v3/projects/3c0f4c0f88fe4deb812ff64ab95ac12c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:11.335034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75728506-f791-4ead-a932-cbbea816f06e None admin] RBAC: Authorizing `identity:get_project(project_id=3c0f4c0f88fe4deb812ff64ab95ac12c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:11.336688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75728506-f791-4ead-a932-cbbea816f06e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:11.338958 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 201/379] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:11 2022] GET /identity/v3/projects/3c0f4c0f88fe4deb812ff64ab95ac12c => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:11.346095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-90c0d58c-afd5-4831-a3bb-603f1dc5d8fb None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:11.346095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-90c0d58c-afd5-4831-a3bb-603f1dc5d8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:11.347546 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75728506-f791-4ead-a932-cbbea816f06e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:11.411747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:11.444845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:11.462781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 179/380] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:11.528651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0d58c-afd5-4831-a3bb-603f1dc5d8fb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:11.559731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75728506-f791-4ead-a932-cbbea816f06e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:11.618901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb76fa1-ce6b-47e3-905a-38628bd31485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:11.619566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb76fa1-ce6b-47e3-905a-38628bd31485 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:11.619846 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb76fa1-ce6b-47e3-905a-38628bd31485 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:11.620124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb76fa1-ce6b-47e3-905a-38628bd31485 None admin] PATH_INFO: `/v3/groups/d1f14f98354f4ae68b9f0ffa20bd5df7` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:11.629563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb76fa1-ce6b-47e3-905a-38628bd31485 None admin] RBAC: Authorizing `identity:get_group(group_id=d1f14f98354f4ae68b9f0ffa20bd5df7)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:11.631016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb76fa1-ce6b-47e3-905a-38628bd31485 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:11.632711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 202/381] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:11 2022] GET /identity/v3/groups/d1f14f98354f4ae68b9f0ffa20bd5df7 => generated 229 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:11.639092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb76fa1-ce6b-47e3-905a-38628bd31485 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:11.650589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0d58c-afd5-4831-a3bb-603f1dc5d8fb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:11.690609 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d3e59-af52-498e-8a74-80439066ef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:11.692200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d3e59-af52-498e-8a74-80439066ef65 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:11.692783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d3e59-af52-498e-8a74-80439066ef65 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:11.694271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d3e59-af52-498e-8a74-80439066ef65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:11.714394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d3e59-af52-498e-8a74-80439066ef65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8d5d3e59-af52-498e-8a74-80439066ef65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:11.721268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:11.722370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:11.723338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:11.723338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:11.723338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:11.723338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:11.723338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:11.723338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:11.723338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:11.723338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:11.723338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:11.723338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:11.723338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:11.723338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:11.725600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 180/382] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:11.733904 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d3e59-af52-498e-8a74-80439066ef65 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:11.812335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:11.818568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:11.863188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb76fa1-ce6b-47e3-905a-38628bd31485 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:11.869169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d3e59-af52-498e-8a74-80439066ef65 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:11.910263 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9953c-e041-4b4d-b2a2-1d927a626cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:11.910955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9953c-e041-4b4d-b2a2-1d927a626cbd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:11.911255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9953c-e041-4b4d-b2a2-1d927a626cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:11.911528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9953c-e041-4b4d-b2a2-1d927a626cbd None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:11.912259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9953c-e041-4b4d-b2a2-1d927a626cbd None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:11.912568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9953c-e041-4b4d-b2a2-1d927a626cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:11.914063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9953c-e041-4b4d-b2a2-1d927a626cbd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:11.923895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 181/383] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:20:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:11.929706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9953c-e041-4b4d-b2a2-1d927a626cbd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:11.962970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4a34e-88e7-4561-ae98-5b878d4ee76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:11.963606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4a34e-88e7-4561-ae98-5b878d4ee76a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:11.963896 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4a34e-88e7-4561-ae98-5b878d4ee76a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:11.964175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4a34e-88e7-4561-ae98-5b878d4ee76a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:11.965018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4a34e-88e7-4561-ae98-5b878d4ee76a None admin] RBAC: Adding query filter params (group.id=d1f14f98354f4ae68b9f0ffa20bd5df7, role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=3c0f4c0f88fe4deb812ff64ab95ac12c) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:11.965337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4a34e-88e7-4561-ae98-5b878d4ee76a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:11.966975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4a34e-88e7-4561-ae98-5b878d4ee76a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:11.986964 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 203/384] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 6 01:20:11 2022] GET /identity/v3/role_assignments?group.id=d1f14f98354f4ae68b9f0ffa20bd5df7&scope.project.id=3c0f4c0f88fe4deb812ff64ab95ac12c&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 260 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:11.990738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda7fe4-b331-4fe7-be9f-eb1dcff21a62 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:11.991023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda7fe4-b331-4fe7-be9f-eb1dcff21a62 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:11.991304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda7fe4-b331-4fe7-be9f-eb1dcff21a62 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:11.993271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 204/385] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:20:12.002829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57f39d-0600-4d09-abb3-6721c5c8b11a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:12.004082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57f39d-0600-4d09-abb3-6721c5c8b11a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:12.004362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57f39d-0600-4d09-abb3-6721c5c8b11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:12.050375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2c57f39d-0600-4d09-abb3-6721c5c8b11a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:12.051493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2c57f39d-0600-4d09-abb3-6721c5c8b11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:12.056845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9953c-e041-4b4d-b2a2-1d927a626cbd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:12.077380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:12.099259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965f689-8382-4e40-ad13-7f6849ec7af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:12.100265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965f689-8382-4e40-ad13-7f6849ec7af6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:12.100748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965f689-8382-4e40-ad13-7f6849ec7af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:12.101290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965f689-8382-4e40-ad13-7f6849ec7af6 None admin] PATH_INFO: `/v3/groups/c2bd198a952645c090e18434714d16bd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:12.102707 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965f689-8382-4e40-ad13-7f6849ec7af6 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bd198a952645c090e18434714d16bd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:12.104370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965f689-8382-4e40-ad13-7f6849ec7af6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:12.111880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 182/386] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:11 2022] GET /identity/v3/groups/c2bd198a952645c090e18434714d16bd => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:12.113604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965f689-8382-4e40-ad13-7f6849ec7af6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:12.191484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 205/387] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:12.218527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57f39d-0600-4d09-abb3-6721c5c8b11a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:12.238260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965f689-8382-4e40-ad13-7f6849ec7af6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:12.278869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd1755-deb8-44c7-9951-a062dde1826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:12.280518 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd1755-deb8-44c7-9951-a062dde1826c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:12.281060 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd1755-deb8-44c7-9951-a062dde1826c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:12.281558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd1755-deb8-44c7-9951-a062dde1826c None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:12.283303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd1755-deb8-44c7-9951-a062dde1826c None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:12.285201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd1755-deb8-44c7-9951-a062dde1826c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:12.292605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 183/388] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:12 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:12.294227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd1755-deb8-44c7-9951-a062dde1826c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:12.418077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:12.418269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:12.466143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57f39d-0600-4d09-abb3-6721c5c8b11a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:12.526011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd1755-deb8-44c7-9951-a062dde1826c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:12.546222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eee44-3d6a-4ec9-be11-749b0bef26f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:12.547249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eee44-3d6a-4ec9-be11-749b0bef26f7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:12.547733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eee44-3d6a-4ec9-be11-749b0bef26f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:12.548206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eee44-3d6a-4ec9-be11-749b0bef26f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:12.570419 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57eee44-3d6a-4ec9-be11-749b0bef26f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c57eee44-3d6a-4ec9-be11-749b0bef26f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:12.578388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:12.579291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:12.580093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:12.580093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:12.580093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:12.580093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:12.580093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:12.580093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:12.580093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:12.580093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:12.580093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:12.580093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:12.580093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:12.580093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:12.582435 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 206/389] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:20:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:12.588423 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eee44-3d6a-4ec9-be11-749b0bef26f7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:12.590765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abbcec-0097-4f28-a858-b7acca09c49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:12.591942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abbcec-0097-4f28-a858-b7acca09c49c None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:12.592501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abbcec-0097-4f28-a858-b7acca09c49c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:12.593025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abbcec-0097-4f28-a858-b7acca09c49c None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e/groups/c2bd198a952645c090e18434714d16bd/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:12.595291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abbcec-0097-4f28-a858-b7acca09c49c None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec256f5efb04aabbbfa6845545a0e2e, group_id=c2bd198a952645c090e18434714d16bd, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:12.601030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abbcec-0097-4f28-a858-b7acca09c49c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:12.626407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 184/390] 10.222.0.15 () {58 vars in 1442 bytes} [Sat Aug 6 01:20:12 2022] PUT /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e/groups/c2bd198a952645c090e18434714d16bd/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:20:12.747394 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eee44-3d6a-4ec9-be11-749b0bef26f7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:12.790407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3e773-3ff8-41aa-8461-3a78e39ec471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:12.791027 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e773-3ff8-41aa-8461-3a78e39ec471 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:12.791306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e773-3ff8-41aa-8461-3a78e39ec471 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:12.791587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e773-3ff8-41aa-8461-3a78e39ec471 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:12.792308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3e773-3ff8-41aa-8461-3a78e39ec471 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:12.792611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3e773-3ff8-41aa-8461-3a78e39ec471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:12.794101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3e773-3ff8-41aa-8461-3a78e39ec471 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:12.797503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:12.804617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 207/391] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:12.812079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abbcec-0097-4f28-a858-b7acca09c49c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:12.953335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abbcec-0097-4f28-a858-b7acca09c49c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:12.978703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:12.993962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309afb90-357b-4724-a85f-557693a2bb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:12.994923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309afb90-357b-4724-a85f-557693a2bb84 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:12.995364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309afb90-357b-4724-a85f-557693a2bb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:12.996034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309afb90-357b-4724-a85f-557693a2bb84 None admin] PATH_INFO: `/v3/groups/c2bd198a952645c090e18434714d16bd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:12.997398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309afb90-357b-4724-a85f-557693a2bb84 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bd198a952645c090e18434714d16bd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:12.999684 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309afb90-357b-4724-a85f-557693a2bb84 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:13.001795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 185/392] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:12 2022] GET /identity/v3/groups/c2bd198a952645c090e18434714d16bd => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:13.010836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3e773-3ff8-41aa-8461-3a78e39ec471 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:13.152612 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3e773-3ff8-41aa-8461-3a78e39ec471 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:13.191507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a44426-bd3b-4736-8e8d-019a7707730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:13.192153 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44426-bd3b-4736-8e8d-019a7707730e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:13.192439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44426-bd3b-4736-8e8d-019a7707730e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:13.192719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a44426-bd3b-4736-8e8d-019a7707730e None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:13.193912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a44426-bd3b-4736-8e8d-019a7707730e None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:13.195334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a44426-bd3b-4736-8e8d-019a7707730e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:13.197375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 208/393] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:13 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:13.203273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309afb90-357b-4724-a85f-557693a2bb84 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:13.324214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309afb90-357b-4724-a85f-557693a2bb84 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:13.380520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd54fa-32a7-4e53-9740-24b526620eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:13.381492 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd54fa-32a7-4e53-9740-24b526620eb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:13.381979 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd54fa-32a7-4e53-9740-24b526620eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:13.382432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd54fa-32a7-4e53-9740-24b526620eb3 None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e/groups/c2bd198a952645c090e18434714d16bd/roles/30697c5bde894ea6b08f513a33e8b9ac` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:13.385309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd54fa-32a7-4e53-9740-24b526620eb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ec256f5efb04aabbbfa6845545a0e2e, group_id=c2bd198a952645c090e18434714d16bd, role_id=30697c5bde894ea6b08f513a33e8b9ac)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:13.386995 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd54fa-32a7-4e53-9740-24b526620eb3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:13.404209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 186/394] 10.222.0.15 () {58 vars in 1442 bytes} [Sat Aug 6 01:20:13 2022] PUT /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e/groups/c2bd198a952645c090e18434714d16bd/roles/30697c5bde894ea6b08f513a33e8b9ac => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:13.745738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6d9c7-a789-42b4-8c7e-1645e8ca7e13 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:13.746482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6d9c7-a789-42b4-8c7e-1645e8ca7e13 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:13.746972 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6d9c7-a789-42b4-8c7e-1645e8ca7e13 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:13.749063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 209/395] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:13.754112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb0651-f17e-45d0-ac1a-3ad611d03d16 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:13.754671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb0651-f17e-45d0-ac1a-3ad611d03d16 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:13.755160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb0651-f17e-45d0-ac1a-3ad611d03d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:13.775906 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bddb0651-f17e-45d0-ac1a-3ad611d03d16 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:13.777464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bddb0651-f17e-45d0-ac1a-3ad611d03d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:13.793345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744bdd4-f5f2-4df2-92a8-7729c7b8ceea None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:13.793652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744bdd4-f5f2-4df2-92a8-7729c7b8ceea None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:13.793901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744bdd4-f5f2-4df2-92a8-7729c7b8ceea None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:13.798086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 210/396] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:13.801642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47344568-4814-4a31-8614-bac52ec96ebe None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:13.801787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47344568-4814-4a31-8614-bac52ec96ebe None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:13.802048 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47344568-4814-4a31-8614-bac52ec96ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:13.826940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:13.830786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-47344568-4814-4a31-8614-bac52ec96ebe None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:13.833180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-47344568-4814-4a31-8614-bac52ec96ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:13.875161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 187/397] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:13.908472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:13.913860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb0651-f17e-45d0-ac1a-3ad611d03d16 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:13.923600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 211/398] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:13.957742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47344568-4814-4a31-8614-bac52ec96ebe None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:14.072449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47344568-4814-4a31-8614-bac52ec96ebe None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:14.125499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e98508-e9be-493b-8c94-efd676e536bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:14.126480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98508-e9be-493b-8c94-efd676e536bc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:14.126874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98508-e9be-493b-8c94-efd676e536bc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:14.127279 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e98508-e9be-493b-8c94-efd676e536bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:14.136758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb0651-f17e-45d0-ac1a-3ad611d03d16 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:14.142949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e98508-e9be-493b-8c94-efd676e536bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-17e98508-e9be-493b-8c94-efd676e536bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:14.151158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:14.152183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:14.153026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:14.153026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:14.153026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:14.153026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:14.153026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:14.153026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:14.153026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:14.153026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:14.153026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:14.153026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:14.153026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:14.153026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:14.157013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 212/399] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:20:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:14.159136 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e98508-e9be-493b-8c94-efd676e536bc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:14.206493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5010022-7a81-4136-ac28-082b57da4fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:14.207153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010022-7a81-4136-ac28-082b57da4fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:14.207439 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010022-7a81-4136-ac28-082b57da4fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:14.207716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010022-7a81-4136-ac28-082b57da4fc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:14.235564 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5010022-7a81-4136-ac28-082b57da4fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f5010022-7a81-4136-ac28-082b57da4fc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:14.240674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:14.241612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:14.242406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 188/400] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:14.249890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5010022-7a81-4136-ac28-082b57da4fc9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:14.283929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:14.321172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:14.382831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e98508-e9be-493b-8c94-efd676e536bc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:14.447412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5010022-7a81-4136-ac28-082b57da4fc9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:14.492678 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab2031-bbb9-46ff-bec6-4883ef970c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:14.493341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab2031-bbb9-46ff-bec6-4883ef970c78 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:14.493587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44d520-815d-4307-b77b-0f4ebf867bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:14.493713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab2031-bbb9-46ff-bec6-4883ef970c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:14.493896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab2031-bbb9-46ff-bec6-4883ef970c78 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:14.494219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44d520-815d-4307-b77b-0f4ebf867bba None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:14.494506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44d520-815d-4307-b77b-0f4ebf867bba None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:14.494782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44d520-815d-4307-b77b-0f4ebf867bba None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:14.494882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab2031-bbb9-46ff-bec6-4883ef970c78 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:14.495174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab2031-bbb9-46ff-bec6-4883ef970c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:14.495501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44d520-815d-4307-b77b-0f4ebf867bba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:14.495810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44d520-815d-4307-b77b-0f4ebf867bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:14.496617 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab2031-bbb9-46ff-bec6-4883ef970c78 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:14.497187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44d520-815d-4307-b77b-0f4ebf867bba None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:14.509546 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 189/401] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:20:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:14.513182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab2031-bbb9-46ff-bec6-4883ef970c78 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:14.523128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 213/402] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:14.532638 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44d520-815d-4307-b77b-0f4ebf867bba None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:14.650377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:14.668975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab2031-bbb9-46ff-bec6-4883ef970c78 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:14.725094 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49a303-b250-493a-b2d8-91e9374caba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:14.726102 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49a303-b250-493a-b2d8-91e9374caba3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:14.726606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49a303-b250-493a-b2d8-91e9374caba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:14.727206 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49a303-b250-493a-b2d8-91e9374caba3 None admin] PATH_INFO: `/v3/groups/c2bd198a952645c090e18434714d16bd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:14.727520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44d520-815d-4307-b77b-0f4ebf867bba None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:14.728873 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49a303-b250-493a-b2d8-91e9374caba3 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bd198a952645c090e18434714d16bd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:14.731726 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49a303-b250-493a-b2d8-91e9374caba3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:14.741687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 190/403] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:14 2022] GET /identity/v3/groups/c2bd198a952645c090e18434714d16bd => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:14.743263 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91512a4-7a18-4834-abb0-7fefd861d2a7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:14.743759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91512a4-7a18-4834-abb0-7fefd861d2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:14.744235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91512a4-7a18-4834-abb0-7fefd861d2a7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:14.746794 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 191/404] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:14.748471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91512a4-7a18-4834-abb0-7fefd861d2a7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:14.759594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:14.782958 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb7497-1fb7-4467-825a-d879932afaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:14.783612 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb7497-1fb7-4467-825a-d879932afaad None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:14.783900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb7497-1fb7-4467-825a-d879932afaad None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:14.784182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb7497-1fb7-4467-825a-d879932afaad None admin] PATH_INFO: `/v3/groups/c2bd198a952645c090e18434714d16bd` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:14.786461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb7497-1fb7-4467-825a-d879932afaad None admin] RBAC: Authorizing `identity:get_group(group_id=c2bd198a952645c090e18434714d16bd)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:14.787902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb7497-1fb7-4467-825a-d879932afaad None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:14.794157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 214/405] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:14 2022] GET /identity/v3/groups/c2bd198a952645c090e18434714d16bd => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:14.795651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be620429-7cd1-4171-88d0-b6dffcf0ad78 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:14.795942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be620429-7cd1-4171-88d0-b6dffcf0ad78 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:14.796220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be620429-7cd1-4171-88d0-b6dffcf0ad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:14.819063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-be620429-7cd1-4171-88d0-b6dffcf0ad78 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:14.820744 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-be620429-7cd1-4171-88d0-b6dffcf0ad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:14.898601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91512a4-7a18-4834-abb0-7fefd861d2a7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:14.906943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 215/406] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:14.906943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be620429-7cd1-4171-88d0-b6dffcf0ad78 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:14.962601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdbc39-c327-409f-8c09-0aacf471e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:14.963268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdbc39-c327-409f-8c09-0aacf471e17b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:14.963649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdbc39-c327-409f-8c09-0aacf471e17b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:14.964268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdbc39-c327-409f-8c09-0aacf471e17b None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:14.965510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdbc39-c327-409f-8c09-0aacf471e17b None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:14.968115 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdbc39-c327-409f-8c09-0aacf471e17b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:14.970549 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 192/407] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:14 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:14.971284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdbc39-c327-409f-8c09-0aacf471e17b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:15.014031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:15.028720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be620429-7cd1-4171-88d0-b6dffcf0ad78 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:15.046509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:15.068006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138d9ba-65d8-48d7-9e14-32da3e87a203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:15.068991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138d9ba-65d8-48d7-9e14-32da3e87a203 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:15.069438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138d9ba-65d8-48d7-9e14-32da3e87a203 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:15.069878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138d9ba-65d8-48d7-9e14-32da3e87a203 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:15.071227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138d9ba-65d8-48d7-9e14-32da3e87a203 None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:15.073821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138d9ba-65d8-48d7-9e14-32da3e87a203 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:15.081814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 216/408] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:14 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:15.082893 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138d9ba-65d8-48d7-9e14-32da3e87a203 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:15.118780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdbc39-c327-409f-8c09-0aacf471e17b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:15.169286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49593d13-e785-495b-96d2-b3627a13207a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:15.170599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49593d13-e785-495b-96d2-b3627a13207a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:15.170787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49593d13-e785-495b-96d2-b3627a13207a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:15.171065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49593d13-e785-495b-96d2-b3627a13207a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:15.186023 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49593d13-e785-495b-96d2-b3627a13207a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-49593d13-e785-495b-96d2-b3627a13207a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:15.193095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:15.194007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 193/409] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:20:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:15.197751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49593d13-e785-495b-96d2-b3627a13207a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:15.211593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138d9ba-65d8-48d7-9e14-32da3e87a203 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:15.252500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712483a-3ee1-41a8-9d76-187ab71fbbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:15.253603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712483a-3ee1-41a8-9d76-187ab71fbbc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:15.254104 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712483a-3ee1-41a8-9d76-187ab71fbbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:15.255586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712483a-3ee1-41a8-9d76-187ab71fbbc2 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695/groups/c2bd198a952645c090e18434714d16bd/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:15.257904 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712483a-3ee1-41a8-9d76-187ab71fbbc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695, group_id=c2bd198a952645c090e18434714d16bd, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:15.259670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712483a-3ee1-41a8-9d76-187ab71fbbc2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:15.279339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 217/410] 10.222.0.15 () {58 vars in 1442 bytes} [Sat Aug 6 01:20:15 2022] PUT /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695/groups/c2bd198a952645c090e18434714d16bd/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:15.280927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712483a-3ee1-41a8-9d76-187ab71fbbc2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:15.342474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:15.355939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49593d13-e785-495b-96d2-b3627a13207a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:15.373375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:15.395589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040b0e9-fa71-4cd4-a27e-68ebfccc3906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:15.396342 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040b0e9-fa71-4cd4-a27e-68ebfccc3906 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:15.396628 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040b0e9-fa71-4cd4-a27e-68ebfccc3906 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:15.396925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040b0e9-fa71-4cd4-a27e-68ebfccc3906 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695/groups/c2bd198a952645c090e18434714d16bd/roles/30697c5bde894ea6b08f513a33e8b9ac` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:15.399211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040b0e9-fa71-4cd4-a27e-68ebfccc3906 None admin] RBAC: Authorizing `identity:create_grant(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695, group_id=c2bd198a952645c090e18434714d16bd, role_id=30697c5bde894ea6b08f513a33e8b9ac)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:15.400658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040b0e9-fa71-4cd4-a27e-68ebfccc3906 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:15.418275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 194/411] 10.222.0.15 () {58 vars in 1442 bytes} [Sat Aug 6 01:20:15 2022] PUT /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695/groups/c2bd198a952645c090e18434714d16bd/roles/30697c5bde894ea6b08f513a33e8b9ac => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:15.420996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a23d8-958f-4229-afd9-ff231d78c99a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:15.421589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a23d8-958f-4229-afd9-ff231d78c99a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:15.422094 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a23d8-958f-4229-afd9-ff231d78c99a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:15.424176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 195/412] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:15.430482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44c525-8c5b-4087-b999-e5c52f955e8e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:15.431550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44c525-8c5b-4087-b999-e5c52f955e8e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:15.432109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44c525-8c5b-4087-b999-e5c52f955e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:15.469877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0c44c525-8c5b-4087-b999-e5c52f955e8e None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:15.473223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0c44c525-8c5b-4087-b999-e5c52f955e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:15.486953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712483a-3ee1-41a8-9d76-187ab71fbbc2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:15.533806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6018f-20f6-4b24-823d-a19ccc0d7112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:15.534531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6018f-20f6-4b24-823d-a19ccc0d7112 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:15.535098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6018f-20f6-4b24-823d-a19ccc0d7112 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:15.535569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6018f-20f6-4b24-823d-a19ccc0d7112 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:15.536633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6018f-20f6-4b24-823d-a19ccc0d7112 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:15.536966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6018f-20f6-4b24-823d-a19ccc0d7112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:15.538577 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6018f-20f6-4b24-823d-a19ccc0d7112 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:15.553607 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 218/413] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:15.556484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6018f-20f6-4b24-823d-a19ccc0d7112 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:15.593743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 196/414] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:15.631559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44c525-8c5b-4087-b999-e5c52f955e8e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:15.712598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6018f-20f6-4b24-823d-a19ccc0d7112 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:15.722889 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:15.731601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:15.764217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44c525-8c5b-4087-b999-e5c52f955e8e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:15.769392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4a13d-182d-41ab-92c4-d705ea3d5c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:15.770317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4a13d-182d-41ab-92c4-d705ea3d5c28 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:15.770799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4a13d-182d-41ab-92c4-d705ea3d5c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:15.771274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4a13d-182d-41ab-92c4-d705ea3d5c28 None admin] PATH_INFO: `/v3/groups/d1f14f98354f4ae68b9f0ffa20bd5df7` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:15.772639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4a13d-182d-41ab-92c4-d705ea3d5c28 None admin] RBAC: Authorizing `identity:get_group(group_id=d1f14f98354f4ae68b9f0ffa20bd5df7)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:15.774955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4a13d-182d-41ab-92c4-d705ea3d5c28 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:15.778256 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 219/415] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:15 2022] GET /identity/v3/groups/d1f14f98354f4ae68b9f0ffa20bd5df7 => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:15.783872 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4a13d-182d-41ab-92c4-d705ea3d5c28 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:15.806972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341ca12-914a-4fe3-8b2f-963534b10948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:15.807688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341ca12-914a-4fe3-8b2f-963534b10948 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:15.807969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341ca12-914a-4fe3-8b2f-963534b10948 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:15.808244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341ca12-914a-4fe3-8b2f-963534b10948 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:15.820321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341ca12-914a-4fe3-8b2f-963534b10948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2341ca12-914a-4fe3-8b2f-963534b10948 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:15.825411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:15.826897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:15.827701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 197/416] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:15.833553 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341ca12-914a-4fe3-8b2f-963534b10948 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:15.902515 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4a13d-182d-41ab-92c4-d705ea3d5c28 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:15.943015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ee08d-db0b-47f1-a72f-9228d28b9494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:15.944058 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ee08d-db0b-47f1-a72f-9228d28b9494 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:15.944550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ee08d-db0b-47f1-a72f-9228d28b9494 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:15.945116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ee08d-db0b-47f1-a72f-9228d28b9494 None admin] PATH_INFO: `/v3/projects/3c0f4c0f88fe4deb812ff64ab95ac12c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:15.947864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341ca12-914a-4fe3-8b2f-963534b10948 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:15.948346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ee08d-db0b-47f1-a72f-9228d28b9494 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0f4c0f88fe4deb812ff64ab95ac12c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:15.950103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ee08d-db0b-47f1-a72f-9228d28b9494 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:15.952565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 220/417] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:15 2022] GET /identity/v3/projects/3c0f4c0f88fe4deb812ff64ab95ac12c => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:15.958824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ee08d-db0b-47f1-a72f-9228d28b9494 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:15.985449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247e2a0-9327-4a7b-8142-b792d0344d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:15.985989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247e2a0-9327-4a7b-8142-b792d0344d04 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:15.986274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247e2a0-9327-4a7b-8142-b792d0344d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:15.986552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247e2a0-9327-4a7b-8142-b792d0344d04 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:15.987277 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247e2a0-9327-4a7b-8142-b792d0344d04 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:15.987631 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247e2a0-9327-4a7b-8142-b792d0344d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:15.989141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247e2a0-9327-4a7b-8142-b792d0344d04 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:15.994634 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:16.005091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 198/418] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:20:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:16.008955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247e2a0-9327-4a7b-8142-b792d0344d04 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:16.042718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:16.129890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247e2a0-9327-4a7b-8142-b792d0344d04 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:16.171457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adbf40-8a27-410a-ac9c-0be56636c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:16.172322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adbf40-8a27-410a-ac9c-0be56636c325 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:16.172605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adbf40-8a27-410a-ac9c-0be56636c325 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:16.172941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adbf40-8a27-410a-ac9c-0be56636c325 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:16.211434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ee08d-db0b-47f1-a72f-9228d28b9494 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:16.250912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:16.254084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adbf40-8a27-410a-ac9c-0be56636c325 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:16.256992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adbf40-8a27-410a-ac9c-0be56636c325 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:16.283479 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7911c-3f14-47dc-bcc6-5fe6f7d14833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:16.284589 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7911c-3f14-47dc-bcc6-5fe6f7d14833 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:16.285078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7911c-3f14-47dc-bcc6-5fe6f7d14833 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:16.285543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7911c-3f14-47dc-bcc6-5fe6f7d14833 None admin] PATH_INFO: `/v3/projects/3c0f4c0f88fe4deb812ff64ab95ac12c/groups/d1f14f98354f4ae68b9f0ffa20bd5df7/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:16.287771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7911c-3f14-47dc-bcc6-5fe6f7d14833 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0f4c0f88fe4deb812ff64ab95ac12c, group_id=d1f14f98354f4ae68b9f0ffa20bd5df7, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:16.289512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7911c-3f14-47dc-bcc6-5fe6f7d14833 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:16.306419 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 221/419] 10.222.0.15 () {58 vars in 1442 bytes} [Sat Aug 6 01:20:15 2022] PUT /identity/v3/projects/3c0f4c0f88fe4deb812ff64ab95ac12c/groups/d1f14f98354f4ae68b9f0ffa20bd5df7/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:20:16.308150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf821b1-f76d-4603-bd95-207fdfc975bd None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:16.308698 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf821b1-f76d-4603-bd95-207fdfc975bd None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:16.309348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf821b1-f76d-4603-bd95-207fdfc975bd None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:16.312070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 222/420] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:16.319024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95853c69-d47f-419d-8e05-b3d91266fbf8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:16.319024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95853c69-d47f-419d-8e05-b3d91266fbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:16.319024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95853c69-d47f-419d-8e05-b3d91266fbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:16.367675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-95853c69-d47f-419d-8e05-b3d91266fbf8 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:16.367675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-95853c69-d47f-419d-8e05-b3d91266fbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:16.378789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 199/421] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:20:16.386026 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adbf40-8a27-410a-ac9c-0be56636c325 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:16.516526 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adbf40-8a27-410a-ac9c-0be56636c325 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:16.521239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:16.558244 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 223/422] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:16.562309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba29c6-0f7a-42c5-b889-1f670b129b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:16.562959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba29c6-0f7a-42c5-b889-1f670b129b2d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:16.563242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba29c6-0f7a-42c5-b889-1f670b129b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:16.563516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba29c6-0f7a-42c5-b889-1f670b129b2d None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:16.565130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba29c6-0f7a-42c5-b889-1f670b129b2d None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:16.566566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba29c6-0f7a-42c5-b889-1f670b129b2d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:16.568219 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 200/423] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:16 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:16.573918 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95853c69-d47f-419d-8e05-b3d91266fbf8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:16.580718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba29c6-0f7a-42c5-b889-1f670b129b2d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:16.626161 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:16.753630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95853c69-d47f-419d-8e05-b3d91266fbf8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:16.758334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba29c6-0f7a-42c5-b889-1f670b129b2d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:16.794951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71061f-abcd-455a-a320-0e6d72ede4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:16.795726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71061f-abcd-455a-a320-0e6d72ede4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:16.796014 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71061f-abcd-455a-a320-0e6d72ede4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:16.796325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71061f-abcd-455a-a320-0e6d72ede4a3 None admin] PATH_INFO: `/v3/groups/c2bd198a952645c090e18434714d16bd` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:16.798123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71061f-abcd-455a-a320-0e6d72ede4a3 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bd198a952645c090e18434714d16bd)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:16.799568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71061f-abcd-455a-a320-0e6d72ede4a3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:16.801491 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 224/424] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:16 2022] GET /identity/v3/groups/c2bd198a952645c090e18434714d16bd => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:16.809124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71061f-abcd-455a-a320-0e6d72ede4a3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:16.834744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0556f6-4ddb-4915-b57b-604d052047de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:16.835437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0556f6-4ddb-4915-b57b-604d052047de None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:16.835725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0556f6-4ddb-4915-b57b-604d052047de None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:16.835997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0556f6-4ddb-4915-b57b-604d052047de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:16.854793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0556f6-4ddb-4915-b57b-604d052047de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-6e0556f6-4ddb-4915-b57b-604d052047de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:16.862332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:16.863223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:16.864027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 201/425] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:20:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:16.869619 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0556f6-4ddb-4915-b57b-604d052047de None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:16.924744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:16.993613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:17.000633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71061f-abcd-455a-a320-0e6d72ede4a3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:17.046493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0494d-cefd-439c-92e7-a729ae22b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:17.047030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0494d-cefd-439c-92e7-a729ae22b496 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:17.047315 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0494d-cefd-439c-92e7-a729ae22b496 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:17.047585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0494d-cefd-439c-92e7-a729ae22b496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:17.048387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0494d-cefd-439c-92e7-a729ae22b496 None admin] RBAC: Adding query filter params (group.id=c2bd198a952645c090e18434714d16bd, role.id=102380322b574754b40ec23fe0394401, scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:17.048697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0494d-cefd-439c-92e7-a729ae22b496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:17.050170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0494d-cefd-439c-92e7-a729ae22b496 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:17.054699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0556f6-4ddb-4915-b57b-604d052047de None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:17.056429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 225/426] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 6 01:20:16 2022] GET /identity/v3/role_assignments?group.id=c2bd198a952645c090e18434714d16bd&scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e&role.id=102380322b574754b40ec23fe0394401 => generated 611 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:17.109866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49931a-0d8f-4bb8-9285-90a032a63583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:17.110528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49931a-0d8f-4bb8-9285-90a032a63583 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:17.110814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49931a-0d8f-4bb8-9285-90a032a63583 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:17.111098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49931a-0d8f-4bb8-9285-90a032a63583 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:17.111865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49931a-0d8f-4bb8-9285-90a032a63583 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:17.112178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49931a-0d8f-4bb8-9285-90a032a63583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:17.113648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49931a-0d8f-4bb8-9285-90a032a63583 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:17.128213 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 202/427] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:17.133953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0494d-cefd-439c-92e7-a729ae22b496 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:17.298950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0494d-cefd-439c-92e7-a729ae22b496 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:17.342654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a0592-23d1-4931-a72b-4e9d9819ac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:17.343284 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a0592-23d1-4931-a72b-4e9d9819ac59 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:17.343572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a0592-23d1-4931-a72b-4e9d9819ac59 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:17.343851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a0592-23d1-4931-a72b-4e9d9819ac59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:17.401299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:17.442156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a0592-23d1-4931-a72b-4e9d9819ac59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:17.443600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a0592-23d1-4931-a72b-4e9d9819ac59 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:17.559670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 226/428] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:17.565808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49931a-0d8f-4bb8-9285-90a032a63583 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:17.656409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be73249-8e9b-4455-a084-76b4113740c7 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:17.656703 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be73249-8e9b-4455-a084-76b4113740c7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:17.657226 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be73249-8e9b-4455-a084-76b4113740c7 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:17.658672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 227/429] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:17.664859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020b2eb-7352-4768-b231-abbe1109d616 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:17.665222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020b2eb-7352-4768-b231-abbe1109d616 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:17.665493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020b2eb-7352-4768-b231-abbe1109d616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:17.672855 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:17.688433 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49931a-0d8f-4bb8-9285-90a032a63583 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:17.688778 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d020b2eb-7352-4768-b231-abbe1109d616 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:17.690002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d020b2eb-7352-4768-b231-abbe1109d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:17.730214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7980b-72ff-4d4b-9af7-12f93f5dc2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:17.731624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7980b-72ff-4d4b-9af7-12f93f5dc2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:17.732618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7980b-72ff-4d4b-9af7-12f93f5dc2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:17.733092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7980b-72ff-4d4b-9af7-12f93f5dc2f6 None admin] PATH_INFO: `/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:17.735099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7980b-72ff-4d4b-9af7-12f93f5dc2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=5ec256f5efb04aabbbfa6845545a0e2e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:17.737466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7980b-72ff-4d4b-9af7-12f93f5dc2f6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:17.740671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 203/430] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:17 2022] GET /identity/v3/projects/5ec256f5efb04aabbbfa6845545a0e2e => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:17.745740 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7980b-72ff-4d4b-9af7-12f93f5dc2f6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:17.785170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:17.800934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 228/431] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:17.833342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020b2eb-7352-4768-b231-abbe1109d616 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:17.886108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7980b-72ff-4d4b-9af7-12f93f5dc2f6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:17.928824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72af7ab-7c7e-4449-8fe5-a577c354aff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:17.929478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72af7ab-7c7e-4449-8fe5-a577c354aff7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:17.929766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72af7ab-7c7e-4449-8fe5-a577c354aff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:17.930040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72af7ab-7c7e-4449-8fe5-a577c354aff7 None admin] PATH_INFO: `/v3/groups/c2bd198a952645c090e18434714d16bd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:17.932096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72af7ab-7c7e-4449-8fe5-a577c354aff7 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bd198a952645c090e18434714d16bd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:17.933578 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72af7ab-7c7e-4449-8fe5-a577c354aff7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:17.936174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 204/432] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:17 2022] GET /identity/v3/groups/c2bd198a952645c090e18434714d16bd => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:17.941986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72af7ab-7c7e-4449-8fe5-a577c354aff7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:17.969332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020b2eb-7352-4768-b231-abbe1109d616 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:17.976883 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:18.021231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adf430-0c94-4dd5-a262-8de13121b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:18.021890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adf430-0c94-4dd5-a262-8de13121b719 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:18.022171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adf430-0c94-4dd5-a262-8de13121b719 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:18.022446 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adf430-0c94-4dd5-a262-8de13121b719 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:18.037264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adf430-0c94-4dd5-a262-8de13121b719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e8adf430-0c94-4dd5-a262-8de13121b719 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:18.045840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:18.046773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:18.052308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 229/433] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:18.055777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adf430-0c94-4dd5-a262-8de13121b719 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:18.083882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72af7ab-7c7e-4449-8fe5-a577c354aff7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:18.125003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:18.129755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eea03e-45e5-4e25-8223-4b6aa7580ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:18.130478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eea03e-45e5-4e25-8223-4b6aa7580ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:18.130757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eea03e-45e5-4e25-8223-4b6aa7580ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:18.131030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eea03e-45e5-4e25-8223-4b6aa7580ab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:18.131829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eea03e-45e5-4e25-8223-4b6aa7580ab4 None admin] RBAC: Adding query filter params (group.id=c2bd198a952645c090e18434714d16bd, role.id=30697c5bde894ea6b08f513a33e8b9ac, scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:18.132137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eea03e-45e5-4e25-8223-4b6aa7580ab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:18.133682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eea03e-45e5-4e25-8223-4b6aa7580ab4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:18.141430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 205/434] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 6 01:20:17 2022] GET /identity/v3/role_assignments?group.id=c2bd198a952645c090e18434714d16bd&scope.project.id=5ec256f5efb04aabbbfa6845545a0e2e&role.id=30697c5bde894ea6b08f513a33e8b9ac => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:18.142920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e39337-ee85-49b8-903c-481600aba441 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:18.143204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e39337-ee85-49b8-903c-481600aba441 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:18.143477 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e39337-ee85-49b8-903c-481600aba441 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:18.144871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 206/435] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:18.150763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a08ae4-5c38-4231-a735-498ee622528b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:18.150975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a08ae4-5c38-4231-a735-498ee622528b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:18.151235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a08ae4-5c38-4231-a735-498ee622528b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:18.178278 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-84a08ae4-5c38-4231-a735-498ee622528b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:18.179511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-84a08ae4-5c38-4231-a735-498ee622528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:18.192827 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adf430-0c94-4dd5-a262-8de13121b719 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:18.251142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9f67a-a639-4187-af87-d20c5d419569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:18.251142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9f67a-a639-4187-af87-d20c5d419569 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:18.251142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9f67a-a639-4187-af87-d20c5d419569 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:18.251142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9f67a-a639-4187-af87-d20c5d419569 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:18.251554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9f67a-a639-4187-af87-d20c5d419569 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:18.251554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9f67a-a639-4187-af87-d20c5d419569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:18.251554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9f67a-a639-4187-af87-d20c5d419569 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:18.264355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 230/436] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:20:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:18.265669 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9f67a-a639-4187-af87-d20c5d419569 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:18.270823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 207/437] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:18.297638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a08ae4-5c38-4231-a735-498ee622528b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:18.322467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:18.385507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9f67a-a639-4187-af87-d20c5d419569 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:18.404524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:18.423387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a08ae4-5c38-4231-a735-498ee622528b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:18.428535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3405e2-6a74-4a7d-bae0-dff8959563fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:18.429220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3405e2-6a74-4a7d-bae0-dff8959563fb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:18.429503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3405e2-6a74-4a7d-bae0-dff8959563fb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:18.429773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3405e2-6a74-4a7d-bae0-dff8959563fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:18.470612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b371fab-8c67-4954-88ca-289ece7f7c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:18.471255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b371fab-8c67-4954-88ca-289ece7f7c98 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:18.471683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b371fab-8c67-4954-88ca-289ece7f7c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:18.471965 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b371fab-8c67-4954-88ca-289ece7f7c98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:18.485424 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b371fab-8c67-4954-88ca-289ece7f7c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5b371fab-8c67-4954-88ca-289ece7f7c98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:18.493130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:18.494032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:18.494846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 208/438] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:20:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:18.501911 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b371fab-8c67-4954-88ca-289ece7f7c98 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:18.519716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3405e2-6a74-4a7d-bae0-dff8959563fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:18.521470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3405e2-6a74-4a7d-bae0-dff8959563fb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:18.608698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:18.635108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b371fab-8c67-4954-88ca-289ece7f7c98 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:18.647751 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 231/439] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:18.653095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3405e2-6a74-4a7d-bae0-dff8959563fb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:18.670707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:18.676663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437ae7-ed46-4834-ba21-901505d3c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:18.677385 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437ae7-ed46-4834-ba21-901505d3c60e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:18.677664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437ae7-ed46-4834-ba21-901505d3c60e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:18.677932 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437ae7-ed46-4834-ba21-901505d3c60e None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:18.678646 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68437ae7-ed46-4834-ba21-901505d3c60e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:18.678951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68437ae7-ed46-4834-ba21-901505d3c60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:18.680311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68437ae7-ed46-4834-ba21-901505d3c60e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:18.689434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 209/440] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:18.690618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8516b2-0f3d-473b-908c-74a16dc43eca None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:18.690901 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8516b2-0f3d-473b-908c-74a16dc43eca None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:18.691176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8516b2-0f3d-473b-908c-74a16dc43eca None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:18.692587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 210/441] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:18.694370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8516b2-0f3d-473b-908c-74a16dc43eca None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:18.759543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3405e2-6a74-4a7d-bae0-dff8959563fb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:18.793318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6020c9-6f78-46e6-9db3-66c56786f4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:18.793950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6020c9-6f78-46e6-9db3-66c56786f4fd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:18.794291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6020c9-6f78-46e6-9db3-66c56786f4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:18.794598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6020c9-6f78-46e6-9db3-66c56786f4fd None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:18.794775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8516b2-0f3d-473b-908c-74a16dc43eca None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:18.795743 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6020c9-6f78-46e6-9db3-66c56786f4fd None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:18.797216 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6020c9-6f78-46e6-9db3-66c56786f4fd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:18.799015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 232/442] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:18 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:18.800006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d41235-370f-4909-9466-d5637ffed8d1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:18.800302 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d41235-370f-4909-9466-d5637ffed8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:18.800581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d41235-370f-4909-9466-d5637ffed8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:18.818124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b1d41235-370f-4909-9466-d5637ffed8d1 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:18.819313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b1d41235-370f-4909-9466-d5637ffed8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:18.830220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fe0cb-6ed2-4a75-b78d-d3518dcb3e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:18.830831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fe0cb-6ed2-4a75-b78d-d3518dcb3e72 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:18.831109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fe0cb-6ed2-4a75-b78d-d3518dcb3e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:18.831382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fe0cb-6ed2-4a75-b78d-d3518dcb3e72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:18.844173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:18.886936 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 233/443] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:18.887690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d41235-370f-4909-9466-d5637ffed8d1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:18.901524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fe0cb-6ed2-4a75-b78d-d3518dcb3e72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:18.903006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fe0cb-6ed2-4a75-b78d-d3518dcb3e72 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:18.907732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:18.993836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d41235-370f-4909-9466-d5637ffed8d1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:19.001303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 211/444] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:20:19.001303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fe0cb-6ed2-4a75-b78d-d3518dcb3e72 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:19.034883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da40085-68cd-4390-ae8a-36a2049f5c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:19.035526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da40085-68cd-4390-ae8a-36a2049f5c14 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:19.035810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da40085-68cd-4390-ae8a-36a2049f5c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:19.036084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da40085-68cd-4390-ae8a-36a2049f5c14 None admin] PATH_INFO: `/v3/groups/c2bd198a952645c090e18434714d16bd` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:19.037263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da40085-68cd-4390-ae8a-36a2049f5c14 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bd198a952645c090e18434714d16bd)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:19.038703 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da40085-68cd-4390-ae8a-36a2049f5c14 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:19.040280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 234/445] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:18 2022] GET /identity/v3/groups/c2bd198a952645c090e18434714d16bd => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:19.041060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da40085-68cd-4390-ae8a-36a2049f5c14 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:19.045828 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:19.103477 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fe0cb-6ed2-4a75-b78d-d3518dcb3e72 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:19.125540 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:19.137911 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a221ffd-6498-452e-86fc-78ae355bdf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:19.139051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a221ffd-6498-452e-86fc-78ae355bdf35 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:19.139404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a221ffd-6498-452e-86fc-78ae355bdf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:19.139936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a221ffd-6498-452e-86fc-78ae355bdf35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:19.145001 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da40085-68cd-4390-ae8a-36a2049f5c14 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:19.149915 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a221ffd-6498-452e-86fc-78ae355bdf35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-0a221ffd-6498-452e-86fc-78ae355bdf35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:19.155156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:19.156138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:19.156990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 212/446] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:20:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:19.157645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a221ffd-6498-452e-86fc-78ae355bdf35 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:19.185220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec69b8d-d946-4b05-b8bf-6a6cdd6038a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:19.185937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec69b8d-d946-4b05-b8bf-6a6cdd6038a2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:19.186282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec69b8d-d946-4b05-b8bf-6a6cdd6038a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:19.186640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec69b8d-d946-4b05-b8bf-6a6cdd6038a2 None admin] PATH_INFO: `/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:19.187830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec69b8d-d946-4b05-b8bf-6a6cdd6038a2 None admin] RBAC: Authorizing `identity:get_project(project_id=331a641c5a1a4c5b8b3d8a1f6c5fa695)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:19.189367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec69b8d-d946-4b05-b8bf-6a6cdd6038a2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:19.190989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 235/447] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:19 2022] GET /identity/v3/projects/331a641c5a1a4c5b8b3d8a1f6c5fa695 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:19.191727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec69b8d-d946-4b05-b8bf-6a6cdd6038a2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:19.256267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a221ffd-6498-452e-86fc-78ae355bdf35 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:19.257807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:19.289599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec69b8d-d946-4b05-b8bf-6a6cdd6038a2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:19.291025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d163-b245-4f3d-872d-604c676f8119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:19.291637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d163-b245-4f3d-872d-604c676f8119 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:19.291928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d163-b245-4f3d-872d-604c676f8119 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:19.292202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d163-b245-4f3d-872d-604c676f8119 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:19.293026 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7d163-b245-4f3d-872d-604c676f8119 None admin] RBAC: Adding query filter params (group.id=c2bd198a952645c090e18434714d16bd, role.id=102380322b574754b40ec23fe0394401, scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:19.293343 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7d163-b245-4f3d-872d-604c676f8119 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:19.295352 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7d163-b245-4f3d-872d-604c676f8119 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:19.301068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 213/448] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 6 01:20:19 2022] GET /identity/v3/role_assignments?group.id=c2bd198a952645c090e18434714d16bd&scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695&role.id=102380322b574754b40ec23fe0394401 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:19.301844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d163-b245-4f3d-872d-604c676f8119 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:19.326717 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec91c1-04ba-45f6-8782-899a50b0ba18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:19.327359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec91c1-04ba-45f6-8782-899a50b0ba18 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:19.327643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec91c1-04ba-45f6-8782-899a50b0ba18 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:19.327917 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec91c1-04ba-45f6-8782-899a50b0ba18 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:19.328659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec91c1-04ba-45f6-8782-899a50b0ba18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:19.328999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec91c1-04ba-45f6-8782-899a50b0ba18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:19.330410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec91c1-04ba-45f6-8782-899a50b0ba18 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:19.341753 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 236/449] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:19.347080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec91c1-04ba-45f6-8782-899a50b0ba18 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:19.367020 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:19.439306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d163-b245-4f3d-872d-604c676f8119 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:19.469408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec91c1-04ba-45f6-8782-899a50b0ba18 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:19.477764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16d8df-254b-4994-9609-706545d4ded9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:19.478159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16d8df-254b-4994-9609-706545d4ded9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:19.478441 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16d8df-254b-4994-9609-706545d4ded9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:19.478717 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16d8df-254b-4994-9609-706545d4ded9 None admin] PATH_INFO: `/v3/groups/c2bd198a952645c090e18434714d16bd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:19.481457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16d8df-254b-4994-9609-706545d4ded9 None admin] RBAC: Authorizing `identity:get_group(group_id=c2bd198a952645c090e18434714d16bd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:19.483043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16d8df-254b-4994-9609-706545d4ded9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:19.484638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 214/450] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:19 2022] GET /identity/v3/groups/c2bd198a952645c090e18434714d16bd => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:19.490700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16d8df-254b-4994-9609-706545d4ded9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:19.508210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0e7a1-a7fd-430c-bc64-77aaccf3b2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:19.508837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0e7a1-a7fd-430c-bc64-77aaccf3b2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:19.509165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0e7a1-a7fd-430c-bc64-77aaccf3b2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:19.509443 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0e7a1-a7fd-430c-bc64-77aaccf3b2f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:19.527892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:19.598572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0e7a1-a7fd-430c-bc64-77aaccf3b2f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:19.599117 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0e7a1-a7fd-430c-bc64-77aaccf3b2f2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:19.606975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16d8df-254b-4994-9609-706545d4ded9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:19.614744 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:19.645804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b0da4-c1d3-4e09-8985-a17f5a5e6825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:19.646460 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0da4-c1d3-4e09-8985-a17f5a5e6825 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:19.646710 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0da4-c1d3-4e09-8985-a17f5a5e6825 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:19.646989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0da4-c1d3-4e09-8985-a17f5a5e6825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:19.647791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b0da4-c1d3-4e09-8985-a17f5a5e6825 None admin] RBAC: Adding query filter params (group.id=c2bd198a952645c090e18434714d16bd, role.id=30697c5bde894ea6b08f513a33e8b9ac, scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:19.648106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b0da4-c1d3-4e09-8985-a17f5a5e6825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:19.650433 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b0da4-c1d3-4e09-8985-a17f5a5e6825 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:19.658728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 215/451] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 6 01:20:19 2022] GET /identity/v3/role_assignments?group.id=c2bd198a952645c090e18434714d16bd&scope.project.id=331a641c5a1a4c5b8b3d8a1f6c5fa695&role.id=30697c5bde894ea6b08f513a33e8b9ac => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:19.720247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 237/452] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:20:19.725917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b0da4-c1d3-4e09-8985-a17f5a5e6825 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:19.827817 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:19.831821 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b0da4-c1d3-4e09-8985-a17f5a5e6825 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:19.866876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04724fb5-1ab0-433b-875b-444cf772cfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:19.867618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04724fb5-1ab0-433b-875b-444cf772cfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:19.867888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04724fb5-1ab0-433b-875b-444cf772cfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:19.868170 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04724fb5-1ab0-433b-875b-444cf772cfd8 None admin] PATH_INFO: `/v3/projects/3c0f4c0f88fe4deb812ff64ab95ac12c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:19.869380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04724fb5-1ab0-433b-875b-444cf772cfd8 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0f4c0f88fe4deb812ff64ab95ac12c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:19.870825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04724fb5-1ab0-433b-875b-444cf772cfd8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:19.873401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 216/453] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:20:19 2022] GET /identity/v3/projects/3c0f4c0f88fe4deb812ff64ab95ac12c => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:19.879157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0e7a1-a7fd-430c-bc64-77aaccf3b2f2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:19.980296 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0e7a1-a7fd-430c-bc64-77aaccf3b2f2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:19.994877 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:20.017262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514077b4-3f68-451d-82b0-103e01e32503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:20.017901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514077b4-3f68-451d-82b0-103e01e32503 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:20.018224 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514077b4-3f68-451d-82b0-103e01e32503 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:20.018488 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514077b4-3f68-451d-82b0-103e01e32503 None admin] PATH_INFO: `/v3/groups/d1f14f98354f4ae68b9f0ffa20bd5df7` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:20.019621 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514077b4-3f68-451d-82b0-103e01e32503 None admin] RBAC: Authorizing `identity:get_group(group_id=d1f14f98354f4ae68b9f0ffa20bd5df7)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:20.021089 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514077b4-3f68-451d-82b0-103e01e32503 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:20.022646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 238/454] 10.222.0.15 () {56 vars in 1180 bytes} [Sat Aug 6 01:20:19 2022] GET /identity/v3/groups/d1f14f98354f4ae68b9f0ffa20bd5df7 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:20.028473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04724fb5-1ab0-433b-875b-444cf772cfd8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:20.128240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04724fb5-1ab0-433b-875b-444cf772cfd8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:20.161035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecdb54-8b55-4bd2-841c-99282b69a775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:20.161668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecdb54-8b55-4bd2-841c-99282b69a775 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:20.161956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecdb54-8b55-4bd2-841c-99282b69a775 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:20.162237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecdb54-8b55-4bd2-841c-99282b69a775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:20.163029 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecdb54-8b55-4bd2-841c-99282b69a775 None admin] RBAC: Adding query filter params (group.id=d1f14f98354f4ae68b9f0ffa20bd5df7, role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=3c0f4c0f88fe4deb812ff64ab95ac12c) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:20.163346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecdb54-8b55-4bd2-841c-99282b69a775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:20.164769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecdb54-8b55-4bd2-841c-99282b69a775 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:20.170718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 217/455] 10.222.0.15 () {56 vars in 1376 bytes} [Sat Aug 6 01:20:20 2022] GET /identity/v3/role_assignments?group.id=d1f14f98354f4ae68b9f0ffa20bd5df7&scope.project.id=3c0f4c0f88fe4deb812ff64ab95ac12c&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:22.824297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980ef3a-412b-4c7c-9967-ca017bcfc4d8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:22.824802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980ef3a-412b-4c7c-9967-ca017bcfc4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:22.824802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980ef3a-412b-4c7c-9967-ca017bcfc4d8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:22.826960 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 239/456] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:22.831247 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563e0cd-3f43-41d2-b18c-038a0ba67ece None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:22.831685 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e2f42-9be1-4442-a862-292f45083efc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:22.831949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e2f42-9be1-4442-a862-292f45083efc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:22.832208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563e0cd-3f43-41d2-b18c-038a0ba67ece None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:22.832493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563e0cd-3f43-41d2-b18c-038a0ba67ece None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:22.832852 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e2f42-9be1-4442-a862-292f45083efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:22.834145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 218/457] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:22.838879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c41de-f5de-4f83-b502-9e220993a455 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:22.839163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c41de-f5de-4f83-b502-9e220993a455 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:22.839440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c41de-f5de-4f83-b502-9e220993a455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:22.854331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0f6e2f42-9be1-4442-a862-292f45083efc None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:22.855754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0f6e2f42-9be1-4442-a862-292f45083efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:22.863553 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7a7c41de-f5de-4f83-b502-9e220993a455 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:22.865062 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7a7c41de-f5de-4f83-b502-9e220993a455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:22.906329 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:22.927862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 240/458] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:22.929538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb15dc-394a-48a3-b3bd-16a243123d0a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:22.930032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb15dc-394a-48a3-b3bd-16a243123d0a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:22.930530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb15dc-394a-48a3-b3bd-16a243123d0a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:22.931990 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 241/459] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:22.946735 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6445e-cf34-43c0-8c7f-2d26ca1950f2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:22.947335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6445e-cf34-43c0-8c7f-2d26ca1950f2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:22.947824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6445e-cf34-43c0-8c7f-2d26ca1950f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:22.961324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 219/460] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:22.962419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c41de-f5de-4f83-b502-9e220993a455 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:22.992500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d7b6445e-cf34-43c0-8c7f-2d26ca1950f2 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:22.994005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d7b6445e-cf34-43c0-8c7f-2d26ca1950f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:23.076878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c41de-f5de-4f83-b502-9e220993a455 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:23.092926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 242/461] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:23.092926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6445e-cf34-43c0-8c7f-2d26ca1950f2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:23.136994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:23.137686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37187e06-5f07-416d-a7ba-6b1cc0d7a910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:23.139268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37187e06-5f07-416d-a7ba-6b1cc0d7a910 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:23.140005 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37187e06-5f07-416d-a7ba-6b1cc0d7a910 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:23.140554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37187e06-5f07-416d-a7ba-6b1cc0d7a910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:23.162183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37187e06-5f07-416d-a7ba-6b1cc0d7a910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:23.164041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37187e06-5f07-416d-a7ba-6b1cc0d7a910 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-37187e06-5f07-416d-a7ba-6b1cc0d7a910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:23.182387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:23.183312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:23.184178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:23.184178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:23.184178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:23.184178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:23.186846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 220/462] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:23.188569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37187e06-5f07-416d-a7ba-6b1cc0d7a910 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:23.205323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:23.212478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6445e-cf34-43c0-8c7f-2d26ca1950f2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:23.249578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188824ab-e526-499a-8a8f-1d102d3bc4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:23.250216 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188824ab-e526-499a-8a8f-1d102d3bc4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:23.250496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188824ab-e526-499a-8a8f-1d102d3bc4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:23.250766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188824ab-e526-499a-8a8f-1d102d3bc4b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:23.261293 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188824ab-e526-499a-8a8f-1d102d3bc4b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:23.262757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188824ab-e526-499a-8a8f-1d102d3bc4b0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-188824ab-e526-499a-8a8f-1d102d3bc4b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:23.280091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:23.280995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:23.286777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:23.286777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:23.286777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:23.286777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:23.286777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 243/463] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:23.286777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84057a3-38dd-4de4-a8b7-28ff041c84b9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:23.286777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84057a3-38dd-4de4-a8b7-28ff041c84b9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:23.286777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84057a3-38dd-4de4-a8b7-28ff041c84b9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:23.286777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 244/464] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:23.287265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84057a3-38dd-4de4-a8b7-28ff041c84b9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:23.307093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37187e06-5f07-416d-a7ba-6b1cc0d7a910 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:23.346830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017719c1-631e-4c97-a3b3-5b29720c56ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:23.347472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017719c1-631e-4c97-a3b3-5b29720c56ba None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:23.347753 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017719c1-631e-4c97-a3b3-5b29720c56ba None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:23.348029 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017719c1-631e-4c97-a3b3-5b29720c56ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:23.358802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017719c1-631e-4c97-a3b3-5b29720c56ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:23.362359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017719c1-631e-4c97-a3b3-5b29720c56ba None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-017719c1-631e-4c97-a3b3-5b29720c56ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:23.379694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:23.380577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:23.381480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:23.381480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:23.381480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:23.381480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:23.381480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 221/465] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:23.382155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017719c1-631e-4c97-a3b3-5b29720c56ba None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:23.395780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:23.406694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84057a3-38dd-4de4-a8b7-28ff041c84b9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:23.445298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ce8f9-482a-42f3-8ffa-fa5b36780a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:23.445912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ce8f9-482a-42f3-8ffa-fa5b36780a72 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:23.446196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ce8f9-482a-42f3-8ffa-fa5b36780a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:23.446466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ce8f9-482a-42f3-8ffa-fa5b36780a72 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:23.447167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ce8f9-482a-42f3-8ffa-fa5b36780a72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:23.447489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ce8f9-482a-42f3-8ffa-fa5b36780a72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:23.447729 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:23.448809 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ce8f9-482a-42f3-8ffa-fa5b36780a72 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:23.461197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 245/466] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:23.462378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249845-3a54-4f12-9108-4257a00c763c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:23.462662 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249845-3a54-4f12-9108-4257a00c763c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:23.462934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249845-3a54-4f12-9108-4257a00c763c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:23.482457 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-65249845-3a54-4f12-9108-4257a00c763c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:23.483844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-65249845-3a54-4f12-9108-4257a00c763c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:23.496566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017719c1-631e-4c97-a3b3-5b29720c56ba None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:23.530998 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179b90a-e4dd-465f-8fd9-15cb0256584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:23.531611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179b90a-e4dd-465f-8fd9-15cb0256584b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:23.531893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179b90a-e4dd-465f-8fd9-15cb0256584b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:23.532170 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179b90a-e4dd-465f-8fd9-15cb0256584b None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:23.532862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179b90a-e4dd-465f-8fd9-15cb0256584b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:23.533195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179b90a-e4dd-465f-8fd9-15cb0256584b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:23.534557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179b90a-e4dd-465f-8fd9-15cb0256584b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:23.552864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 222/467] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:23.553527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179b90a-e4dd-465f-8fd9-15cb0256584b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:23.569301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 246/468] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:23.569301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65249845-3a54-4f12-9108-4257a00c763c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:23.661617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:23.664276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179b90a-e4dd-465f-8fd9-15cb0256584b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:23.680613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65249845-3a54-4f12-9108-4257a00c763c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:23.689980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:23.702588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bad8cd-0ec9-46b2-848e-438bb2278cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:23.703216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bad8cd-0ec9-46b2-848e-438bb2278cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:23.703502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bad8cd-0ec9-46b2-848e-438bb2278cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:23.703781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bad8cd-0ec9-46b2-848e-438bb2278cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:23.704484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bad8cd-0ec9-46b2-848e-438bb2278cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:23.704796 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bad8cd-0ec9-46b2-848e-438bb2278cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:23.706217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bad8cd-0ec9-46b2-848e-438bb2278cf7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:23.722458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 223/469] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:23.722458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bad8cd-0ec9-46b2-848e-438bb2278cf7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:23.724871 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c6170-440a-474e-8d41-e8d480422255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:23.725539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c6170-440a-474e-8d41-e8d480422255 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:23.725825 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c6170-440a-474e-8d41-e8d480422255 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:23.726864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c6170-440a-474e-8d41-e8d480422255 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:23.726864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c6170-440a-474e-8d41-e8d480422255 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:23.728366 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c6170-440a-474e-8d41-e8d480422255 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:23.756946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 247/470] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:20:23 2022] POST /identity/v3/users => generated 248 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:23.756946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c6170-440a-474e-8d41-e8d480422255 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:23.865091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bad8cd-0ec9-46b2-848e-438bb2278cf7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:23.889850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c6170-440a-474e-8d41-e8d480422255 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:23.910644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762028e-18a0-4c84-9192-5064b5fefdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:23.911366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762028e-18a0-4c84-9192-5064b5fefdca None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:23.911773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762028e-18a0-4c84-9192-5064b5fefdca None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:23.912056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762028e-18a0-4c84-9192-5064b5fefdca None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:23.913436 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762028e-18a0-4c84-9192-5064b5fefdca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:23.915388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762028e-18a0-4c84-9192-5064b5fefdca None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:23.929136 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990184be-8ffa-425a-ac04-84f642bc5b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:23.930121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990184be-8ffa-425a-ac04-84f642bc5b07 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:23.930502 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990184be-8ffa-425a-ac04-84f642bc5b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:23.930844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990184be-8ffa-425a-ac04-84f642bc5b07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:23.940543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:23.942195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 224/471] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:20:23 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:23.943111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762028e-18a0-4c84-9192-5064b5fefdca None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:23.953971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990184be-8ffa-425a-ac04-84f642bc5b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:23.955641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990184be-8ffa-425a-ac04-84f642bc5b07 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-990184be-8ffa-425a-ac04-84f642bc5b07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:23.978687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:23.979611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:23.980458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:23.980458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:23.980458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:23.980458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:23.980670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 248/472] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:23.986628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990184be-8ffa-425a-ac04-84f642bc5b07 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:24.000023 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:24.083283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762028e-18a0-4c84-9192-5064b5fefdca None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:24.121922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990184be-8ffa-425a-ac04-84f642bc5b07 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:24.131178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57759335-a402-4e4a-a633-31d283b59a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:24.131815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57759335-a402-4e4a-a633-31d283b59a5a None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:24.132104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57759335-a402-4e4a-a633-31d283b59a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:24.132767 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57759335-a402-4e4a-a633-31d283b59a5a None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:24.133519 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57759335-a402-4e4a-a633-31d283b59a5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:24.135494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57759335-a402-4e4a-a633-31d283b59a5a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:24.160667 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 225/473] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:20:23 2022] POST /identity/v3/users => generated 246 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:24.162661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b1f8d-a4c7-447b-ae5c-9e9bb08763db None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:24.162897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b1f8d-a4c7-447b-ae5c-9e9bb08763db None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:24.163179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b1f8d-a4c7-447b-ae5c-9e9bb08763db None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:24.164611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 226/474] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:24.171046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebcdaa-0a09-49bc-81c6-6ab496129fc1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:24.171352 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebcdaa-0a09-49bc-81c6-6ab496129fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:24.171617 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebcdaa-0a09-49bc-81c6-6ab496129fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:24.175075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c739e7-e29a-4a84-9eb8-fb94848eae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:24.176116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c739e7-e29a-4a84-9eb8-fb94848eae64 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:24.176740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c739e7-e29a-4a84-9eb8-fb94848eae64 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:24.177303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c739e7-e29a-4a84-9eb8-fb94848eae64 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:24.178556 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c739e7-e29a-4a84-9eb8-fb94848eae64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:24.180092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c739e7-e29a-4a84-9eb8-fb94848eae64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:24.181927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c739e7-e29a-4a84-9eb8-fb94848eae64 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:24.192932 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ccebcdaa-0a09-49bc-81c6-6ab496129fc1 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:24.194183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ccebcdaa-0a09-49bc-81c6-6ab496129fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:24.200234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 249/475] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:24.206834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c739e7-e29a-4a84-9eb8-fb94848eae64 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:24.265765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:24.287872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 227/476] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:24.330571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c739e7-e29a-4a84-9eb8-fb94848eae64 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:24.362361 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebcdaa-0a09-49bc-81c6-6ab496129fc1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:24.368989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5de8a-909f-4bb8-8e43-46a472c438c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:24.369900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5de8a-909f-4bb8-8e43-46a472c438c6 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:24.370374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5de8a-909f-4bb8-8e43-46a472c438c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:24.370840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5de8a-909f-4bb8-8e43-46a472c438c6 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:24.371713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5de8a-909f-4bb8-8e43-46a472c438c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:24.376954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5de8a-909f-4bb8-8e43-46a472c438c6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:24.400858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 250/477] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:20:24 2022] POST /identity/v3/users => generated 249 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:20:24.402632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:24.496614 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebcdaa-0a09-49bc-81c6-6ab496129fc1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:24.534943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bfab7-7e81-480b-a04c-a7242ef28587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:24.535644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bfab7-7e81-480b-a04c-a7242ef28587 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:24.535929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bfab7-7e81-480b-a04c-a7242ef28587 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:24.536203 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bfab7-7e81-480b-a04c-a7242ef28587 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:24.536981 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bfab7-7e81-480b-a04c-a7242ef28587 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:24.538410 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bfab7-7e81-480b-a04c-a7242ef28587 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:24.549324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.sql.core [None req-752bfab7-7e81-480b-a04c-a7242ef28587 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 06 01:20:24.549324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 06 01:20:24.549324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [parameters: {'id': 'b018e631198d49a5ababa1ed4f1af627', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 06 01:20:24.549324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80158) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-752bfab7-7e81-480b-a04c-a7242ef28587 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Aug 06 01:20:24.566683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return ref.to_dict() Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 01:20:24.567621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application yield resource Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise self.value Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application session.commit() Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 01:20:24.568527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.flush() Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application compat.raise_( Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 01:20:24.569417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 01:20:24.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 01:20:24.571131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [parameters: {'id': 'b018e631198d49a5ababa1ed4f1af627', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:24.571925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 06 01:20:24.574786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:24.577285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 228/478] 10.222.0.15 () {60 vars in 1131 bytes} [Sat Aug 6 01:20:24 2022] POST /identity/v3/roles => generated 144 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:24.580920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5de8a-909f-4bb8-8e43-46a472c438c6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:24.700678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5de8a-909f-4bb8-8e43-46a472c438c6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:24.707938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:24.741084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b04861-c7ea-4be6-87c1-75a7a438146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:24.741736 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b04861-c7ea-4be6-87c1-75a7a438146d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:24.742017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b04861-c7ea-4be6-87c1-75a7a438146d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:24.742292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b04861-c7ea-4be6-87c1-75a7a438146d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:24.754571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b04861-c7ea-4be6-87c1-75a7a438146d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-02b04861-c7ea-4be6-87c1-75a7a438146d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:24.760812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:24.763097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:24.765273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 251/479] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:20:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:24.768097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bfab7-7e81-480b-a04c-a7242ef28587 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:24.868540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:24.880167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bfab7-7e81-480b-a04c-a7242ef28587 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:24.916239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703e33e-f741-4674-883e-0a47e2bd7040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:24.917221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703e33e-f741-4674-883e-0a47e2bd7040 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:24.917718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703e33e-f741-4674-883e-0a47e2bd7040 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:24.918244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703e33e-f741-4674-883e-0a47e2bd7040 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:24.919262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703e33e-f741-4674-883e-0a47e2bd7040 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:24.919777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703e33e-f741-4674-883e-0a47e2bd7040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:24.921417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703e33e-f741-4674-883e-0a47e2bd7040 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:24.930338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 229/480] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:26.232447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2a5ef-ee9c-4f69-9c39-459d8d7169a1 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:26.233175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2a5ef-ee9c-4f69-9c39-459d8d7169a1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:26.233175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2a5ef-ee9c-4f69-9c39-459d8d7169a1 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:26.234656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 252/481] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:26.240306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05178584-feaa-4401-af7a-8b583560bef4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:26.241158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05178584-feaa-4401-af7a-8b583560bef4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:26.241647 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05178584-feaa-4401-af7a-8b583560bef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:26.260733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-05178584-feaa-4401-af7a-8b583560bef4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:26.262252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-05178584-feaa-4401-af7a-8b583560bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:26.336337 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 230/482] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:26.355505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2a5ef-ee9c-4f69-9c39-459d8d7169a1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:26.494044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2a5ef-ee9c-4f69-9c39-459d8d7169a1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:26.542492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d50ba9-03ca-4838-9e7a-ad6d59b6d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:26.543146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d50ba9-03ca-4838-9e7a-ad6d59b6d130 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:26.543437 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d50ba9-03ca-4838-9e7a-ad6d59b6d130 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:26.543710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d50ba9-03ca-4838-9e7a-ad6d59b6d130 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:26.559012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d50ba9-03ca-4838-9e7a-ad6d59b6d130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b6d50ba9-03ca-4838-9e7a-ad6d59b6d130 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:26.564142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:26.565042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:26.565928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 253/483] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:26.571554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05178584-feaa-4401-af7a-8b583560bef4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:26.614376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382217ae-07c0-4b5d-8515-54d143bc07e3 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:26.614678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382217ae-07c0-4b5d-8515-54d143bc07e3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:26.614928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382217ae-07c0-4b5d-8515-54d143bc07e3 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:26.616267 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 254/484] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:20:26.630212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b021571-25c7-44ba-a20a-7e2159e53ade None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:26.630526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b021571-25c7-44ba-a20a-7e2159e53ade None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:26.630760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b021571-25c7-44ba-a20a-7e2159e53ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:26.658026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4b021571-25c7-44ba-a20a-7e2159e53ade None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:26.659362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4b021571-25c7-44ba-a20a-7e2159e53ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:26.684097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:26.701265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:26.703800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05178584-feaa-4401-af7a-8b583560bef4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:26.741086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bdac1-0e12-4ebc-82ba-6692fb8461b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:26.741931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bdac1-0e12-4ebc-82ba-6692fb8461b0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:26.742330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bdac1-0e12-4ebc-82ba-6692fb8461b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:26.742702 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bdac1-0e12-4ebc-82ba-6692fb8461b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:26.743522 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bdac1-0e12-4ebc-82ba-6692fb8461b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:26.743926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bdac1-0e12-4ebc-82ba-6692fb8461b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:26.745469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bdac1-0e12-4ebc-82ba-6692fb8461b0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:26.762427 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 231/485] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:26.765100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bdac1-0e12-4ebc-82ba-6692fb8461b0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:26.807686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 255/486] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:26.840313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b021571-25c7-44ba-a20a-7e2159e53ade None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:26.883191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bdac1-0e12-4ebc-82ba-6692fb8461b0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:26.917983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1923-aada-4237-b214-d3b00277466a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:26.918621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1923-aada-4237-b214-d3b00277466a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:26.919025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1923-aada-4237-b214-d3b00277466a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:26.919366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1923-aada-4237-b214-d3b00277466a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:26.930516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a1923-aada-4237-b214-d3b00277466a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:26.932028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a1923-aada-4237-b214-d3b00277466a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:26.941248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-487a1923-aada-4237-b214-d3b00277466a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:26.948186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:26.949061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:26.949922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:26.949922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:26.949922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:26.949922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:26.954303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 232/487] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:26.955855 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1923-aada-4237-b214-d3b00277466a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:27.026936 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b021571-25c7-44ba-a20a-7e2159e53ade None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:27.068667 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1923-aada-4237-b214-d3b00277466a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:27.070360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471af76b-28d9-4fa9-9629-39e583839077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:27.071174 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471af76b-28d9-4fa9-9629-39e583839077 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.071455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471af76b-28d9-4fa9-9629-39e583839077 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.071734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471af76b-28d9-4fa9-9629-39e583839077 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.082358 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471af76b-28d9-4fa9-9629-39e583839077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-471af76b-28d9-4fa9-9629-39e583839077 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:27.087269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:27.088157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:27.088986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:27.088986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:27.088986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:27.088986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:27.088986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:27.088986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:27.088986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:27.088986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:27.088986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:27.088986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:27.088986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:27.088986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:27.093184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 256/488] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:27.094759 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9867a8-9423-44a4-bd0d-81482255e0b9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.095046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9867a8-9423-44a4-bd0d-81482255e0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.095324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9867a8-9423-44a4-bd0d-81482255e0b9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.096585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 257/489] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:27.100655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df49da2-74e6-4d6d-9211-9a91f680cc0f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.100655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df49da2-74e6-4d6d-9211-9a91f680cc0f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.100655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df49da2-74e6-4d6d-9211-9a91f680cc0f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.100655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 258/490] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:27.101092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df49da2-74e6-4d6d-9211-9a91f680cc0f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:27.113600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baee6b-e562-4d7d-96f2-72353c74c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:27.114217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baee6b-e562-4d7d-96f2-72353c74c5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.114500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baee6b-e562-4d7d-96f2-72353c74c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.114771 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baee6b-e562-4d7d-96f2-72353c74c5f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.115464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baee6b-e562-4d7d-96f2-72353c74c5f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:27.115768 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baee6b-e562-4d7d-96f2-72353c74c5f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:27.117171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baee6b-e562-4d7d-96f2-72353c74c5f4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:27.121371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:27.134271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 233/491] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:27.135571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7e511-7cf5-4c3d-8bfd-952c8a36bb06 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.135888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7e511-7cf5-4c3d-8bfd-952c8a36bb06 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.136134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7e511-7cf5-4c3d-8bfd-952c8a36bb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.155252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8fa7e511-7cf5-4c3d-8bfd-952c8a36bb06 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:27.156430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8fa7e511-7cf5-4c3d-8bfd-952c8a36bb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:27.207645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:27.218860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df49da2-74e6-4d6d-9211-9a91f680cc0f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:27.236941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 234/492] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:27.236941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5033df-21c0-4aef-b233-58002081f2f6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.236941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5033df-21c0-4aef-b233-58002081f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.236941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5033df-21c0-4aef-b233-58002081f2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.256202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-dd5033df-21c0-4aef-b233-58002081f2f6 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:27.257408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dd5033df-21c0-4aef-b233-58002081f2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:27.261231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08d2d2-4bbc-4a3e-aca9-07ab61814d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:27.261862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08d2d2-4bbc-4a3e-aca9-07ab61814d23 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.262144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08d2d2-4bbc-4a3e-aca9-07ab61814d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.262419 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08d2d2-4bbc-4a3e-aca9-07ab61814d23 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.263871 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08d2d2-4bbc-4a3e-aca9-07ab61814d23 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:27.264182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08d2d2-4bbc-4a3e-aca9-07ab61814d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:27.265851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08d2d2-4bbc-4a3e-aca9-07ab61814d23 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:27.274104 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 259/493] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:27.278061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08d2d2-4bbc-4a3e-aca9-07ab61814d23 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:27.333739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 235/494] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:27.334687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5033df-21c0-4aef-b233-58002081f2f6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:27.361368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:27.385483 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08d2d2-4bbc-4a3e-aca9-07ab61814d23 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:27.423961 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9eb427-66d3-49e5-a717-6db18e49e2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:27.424888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9eb427-66d3-49e5-a717-6db18e49e2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.425378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9eb427-66d3-49e5-a717-6db18e49e2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.425861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9eb427-66d3-49e5-a717-6db18e49e2a8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.435133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9eb427-66d3-49e5-a717-6db18e49e2a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:27.436829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9eb427-66d3-49e5-a717-6db18e49e2a8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5e9eb427-66d3-49e5-a717-6db18e49e2a8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:27.451369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:27.452509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:27.453516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:27.453516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:27.453516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:27.453516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:27.453516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:27.453516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:27.453516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:27.453516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:27.453516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 01:20:27.453516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:27.454042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 260/495] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:27.459269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9eb427-66d3-49e5-a717-6db18e49e2a8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:27.464654 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5033df-21c0-4aef-b233-58002081f2f6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:27.483074 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:27.502752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2a41f-bf1c-492f-a9a3-40d1f64fe028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:27.503456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a41f-bf1c-492f-a9a3-40d1f64fe028 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.503730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a41f-bf1c-492f-a9a3-40d1f64fe028 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.504046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a41f-bf1c-492f-a9a3-40d1f64fe028 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.516239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2a41f-bf1c-492f-a9a3-40d1f64fe028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f3e2a41f-bf1c-492f-a9a3-40d1f64fe028 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:27.521173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:27.522071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:27.522881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 236/496] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:27.523533 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2a41f-bf1c-492f-a9a3-40d1f64fe028 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:27.570459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9eb427-66d3-49e5-a717-6db18e49e2a8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:27.605100 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65c97f-8f0d-4742-a569-5425c8bde5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:27.605734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65c97f-8f0d-4742-a569-5425c8bde5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.606013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65c97f-8f0d-4742-a569-5425c8bde5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.607000 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65c97f-8f0d-4742-a569-5425c8bde5e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.614445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:27.618424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65c97f-8f0d-4742-a569-5425c8bde5e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:27.620828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65c97f-8f0d-4742-a569-5425c8bde5e1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:27.634202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2a41f-bf1c-492f-a9a3-40d1f64fe028 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5c65c97f-8f0d-4742-a569-5425c8bde5e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:27.636436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:27.637439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:27.638821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:27.638821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:27.638821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:27.638821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:27.638821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 261/497] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:27.639102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65c97f-8f0d-4742-a569-5425c8bde5e1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:27.672843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5cff1-d957-47c4-94c7-c778ccabb7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:27.673513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5cff1-d957-47c4-94c7-c778ccabb7eb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.673792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5cff1-d957-47c4-94c7-c778ccabb7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.674069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5cff1-d957-47c4-94c7-c778ccabb7eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.685944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5cff1-d957-47c4-94c7-c778ccabb7eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9db5cff1-d957-47c4-94c7-c778ccabb7eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:27.690835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:27.691732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:27.692537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 237/498] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:27.693269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5cff1-d957-47c4-94c7-c778ccabb7eb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:27.732656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:27.759385 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65c97f-8f0d-4742-a569-5425c8bde5e1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:27.795310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3b53e-79d6-493e-b7ea-9184a1abba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:27.795926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3b53e-79d6-493e-b7ea-9184a1abba2a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.796213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3b53e-79d6-493e-b7ea-9184a1abba2a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.796728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3b53e-79d6-493e-b7ea-9184a1abba2a None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.797329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3b53e-79d6-493e-b7ea-9184a1abba2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:27.797639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3b53e-79d6-493e-b7ea-9184a1abba2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:27.799097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3b53e-79d6-493e-b7ea-9184a1abba2a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:27.799296 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5cff1-d957-47c4-94c7-c778ccabb7eb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:27.833839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf1661-9e4a-46ae-ab1d-db957bc58e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:27.834374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1661-9e4a-46ae-ab1d-db957bc58e80 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.834651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1661-9e4a-46ae-ab1d-db957bc58e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.834921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1661-9e4a-46ae-ab1d-db957bc58e80 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.835551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 262/499] 10.222.0.15 () {56 vars in 1137 bytes} [Sat Aug 6 01:20:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:27.835650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf1661-9e4a-46ae-ab1d-db957bc58e80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:27.835916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf1661-9e4a-46ae-ab1d-db957bc58e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:27.836361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3b53e-79d6-493e-b7ea-9184a1abba2a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:27.837408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf1661-9e4a-46ae-ab1d-db957bc58e80 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:27.846934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 238/500] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:27.847727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf1661-9e4a-46ae-ab1d-db957bc58e80 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:27.886896 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:27.939324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3b53e-79d6-493e-b7ea-9184a1abba2a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:27.942165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:27.945647 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf1661-9e4a-46ae-ab1d-db957bc58e80 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:27.972790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7b149-cb4d-4e98-bc5e-071429347836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:27.973427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7b149-cb4d-4e98-bc5e-071429347836 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.973707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7b149-cb4d-4e98-bc5e-071429347836 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.973974 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7b149-cb4d-4e98-bc5e-071429347836 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.974664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7b149-cb4d-4e98-bc5e-071429347836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:27.974975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7b149-cb4d-4e98-bc5e-071429347836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:27.976350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7b149-cb4d-4e98-bc5e-071429347836 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:27.979318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2371a-338a-487b-9915-c8a81a3ff053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:27.979919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2371a-338a-487b-9915-c8a81a3ff053 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.980199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2371a-338a-487b-9915-c8a81a3ff053 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.980473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2371a-338a-487b-9915-c8a81a3ff053 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.981284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2371a-338a-487b-9915-c8a81a3ff053 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:27.982102 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2371a-338a-487b-9915-c8a81a3ff053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:27.983455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2371a-338a-487b-9915-c8a81a3ff053 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:27.988259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 263/501] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:27.989566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c8899-eafe-48e3-8429-2c2c30ba5f54 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:27.989856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c8899-eafe-48e3-8429-2c2c30ba5f54 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:27.990131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c8899-eafe-48e3-8429-2c2c30ba5f54 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:27.991338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 264/502] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:27.992018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c8899-eafe-48e3-8429-2c2c30ba5f54 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:27.992359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 239/503] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:27.993193 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2371a-338a-487b-9915-c8a81a3ff053 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:28.093512 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2371a-338a-487b-9915-c8a81a3ff053 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:28.101411 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c8899-eafe-48e3-8429-2c2c30ba5f54 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:28.110680 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:28.128458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5e001-8cc2-4f59-9334-f829a997ba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:28.129121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5e001-8cc2-4f59-9334-f829a997ba37 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:28.129408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5e001-8cc2-4f59-9334-f829a997ba37 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:28.129690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5e001-8cc2-4f59-9334-f829a997ba37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:28.136737 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a7b09-4421-4012-a14e-c3f175b5cc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:28.137376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7b09-4421-4012-a14e-c3f175b5cc53 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:28.137737 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7b09-4421-4012-a14e-c3f175b5cc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:28.138001 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7b09-4421-4012-a14e-c3f175b5cc53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:28.140516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5e001-8cc2-4f59-9334-f829a997ba37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:28.141992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5e001-8cc2-4f59-9334-f829a997ba37 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-90c5e001-8cc2-4f59-9334-f829a997ba37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:28.156195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:28.157059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:28.162830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:28.162830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:28.162830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:28.162830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:28.162830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 240/504] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:28.162830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5e001-8cc2-4f59-9334-f829a997ba37 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:28.174124 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:28.205433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a7b09-4421-4012-a14e-c3f175b5cc53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:28.206894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a7b09-4421-4012-a14e-c3f175b5cc53 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:28.258281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5e001-8cc2-4f59-9334-f829a997ba37 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:28.293119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55099e2c-adfb-4bbd-85e5-3be612e56b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:28.293813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55099e2c-adfb-4bbd-85e5-3be612e56b41 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:28.294259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55099e2c-adfb-4bbd-85e5-3be612e56b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:28.294548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55099e2c-adfb-4bbd-85e5-3be612e56b41 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:28.301931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55099e2c-adfb-4bbd-85e5-3be612e56b41 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:28.303379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55099e2c-adfb-4bbd-85e5-3be612e56b41 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:28.303730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 265/505] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:28.304554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a7b09-4421-4012-a14e-c3f175b5cc53 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:28.314494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-55099e2c-adfb-4bbd-85e5-3be612e56b41 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:28.320652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:28.321735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:28.322923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:28.322923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:28.322923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:28.322923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:28.322923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:28.322923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:28.322923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:28.322923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:28.322923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:20:28.322923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:28.322923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 241/506] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:28.323607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943c533-a230-4ee1-9f5d-4db0579fa949 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:28.323607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943c533-a230-4ee1-9f5d-4db0579fa949 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:28.323607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943c533-a230-4ee1-9f5d-4db0579fa949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:28.342770 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5943c533-a230-4ee1-9f5d-4db0579fa949 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:28.344012 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5943c533-a230-4ee1-9f5d-4db0579fa949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:28.408133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a7b09-4421-4012-a14e-c3f175b5cc53 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:28.414352 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 242/507] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:28.415700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943c533-a230-4ee1-9f5d-4db0579fa949 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:28.418204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:28.443685 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5781fb-d161-493a-ba58-9a214fccb1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:28.444321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5781fb-d161-493a-ba58-9a214fccb1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:28.444600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5781fb-d161-493a-ba58-9a214fccb1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:28.444874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5781fb-d161-493a-ba58-9a214fccb1a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:28.455467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5781fb-d161-493a-ba58-9a214fccb1a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:28.456931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5781fb-d161-493a-ba58-9a214fccb1a1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-af5781fb-d161-493a-ba58-9a214fccb1a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:28.471574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:28.472430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:28.473568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:28.473568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:28.473568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:28.473568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:28.473568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 266/508] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:28.473568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5781fb-d161-493a-ba58-9a214fccb1a1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:28.521272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943c533-a230-4ee1-9f5d-4db0579fa949 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:28.531445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:28.554305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037ccb7-8e9d-4874-a6f2-de5c21a57cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:28.554913 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037ccb7-8e9d-4874-a6f2-de5c21a57cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:28.555190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037ccb7-8e9d-4874-a6f2-de5c21a57cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:28.555456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037ccb7-8e9d-4874-a6f2-de5c21a57cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:28.556142 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037ccb7-8e9d-4874-a6f2-de5c21a57cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:28.556444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037ccb7-8e9d-4874-a6f2-de5c21a57cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:28.557845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037ccb7-8e9d-4874-a6f2-de5c21a57cf9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:28.569280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 243/509] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:28.570057 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037ccb7-8e9d-4874-a6f2-de5c21a57cf9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:28.572339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5781fb-d161-493a-ba58-9a214fccb1a1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:28.605840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce3e12-1e8b-4ad9-96fb-57c269f2ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:28.606444 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce3e12-1e8b-4ad9-96fb-57c269f2ecdd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:28.606722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce3e12-1e8b-4ad9-96fb-57c269f2ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:28.606994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce3e12-1e8b-4ad9-96fb-57c269f2ecdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:28.617119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce3e12-1e8b-4ad9-96fb-57c269f2ecdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:28.618557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce3e12-1e8b-4ad9-96fb-57c269f2ecdd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:28.629414 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a5ce3e12-1e8b-4ad9-96fb-57c269f2ecdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:28.633308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:28.634212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:28.635081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:28.635081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:28.635081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:28.635081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:28.635081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 267/510] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:28.635346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce3e12-1e8b-4ad9-96fb-57c269f2ecdd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:28.670789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037ccb7-8e9d-4874-a6f2-de5c21a57cf9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:28.702563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb74868-512c-40d0-85ad-bfb630911607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:28.703169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb74868-512c-40d0-85ad-bfb630911607 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:28.703449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb74868-512c-40d0-85ad-bfb630911607 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:28.703728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb74868-512c-40d0-85ad-bfb630911607 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:28.704509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb74868-512c-40d0-85ad-bfb630911607 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:28.704813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb74868-512c-40d0-85ad-bfb630911607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:28.706251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb74868-512c-40d0-85ad-bfb630911607 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:28.734589 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce3e12-1e8b-4ad9-96fb-57c269f2ecdd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:28.743474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 244/511] 10.222.0.15 () {56 vars in 1137 bytes} [Sat Aug 6 01:20:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:28.744273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb74868-512c-40d0-85ad-bfb630911607 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:28.747270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:28.769486 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b36a97-1d4c-494d-8ff1-a7df257430fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:28.770116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b36a97-1d4c-494d-8ff1-a7df257430fe None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:28.770395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b36a97-1d4c-494d-8ff1-a7df257430fe None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:28.770670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b36a97-1d4c-494d-8ff1-a7df257430fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:28.781674 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b36a97-1d4c-494d-8ff1-a7df257430fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:28.783108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b36a97-1d4c-494d-8ff1-a7df257430fe None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a8b36a97-1d4c-494d-8ff1-a7df257430fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:28.797711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:28.798558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:28.799434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:28.799434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:28.799434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:28.799434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:28.799434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 268/512] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:28.799746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b36a97-1d4c-494d-8ff1-a7df257430fe None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:28.848599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb74868-512c-40d0-85ad-bfb630911607 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:28.868416 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:28.882948 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e9705-a7e5-4ff0-b437-b46824654bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:28.883750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e9705-a7e5-4ff0-b437-b46824654bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:28.884029 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e9705-a7e5-4ff0-b437-b46824654bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:28.884302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e9705-a7e5-4ff0-b437-b46824654bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:28.885018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e9705-a7e5-4ff0-b437-b46824654bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:28.885323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e9705-a7e5-4ff0-b437-b46824654bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:28.886682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e9705-a7e5-4ff0-b437-b46824654bc8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:28.897375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b36a97-1d4c-494d-8ff1-a7df257430fe None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:28.897828 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 245/513] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:28.898595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e9705-a7e5-4ff0-b437-b46824654bc8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:28.931735 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8450064-a3a7-4a3a-a50d-1558a785deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:28.932369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8450064-a3a7-4a3a-a50d-1558a785deae None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:28.932656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8450064-a3a7-4a3a-a50d-1558a785deae None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:28.932965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8450064-a3a7-4a3a-a50d-1558a785deae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:28.940365 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8450064-a3a7-4a3a-a50d-1558a785deae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:28.941867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8450064-a3a7-4a3a-a50d-1558a785deae None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e8450064-a3a7-4a3a-a50d-1558a785deae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:28.953353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:28.954449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:28.955375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:28.955375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:28.955375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:28.955375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:28.955375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:28.955375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:28.955375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:28.955375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:28.955375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:20:28.955375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:28.955375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 269/514] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 6 01:20:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:28.955375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8450064-a3a7-4a3a-a50d-1558a785deae None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:28.980480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:29.001572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e9705-a7e5-4ff0-b437-b46824654bc8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:29.035956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af416d3-b67b-49a5-9a67-0844f1bab4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:29.036577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af416d3-b67b-49a5-9a67-0844f1bab4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:29.036858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af416d3-b67b-49a5-9a67-0844f1bab4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:29.037167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af416d3-b67b-49a5-9a67-0844f1bab4d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:29.037862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af416d3-b67b-49a5-9a67-0844f1bab4d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:29.038172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af416d3-b67b-49a5-9a67-0844f1bab4d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:29.039544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af416d3-b67b-49a5-9a67-0844f1bab4d5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:29.052099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 246/515] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:29.052896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af416d3-b67b-49a5-9a67-0844f1bab4d5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:29.054162 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8450064-a3a7-4a3a-a50d-1558a785deae None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:29.089466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64272d4e-ad06-46ac-9229-4e0014e62c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:29.090088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64272d4e-ad06-46ac-9229-4e0014e62c5d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:29.090371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64272d4e-ad06-46ac-9229-4e0014e62c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:29.091223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64272d4e-ad06-46ac-9229-4e0014e62c5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:29.098779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:29.157138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af416d3-b67b-49a5-9a67-0844f1bab4d5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:29.160842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64272d4e-ad06-46ac-9229-4e0014e62c5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:29.162307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64272d4e-ad06-46ac-9229-4e0014e62c5d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:29.185915 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:29.191267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e0909-c87b-4c38-acbb-dbfdca4acc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:29.191957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e0909-c87b-4c38-acbb-dbfdca4acc3b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:29.192308 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e0909-c87b-4c38-acbb-dbfdca4acc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:29.192584 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e0909-c87b-4c38-acbb-dbfdca4acc3b None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:29.193306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e0909-c87b-4c38-acbb-dbfdca4acc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:29.193614 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e0909-c87b-4c38-acbb-dbfdca4acc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:29.194973 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e0909-c87b-4c38-acbb-dbfdca4acc3b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:29.206193 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 247/516] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:29.206989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e0909-c87b-4c38-acbb-dbfdca4acc3b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:29.263677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 270/517] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:29.265025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64272d4e-ad06-46ac-9229-4e0014e62c5d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:29.301923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:29.305334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e0909-c87b-4c38-acbb-dbfdca4acc3b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:29.340126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7462f4-2021-4bb3-88b6-8f3be3573cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:29.340797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7462f4-2021-4bb3-88b6-8f3be3573cfb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:29.341161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7462f4-2021-4bb3-88b6-8f3be3573cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:29.341439 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7462f4-2021-4bb3-88b6-8f3be3573cfb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:29.349193 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7462f4-2021-4bb3-88b6-8f3be3573cfb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:29.350686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7462f4-2021-4bb3-88b6-8f3be3573cfb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ee7462f4-2021-4bb3-88b6-8f3be3573cfb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:29.361947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:29.362844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:29.363737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:29.363737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:29.363737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:29.363737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:29.363737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:29.363737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:29.363737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:29.363737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:29.363737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 01:20:29.363737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:29.363737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 248/518] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:29.364835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7462f4-2021-4bb3-88b6-8f3be3573cfb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:29.372335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64272d4e-ad06-46ac-9229-4e0014e62c5d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:29.399729 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:29.413316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594031e2-43cb-4b64-8ba7-c6ceec2cfbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:29.414101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594031e2-43cb-4b64-8ba7-c6ceec2cfbcb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:29.414483 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594031e2-43cb-4b64-8ba7-c6ceec2cfbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:29.414881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594031e2-43cb-4b64-8ba7-c6ceec2cfbcb None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:29.415686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594031e2-43cb-4b64-8ba7-c6ceec2cfbcb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:29.415996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594031e2-43cb-4b64-8ba7-c6ceec2cfbcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:29.417465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594031e2-43cb-4b64-8ba7-c6ceec2cfbcb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:29.435670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 271/519] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 6 01:20:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:29.436438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594031e2-43cb-4b64-8ba7-c6ceec2cfbcb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:29.467101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7462f4-2021-4bb3-88b6-8f3be3573cfb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:29.500844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1871b07-b691-49f4-a2aa-baa634ffc299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:29.501543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1871b07-b691-49f4-a2aa-baa634ffc299 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:29.502096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1871b07-b691-49f4-a2aa-baa634ffc299 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:29.502379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1871b07-b691-49f4-a2aa-baa634ffc299 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:29.509001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1871b07-b691-49f4-a2aa-baa634ffc299 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:29.510432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1871b07-b691-49f4-a2aa-baa634ffc299 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e1871b07-b691-49f4-a2aa-baa634ffc299 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:29.523334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:29.524401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:29.525348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:29.525348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:29.525348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:29.525348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:29.525348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:29.525348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:29.525348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:29.525348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:29.525348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 249/520] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:29.525835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1871b07-b691-49f4-a2aa-baa634ffc299 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:29.538419 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594031e2-43cb-4b64-8ba7-c6ceec2cfbcb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:29.547274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:29.571900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da74b4-f63b-4a1a-b2bf-287b1c15bffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:29.572514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da74b4-f63b-4a1a-b2bf-287b1c15bffe None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:29.572796 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da74b4-f63b-4a1a-b2bf-287b1c15bffe None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:29.573098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da74b4-f63b-4a1a-b2bf-287b1c15bffe None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:29.573779 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da74b4-f63b-4a1a-b2bf-287b1c15bffe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:29.575719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da74b4-f63b-4a1a-b2bf-287b1c15bffe None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:29.597842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 272/521] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:20:29 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:29.598640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da74b4-f63b-4a1a-b2bf-287b1c15bffe None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:29.642712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1871b07-b691-49f4-a2aa-baa634ffc299 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:29.649141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:29.682910 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010925ad-0bb2-4b68-b110-a857d95f50df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:29.683577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010925ad-0bb2-4b68-b110-a857d95f50df None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:29.683931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010925ad-0bb2-4b68-b110-a857d95f50df None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:29.684217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010925ad-0bb2-4b68-b110-a857d95f50df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:29.696304 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010925ad-0bb2-4b68-b110-a857d95f50df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:29.697878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010925ad-0bb2-4b68-b110-a857d95f50df None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-010925ad-0bb2-4b68-b110-a857d95f50df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:29.714928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:29.716986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:29.718438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:29.718438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:29.718438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:29.718438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:29.718438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 250/522] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:29.718438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010925ad-0bb2-4b68-b110-a857d95f50df None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:29.728878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da74b4-f63b-4a1a-b2bf-287b1c15bffe None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:29.771675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5dbfb-e2f3-407f-804c-409a4e2793a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:29.772299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5dbfb-e2f3-407f-804c-409a4e2793a8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:29.772582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5dbfb-e2f3-407f-804c-409a4e2793a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:29.772858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5dbfb-e2f3-407f-804c-409a4e2793a8 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:29.773810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5dbfb-e2f3-407f-804c-409a4e2793a8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:29.774125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5dbfb-e2f3-407f-804c-409a4e2793a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:29.775569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5dbfb-e2f3-407f-804c-409a4e2793a8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:29.798320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 273/523] 10.222.0.15 () {56 vars in 1139 bytes} [Sat Aug 6 01:20:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:29.799551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5dbfb-e2f3-407f-804c-409a4e2793a8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:29.806525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:29.848345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010925ad-0bb2-4b68-b110-a857d95f50df None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:29.887132 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17057eac-93fa-417b-9a27-b92c4ce6164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:29.887829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17057eac-93fa-417b-9a27-b92c4ce6164a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:29.888189 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17057eac-93fa-417b-9a27-b92c4ce6164a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:29.888460 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17057eac-93fa-417b-9a27-b92c4ce6164a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:29.900588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:29.907619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5dbfb-e2f3-407f-804c-409a4e2793a8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:29.943542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6c7a-5eda-4c22-a440-1ec853be9d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:29.944076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6c7a-5eda-4c22-a440-1ec853be9d7f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:29.944357 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6c7a-5eda-4c22-a440-1ec853be9d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:29.944696 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6c7a-5eda-4c22-a440-1ec853be9d7f None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:29.945458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e6c7a-5eda-4c22-a440-1ec853be9d7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:29.945840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e6c7a-5eda-4c22-a440-1ec853be9d7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:29.947277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e6c7a-5eda-4c22-a440-1ec853be9d7f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:29.963080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17057eac-93fa-417b-9a27-b92c4ce6164a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:29.964549 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17057eac-93fa-417b-9a27-b92c4ce6164a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:29.966085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 274/524] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:29.971576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6c7a-5eda-4c22-a440-1ec853be9d7f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.038864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:30.072740 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 251/525] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:30.073877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17057eac-93fa-417b-9a27-b92c4ce6164a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.082097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6c7a-5eda-4c22-a440-1ec853be9d7f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:30.118647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a698d-3c2b-44ae-aee1-6e862ea0e0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:30.119265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a698d-3c2b-44ae-aee1-6e862ea0e0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.119549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a698d-3c2b-44ae-aee1-6e862ea0e0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.119825 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a698d-3c2b-44ae-aee1-6e862ea0e0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.120643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a698d-3c2b-44ae-aee1-6e862ea0e0b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:30.120972 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a698d-3c2b-44ae-aee1-6e862ea0e0b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:30.122667 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a698d-3c2b-44ae-aee1-6e862ea0e0b8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:30.136013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 275/526] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:30.136720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a698d-3c2b-44ae-aee1-6e862ea0e0b8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.161034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:30.189187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17057eac-93fa-417b-9a27-b92c4ce6164a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:30.226445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f8621-4b14-4349-9550-171240382a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:30.226989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f8621-4b14-4349-9550-171240382a62 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.227256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f8621-4b14-4349-9550-171240382a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.227526 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f8621-4b14-4349-9550-171240382a62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.251094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a698d-3c2b-44ae-aee1-6e862ea0e0b8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:30.271159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:30.290361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad500f9-b8f9-4a7e-ac06-690fc30d3c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:30.290980 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad500f9-b8f9-4a7e-ac06-690fc30d3c13 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.291378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad500f9-b8f9-4a7e-ac06-690fc30d3c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.291715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad500f9-b8f9-4a7e-ac06-690fc30d3c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.292688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad500f9-b8f9-4a7e-ac06-690fc30d3c13 None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=da39170a654d4d52a39b4b2c8cfd8906) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:30.293085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad500f9-b8f9-4a7e-ac06-690fc30d3c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:30.295054 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad500f9-b8f9-4a7e-ac06-690fc30d3c13 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:30.299326 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f8621-4b14-4349-9550-171240382a62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:30.309324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 276/527] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:30 2022] GET /identity/v3/role_assignments?user.id=da39170a654d4d52a39b4b2c8cfd8906&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:30.309592 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f8621-4b14-4349-9550-171240382a62 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:30.310016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad500f9-b8f9-4a7e-ac06-690fc30d3c13 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:30.452135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 252/528] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:30.453443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f8621-4b14-4349-9550-171240382a62 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.453887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad500f9-b8f9-4a7e-ac06-690fc30d3c13 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:30.503813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d19610-c195-44e2-81a3-cfd3b5e689f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:30.505341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d19610-c195-44e2-81a3-cfd3b5e689f4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.505781 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d19610-c195-44e2-81a3-cfd3b5e689f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.506193 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d19610-c195-44e2-81a3-cfd3b5e689f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.523165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d19610-c195-44e2-81a3-cfd3b5e689f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:30.525379 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d19610-c195-44e2-81a3-cfd3b5e689f4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:30.537917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-97d19610-c195-44e2-81a3-cfd3b5e689f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:30.547076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:30.548123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:30.549205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:30.549205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:30.549205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:30.549205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:30.556338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 277/529] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:30.556338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d19610-c195-44e2-81a3-cfd3b5e689f4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.578846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f8621-4b14-4349-9550-171240382a62 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:30.622283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae81e3-181b-4131-8b13-b4d3f26876d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:30.623830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae81e3-181b-4131-8b13-b4d3f26876d3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.624322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae81e3-181b-4131-8b13-b4d3f26876d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.625052 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae81e3-181b-4131-8b13-b4d3f26876d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.633747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae81e3-181b-4131-8b13-b4d3f26876d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:30.636058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae81e3-181b-4131-8b13-b4d3f26876d3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ebae81e3-181b-4131-8b13-b4d3f26876d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:30.653015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:30.654145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:30.655033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:30.655033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:30.655033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:30.655033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:30.655033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:30.655033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:30.655033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:30.655033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:30.662129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 253/530] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:30.662129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae81e3-181b-4131-8b13-b4d3f26876d3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.693979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d19610-c195-44e2-81a3-cfd3b5e689f4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:30.739523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:30.746327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c699fd-135e-48ef-9bd0-cddded472e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:30.748025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c699fd-135e-48ef-9bd0-cddded472e68 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.748516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c699fd-135e-48ef-9bd0-cddded472e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.749018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c699fd-135e-48ef-9bd0-cddded472e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.760957 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c699fd-135e-48ef-9bd0-cddded472e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:30.763308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c699fd-135e-48ef-9bd0-cddded472e68 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:30.778841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae81e3-181b-4131-8b13-b4d3f26876d3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a1c699fd-135e-48ef-9bd0-cddded472e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:30.779362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:30.780166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:30.781427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:30.781427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:30.781427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:30.781427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:30.787765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 278/531] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:30.788827 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c699fd-135e-48ef-9bd0-cddded472e68 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.812251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:30.820125 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dabd6e-7d5c-4a2b-a2d0-ba7c1444ad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:30.821364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dabd6e-7d5c-4a2b-a2d0-ba7c1444ad86 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.822086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dabd6e-7d5c-4a2b-a2d0-ba7c1444ad86 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.822966 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dabd6e-7d5c-4a2b-a2d0-ba7c1444ad86 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.824133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dabd6e-7d5c-4a2b-a2d0-ba7c1444ad86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:30.824635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dabd6e-7d5c-4a2b-a2d0-ba7c1444ad86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:30.827358 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dabd6e-7d5c-4a2b-a2d0-ba7c1444ad86 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:30.844272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 254/532] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:30.845466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dabd6e-7d5c-4a2b-a2d0-ba7c1444ad86 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.911487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c699fd-135e-48ef-9bd0-cddded472e68 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:30.952610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd25f-7c95-4ec9-950f-bbe9729e9bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:30.953656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd25f-7c95-4ec9-950f-bbe9729e9bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.954116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd25f-7c95-4ec9-950f-bbe9729e9bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.954624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd25f-7c95-4ec9-950f-bbe9729e9bd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.955561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cd25f-7c95-4ec9-950f-bbe9729e9bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:30.956042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cd25f-7c95-4ec9-950f-bbe9729e9bd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:30.957926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cd25f-7c95-4ec9-950f-bbe9729e9bd3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:30.960076 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dabd6e-7d5c-4a2b-a2d0-ba7c1444ad86 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:30.972155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 279/533] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:30.973412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd25f-7c95-4ec9-950f-bbe9729e9bd3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.997606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da64be-3ab0-489f-8176-ba896e29bf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:30.998244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da64be-3ab0-489f-8176-ba896e29bf20 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.998527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da64be-3ab0-489f-8176-ba896e29bf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.998806 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da64be-3ab0-489f-8176-ba896e29bf20 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.999506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da64be-3ab0-489f-8176-ba896e29bf20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:30.999826 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da64be-3ab0-489f-8176-ba896e29bf20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.001302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da64be-3ab0-489f-8176-ba896e29bf20 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.018011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 255/534] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:31.018837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da64be-3ab0-489f-8176-ba896e29bf20 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.025565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:31.074306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:31.092553 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd25f-7c95-4ec9-950f-bbe9729e9bd3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.126378 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da64be-3ab0-489f-8176-ba896e29bf20 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.134073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15073d05-afaa-4859-b0a5-5d5a0e02e35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.134981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15073d05-afaa-4859-b0a5-5d5a0e02e35c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.135588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15073d05-afaa-4859-b0a5-5d5a0e02e35c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.136079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15073d05-afaa-4859-b0a5-5d5a0e02e35c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.144838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15073d05-afaa-4859-b0a5-5d5a0e02e35c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.146533 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15073d05-afaa-4859-b0a5-5d5a0e02e35c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-15073d05-afaa-4859-b0a5-5d5a0e02e35c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:31.159844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:31.160687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:31.161575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:31.161575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:31.161575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:31.161575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:31.161575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:31.161575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:31.161575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:31.161575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:31.162004 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc7f0f-893f-4312-acda-e0f9606d7722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.162594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc7f0f-893f-4312-acda-e0f9606d7722 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.162829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc7f0f-893f-4312-acda-e0f9606d7722 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.163111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc7f0f-893f-4312-acda-e0f9606d7722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.163907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc7f0f-893f-4312-acda-e0f9606d7722 None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=acd6aba844f04489adec2ce9f1eb49dd) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:31.164276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc7f0f-893f-4312-acda-e0f9606d7722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.165156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 280/535] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:31.165819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc7f0f-893f-4312-acda-e0f9606d7722 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.166464 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15073d05-afaa-4859-b0a5-5d5a0e02e35c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.172684 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 256/536] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/role_assignments?user.id=acd6aba844f04489adec2ce9f1eb49dd&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:31.173560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc7f0f-893f-4312-acda-e0f9606d7722 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.283885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15073d05-afaa-4859-b0a5-5d5a0e02e35c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.284598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc7f0f-893f-4312-acda-e0f9606d7722 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.287044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:31.303090 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:31.323449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ce26d-f174-49c3-8c09-ce92e2288dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.324082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ce26d-f174-49c3-8c09-ce92e2288dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.324348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ce26d-f174-49c3-8c09-ce92e2288dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.324686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ce26d-f174-49c3-8c09-ce92e2288dc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.326015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ce26d-f174-49c3-8c09-ce92e2288dc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:31.326428 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ce26d-f174-49c3-8c09-ce92e2288dc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.327877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ce26d-f174-49c3-8c09-ce92e2288dc6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.329959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3b5b1-e272-4a53-bf13-6f81edd681b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.330817 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3b5b1-e272-4a53-bf13-6f81edd681b0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.331312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3b5b1-e272-4a53-bf13-6f81edd681b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.331887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3b5b1-e272-4a53-bf13-6f81edd681b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.339787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3b5b1-e272-4a53-bf13-6f81edd681b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.341779 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3b5b1-e272-4a53-bf13-6f81edd681b0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.348232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 257/537] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c6d3b5b1-e272-4a53-bf13-6f81edd681b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:31.355173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:31.356575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:31.357534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:31.357534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:31.357534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:31.357534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:31.357534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:31.357534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:31.357534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:31.357534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:31.357933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ce26d-f174-49c3-8c09-ce92e2288dc6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.374370 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 281/538] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:31.376849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3b5b1-e272-4a53-bf13-6f81edd681b0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.485505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3b5b1-e272-4a53-bf13-6f81edd681b0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.522822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3fcad-893b-4ba0-9991-88bfe8aa64bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.523817 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3fcad-893b-4ba0-9991-88bfe8aa64bd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.524380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3fcad-893b-4ba0-9991-88bfe8aa64bd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.524985 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3fcad-893b-4ba0-9991-88bfe8aa64bd None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.525950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3fcad-893b-4ba0-9991-88bfe8aa64bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:31.526451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3fcad-893b-4ba0-9991-88bfe8aa64bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.528636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3fcad-893b-4ba0-9991-88bfe8aa64bd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.545950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 282/539] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:31.548927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ce26d-f174-49c3-8c09-ce92e2288dc6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.549294 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3fcad-893b-4ba0-9991-88bfe8aa64bd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.600654 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a54e9-8147-4d78-990e-ff89bfa6f68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.601323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a54e9-8147-4d78-990e-ff89bfa6f68c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.601604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a54e9-8147-4d78-990e-ff89bfa6f68c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.601876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a54e9-8147-4d78-990e-ff89bfa6f68c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.602680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a54e9-8147-4d78-990e-ff89bfa6f68c None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=666f4864832445d5a10d60f677f5cd6c) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:31.602993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a54e9-8147-4d78-990e-ff89bfa6f68c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.604440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a54e9-8147-4d78-990e-ff89bfa6f68c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.610592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:31.615674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 258/540] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/role_assignments?user.id=666f4864832445d5a10d60f677f5cd6c&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:31.707298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3fcad-893b-4ba0-9991-88bfe8aa64bd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.714892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f4b81-d7a2-4ab2-b0de-c4530c06238d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.715223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f4b81-d7a2-4ab2-b0de-c4530c06238d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.716016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f4b81-d7a2-4ab2-b0de-c4530c06238d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.721093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 259/541] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:31.723445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b41320-6092-4ae9-b395-45aa6425832f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.723729 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b41320-6092-4ae9-b395-45aa6425832f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.724002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b41320-6092-4ae9-b395-45aa6425832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.753338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8fb3e-c40a-45d1-9138-e766bce9cfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.753979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8fb3e-c40a-45d1-9138-e766bce9cfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.754334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8fb3e-c40a-45d1-9138-e766bce9cfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.755006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8fb3e-c40a-45d1-9138-e766bce9cfd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.756399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8fb3e-c40a-45d1-9138-e766bce9cfd8 None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=403beb9eb6c04cc69579361138bea12d) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:31.756993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8fb3e-c40a-45d1-9138-e766bce9cfd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.759499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8fb3e-c40a-45d1-9138-e766bce9cfd8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.767360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 283/542] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/role_assignments?user.id=403beb9eb6c04cc69579361138bea12d&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:31.768228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-12b41320-6092-4ae9-b395-45aa6425832f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:31.769738 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-12b41320-6092-4ae9-b395-45aa6425832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:31.871202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:31.919703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 260/543] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:31.971396 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8fb3e-c40a-45d1-9138-e766bce9cfd8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.086951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:32.102791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8fb3e-c40a-45d1-9138-e766bce9cfd8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.142716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d4d7b-b247-433d-acc9-6956a7d97f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.143276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d4d7b-b247-433d-acc9-6956a7d97f37 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.143559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d4d7b-b247-433d-acc9-6956a7d97f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.143838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d4d7b-b247-433d-acc9-6956a7d97f37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.157442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d4d7b-b247-433d-acc9-6956a7d97f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e79d4d7b-b247-433d-acc9-6956a7d97f37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:32.163956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:32.165772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:32.167468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 284/544] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:32.178424 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b41320-6092-4ae9-b395-45aa6425832f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.331684 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b41320-6092-4ae9-b395-45aa6425832f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.396044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc89aae-588e-4076-901b-590120b8b077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.396571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc89aae-588e-4076-901b-590120b8b077 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.396852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc89aae-588e-4076-901b-590120b8b077 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.397531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc89aae-588e-4076-901b-590120b8b077 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.397861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc89aae-588e-4076-901b-590120b8b077 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:32.398208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc89aae-588e-4076-901b-590120b8b077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.399632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc89aae-588e-4076-901b-590120b8b077 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.418926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 261/545] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:32.425100 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d4d7b-b247-433d-acc9-6956a7d97f37 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.562834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d4d7b-b247-433d-acc9-6956a7d97f37 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.604501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243ef4b-515c-4833-acc7-55e9e3bdfbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.605183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243ef4b-515c-4833-acc7-55e9e3bdfbea None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.605470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243ef4b-515c-4833-acc7-55e9e3bdfbea None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.605751 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243ef4b-515c-4833-acc7-55e9e3bdfbea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.618442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243ef4b-515c-4833-acc7-55e9e3bdfbea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.619923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243ef4b-515c-4833-acc7-55e9e3bdfbea None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.632578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b243ef4b-515c-4833-acc7-55e9e3bdfbea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:32.648003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:32.650234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:32.652268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:32.652268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:32.652268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:32.652268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:32.652268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 285/546] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:32.662047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc89aae-588e-4076-901b-590120b8b077 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.704861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:32.792843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc89aae-588e-4076-901b-590120b8b077 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.839273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ff6ea-89ca-43e8-9b77-a572e9b5db7c None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.839601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ff6ea-89ca-43e8-9b77-a572e9b5db7c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.839818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ff6ea-89ca-43e8-9b77-a572e9b5db7c None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.842204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 286/547] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:20:32.846082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e3e8-f878-4408-9534-b0a6420686fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.846760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e3e8-f878-4408-9534-b0a6420686fc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.847087 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e3e8-f878-4408-9534-b0a6420686fc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.847366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e3e8-f878-4408-9534-b0a6420686fc None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.847528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbfaac-b74e-44c1-a1a3-5379166c1b8a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.847729 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbfaac-b74e-44c1-a1a3-5379166c1b8a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.848016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbfaac-b74e-44c1-a1a3-5379166c1b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.848180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468e3e8-f878-4408-9534-b0a6420686fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:32.848350 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468e3e8-f878-4408-9534-b0a6420686fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.849728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468e3e8-f878-4408-9534-b0a6420686fc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.863603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 262/548] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:32.868536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e3e8-f878-4408-9534-b0a6420686fc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.883128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a3bbfaac-b74e-44c1-a1a3-5379166c1b8a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:32.884325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a3bbfaac-b74e-44c1-a1a3-5379166c1b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:33.015683 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 287/549] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:33.029820 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:33.044386 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e3e8-f878-4408-9534-b0a6420686fc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.050200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbfaac-b74e-44c1-a1a3-5379166c1b8a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.103357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff160286-d2b6-4177-8d30-f57bcb4207d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.104005 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff160286-d2b6-4177-8d30-f57bcb4207d3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.104286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff160286-d2b6-4177-8d30-f57bcb4207d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.104564 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff160286-d2b6-4177-8d30-f57bcb4207d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.113436 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff160286-d2b6-4177-8d30-f57bcb4207d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.114921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff160286-d2b6-4177-8d30-f57bcb4207d3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ff160286-d2b6-4177-8d30-f57bcb4207d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:33.129376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:33.131838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:33.133239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:33.133239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:33.133239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:33.133239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:33.133239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:33.133239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:33.133239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:33.133239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:33.133239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:20:33.133239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:33.133239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 263/550] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:33.143797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff160286-d2b6-4177-8d30-f57bcb4207d3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.289584 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff160286-d2b6-4177-8d30-f57bcb4207d3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.310954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbfaac-b74e-44c1-a1a3-5379166c1b8a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.343776 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783997fb-9c24-45b1-96a0-d99d5f769690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.344467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783997fb-9c24-45b1-96a0-d99d5f769690 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.344729 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783997fb-9c24-45b1-96a0-d99d5f769690 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.345029 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783997fb-9c24-45b1-96a0-d99d5f769690 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.345826 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783997fb-9c24-45b1-96a0-d99d5f769690 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:33.346130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783997fb-9c24-45b1-96a0-d99d5f769690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.347562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783997fb-9c24-45b1-96a0-d99d5f769690 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.364093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:33.368641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 264/551] 10.222.0.15 () {56 vars in 1135 bytes} [Sat Aug 6 01:20:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:33.376958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783997fb-9c24-45b1-96a0-d99d5f769690 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.389965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171aa68-6f65-472e-b4a9-75a4a818a843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.390881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171aa68-6f65-472e-b4a9-75a4a818a843 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.392276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171aa68-6f65-472e-b4a9-75a4a818a843 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.392700 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171aa68-6f65-472e-b4a9-75a4a818a843 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.405317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:33.414410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171aa68-6f65-472e-b4a9-75a4a818a843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3171aa68-6f65-472e-b4a9-75a4a818a843 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:33.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:33.424518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:33.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:33.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:33.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:33.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:33.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:33.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:33.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:33.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:33.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:33.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:33.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:33.425771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:33.430961 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 288/552] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:33.441865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171aa68-6f65-472e-b4a9-75a4a818a843 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.554939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171aa68-6f65-472e-b4a9-75a4a818a843 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.596555 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783997fb-9c24-45b1-96a0-d99d5f769690 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.599727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8a16f-6568-4126-ab8e-1a70b1149147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.600842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8a16f-6568-4126-ab8e-1a70b1149147 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.601288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8a16f-6568-4126-ab8e-1a70b1149147 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.601707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8a16f-6568-4126-ab8e-1a70b1149147 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.604158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8a16f-6568-4126-ab8e-1a70b1149147 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:33.604629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8a16f-6568-4126-ab8e-1a70b1149147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.616163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8a16f-6568-4126-ab8e-1a70b1149147 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.633234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 289/553] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:33.639061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8a16f-6568-4126-ab8e-1a70b1149147 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.691713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102fe8b-eb0a-43d3-a104-7e2a713f68a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.692594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102fe8b-eb0a-43d3-a104-7e2a713f68a6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.693050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102fe8b-eb0a-43d3-a104-7e2a713f68a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.694297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102fe8b-eb0a-43d3-a104-7e2a713f68a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.740506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:33.810617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8a16f-6568-4126-ab8e-1a70b1149147 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.854306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12564342-4531-4f66-b7dc-dd3f4d87917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.856106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12564342-4531-4f66-b7dc-dd3f4d87917a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.857116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12564342-4531-4f66-b7dc-dd3f4d87917a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.858257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12564342-4531-4f66-b7dc-dd3f4d87917a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.877727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102fe8b-eb0a-43d3-a104-7e2a713f68a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.882116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102fe8b-eb0a-43d3-a104-7e2a713f68a6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.885017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12564342-4531-4f66-b7dc-dd3f4d87917a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.887735 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12564342-4531-4f66-b7dc-dd3f4d87917a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-12564342-4531-4f66-b7dc-dd3f4d87917a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:33.925118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:33.926371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:33.927441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:33.927441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:33.927441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:33.927441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:33.929288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:33.931389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 290/554] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:33.932273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12564342-4531-4f66-b7dc-dd3f4d87917a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.021571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 265/555] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:34.025572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be84bf9-8bdf-4173-a7c4-719fcce6f97e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.025877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be84bf9-8bdf-4173-a7c4-719fcce6f97e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.026159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be84bf9-8bdf-4173-a7c4-719fcce6f97e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.029067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 266/556] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:34.029809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be84bf9-8bdf-4173-a7c4-719fcce6f97e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.113981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12564342-4531-4f66-b7dc-dd3f4d87917a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.117180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:34.159417 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798a615-729e-4f5d-ba09-caddf590e596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.160732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798a615-729e-4f5d-ba09-caddf590e596 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.161696 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798a615-729e-4f5d-ba09-caddf590e596 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.162526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798a615-729e-4f5d-ba09-caddf590e596 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.163479 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798a615-729e-4f5d-ba09-caddf590e596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:34.164195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798a615-729e-4f5d-ba09-caddf590e596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.165292 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be84bf9-8bdf-4173-a7c4-719fcce6f97e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.167271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798a615-729e-4f5d-ba09-caddf590e596 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.178822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:34.181908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 291/557] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:34.183209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebd2ee-2448-4978-a9be-b56240907045 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.183507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebd2ee-2448-4978-a9be-b56240907045 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.183788 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebd2ee-2448-4978-a9be-b56240907045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.202618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1cebd2ee-2448-4978-a9be-b56240907045 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:34.203813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1cebd2ee-2448-4978-a9be-b56240907045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:34.209912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108e1f9-6673-45ca-a8b5-8598c5635070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.210549 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108e1f9-6673-45ca-a8b5-8598c5635070 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.210830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108e1f9-6673-45ca-a8b5-8598c5635070 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.211155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108e1f9-6673-45ca-a8b5-8598c5635070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.222998 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108e1f9-6673-45ca-a8b5-8598c5635070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.224427 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108e1f9-6673-45ca-a8b5-8598c5635070 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d108e1f9-6673-45ca-a8b5-8598c5635070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:34.240137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:34.241832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:34.242953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:34.242953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:34.242953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:34.242953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:34.245047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 267/558] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:34.247407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3903b4-8cfd-4dab-a4f0-95fde427d7e2 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.247688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3903b4-8cfd-4dab-a4f0-95fde427d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.247960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3903b4-8cfd-4dab-a4f0-95fde427d7e2 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.249273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 268/559] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:34.249955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3903b4-8cfd-4dab-a4f0-95fde427d7e2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.286239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 292/560] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:34.287369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebd2ee-2448-4978-a9be-b56240907045 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.363558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3903b4-8cfd-4dab-a4f0-95fde427d7e2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.398041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44f062-39b6-4c8f-93ab-51e3bde342a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.398333 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:34.398682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44f062-39b6-4c8f-93ab-51e3bde342a6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.398961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44f062-39b6-4c8f-93ab-51e3bde342a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.399236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44f062-39b6-4c8f-93ab-51e3bde342a6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.406697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebd2ee-2448-4978-a9be-b56240907045 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.408263 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44f062-39b6-4c8f-93ab-51e3bde342a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.409759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44f062-39b6-4c8f-93ab-51e3bde342a6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-da44f062-39b6-4c8f-93ab-51e3bde342a6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:34.421371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:34.422381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:34.423328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:34.423328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:34.423328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:34.423328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:34.423328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:34.423328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:34.423328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:34.423328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:34.423328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 01:20:34.423328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:34.423328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 269/561] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:34.423912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d84d3-fb6d-4c1f-bdcd-2e90d40cdbf4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.424084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d84d3-fb6d-4c1f-bdcd-2e90d40cdbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.424370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d84d3-fb6d-4c1f-bdcd-2e90d40cdbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.443594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a15d84d3-fb6d-4c1f-bdcd-2e90d40cdbf4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:34.444340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d93a6-055c-4daf-a418-70a623759764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.444787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a15d84d3-fb6d-4c1f-bdcd-2e90d40cdbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:34.444982 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d93a6-055c-4daf-a418-70a623759764 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.445264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d93a6-055c-4daf-a418-70a623759764 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.445539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d93a6-055c-4daf-a418-70a623759764 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.446237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d93a6-055c-4daf-a418-70a623759764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:34.446573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d93a6-055c-4daf-a418-70a623759764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.447931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d93a6-055c-4daf-a418-70a623759764 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.463566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 293/562] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:34.463566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d93a6-055c-4daf-a418-70a623759764 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.465858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:34.513547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 270/563] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:34.515084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf96fd1-857d-4fa3-a895-5d28955bf083 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.515372 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf96fd1-857d-4fa3-a895-5d28955bf083 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.515649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf96fd1-857d-4fa3-a895-5d28955bf083 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.516879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 271/564] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:34.517583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf96fd1-857d-4fa3-a895-5d28955bf083 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.573046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d93a6-055c-4daf-a418-70a623759764 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.605701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8df3c4-fbad-47d1-9e63-03a679929617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.606387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df3c4-fbad-47d1-9e63-03a679929617 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.606770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df3c4-fbad-47d1-9e63-03a679929617 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.607047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df3c4-fbad-47d1-9e63-03a679929617 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.616954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8df3c4-fbad-47d1-9e63-03a679929617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:34.618963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf96fd1-857d-4fa3-a895-5d28955bf083 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9c8df3c4-fbad-47d1-9e63-03a679929617 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:34.622895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:34.623865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:34.624719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 294/565] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:34.625458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8df3c4-fbad-47d1-9e63-03a679929617 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.641466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:34.657040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b145e9-9e8b-4200-a7cc-a41e3d40747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.657661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b145e9-9e8b-4200-a7cc-a41e3d40747d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.657947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b145e9-9e8b-4200-a7cc-a41e3d40747d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.658221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b145e9-9e8b-4200-a7cc-a41e3d40747d None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.659021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b145e9-9e8b-4200-a7cc-a41e3d40747d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:34.659331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b145e9-9e8b-4200-a7cc-a41e3d40747d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.660750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b145e9-9e8b-4200-a7cc-a41e3d40747d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.677698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 272/566] 10.222.0.15 () {56 vars in 1137 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:34.678957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac59f2-e451-41c0-ae90-c2089db87252 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.679251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac59f2-e451-41c0-ae90-c2089db87252 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.679527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac59f2-e451-41c0-ae90-c2089db87252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.696895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-03ac59f2-e451-41c0-ae90-c2089db87252 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:34.698105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-03ac59f2-e451-41c0-ae90-c2089db87252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:34.700826 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:34.731470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8df3c4-fbad-47d1-9e63-03a679929617 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.765554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41e26-4638-4a23-a67b-05ecc696adf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.766194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41e26-4638-4a23-a67b-05ecc696adf5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.766483 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41e26-4638-4a23-a67b-05ecc696adf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.766608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 273/567] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:34.766767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41e26-4638-4a23-a67b-05ecc696adf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.767338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac59f2-e451-41c0-ae90-c2089db87252 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.782273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b41e26-4638-4a23-a67b-05ecc696adf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.783734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b41e26-4638-4a23-a67b-05ecc696adf5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d8b41e26-4638-4a23-a67b-05ecc696adf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:34.796463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:34.797376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:34.798254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:34.798254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:34.798254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:34.798254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:34.798254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:34.798254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:34.798254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:34.798254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:34.798254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 295/568] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:34.798755 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41e26-4638-4a23-a67b-05ecc696adf5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.868223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac59f2-e451-41c0-ae90-c2089db87252 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.873790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:34.898729 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41e26-4638-4a23-a67b-05ecc696adf5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.900963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9d83b-8598-4637-b727-426db04eed71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.901596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9d83b-8598-4637-b727-426db04eed71 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.901869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9d83b-8598-4637-b727-426db04eed71 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.902140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9d83b-8598-4637-b727-426db04eed71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.910067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:34.913341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9d83b-8598-4637-b727-426db04eed71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-17f9d83b-8598-4637-b727-426db04eed71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:34.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:34.920049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:34.920881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 274/569] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:34.921610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9d83b-8598-4637-b727-426db04eed71 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.938203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad13931-0c0a-43a8-8a4c-82d5f6dda96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.938818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad13931-0c0a-43a8-8a4c-82d5f6dda96c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.939095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad13931-0c0a-43a8-8a4c-82d5f6dda96c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.939369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad13931-0c0a-43a8-8a4c-82d5f6dda96c None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.940087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad13931-0c0a-43a8-8a4c-82d5f6dda96c None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:34.940390 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad13931-0c0a-43a8-8a4c-82d5f6dda96c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.941770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad13931-0c0a-43a8-8a4c-82d5f6dda96c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.950853 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 296/570] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:34.951733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad13931-0c0a-43a8-8a4c-82d5f6dda96c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.022724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9d83b-8598-4637-b727-426db04eed71 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.056243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee842c-1bbb-41d9-acf7-a598dcfb5ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.056595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad13931-0c0a-43a8-8a4c-82d5f6dda96c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.056954 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee842c-1bbb-41d9-acf7-a598dcfb5ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.057243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee842c-1bbb-41d9-acf7-a598dcfb5ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.057521 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee842c-1bbb-41d9-acf7-a598dcfb5ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.067355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee842c-1bbb-41d9-acf7-a598dcfb5ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.068788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee842c-1bbb-41d9-acf7-a598dcfb5ca1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dfee842c-1bbb-41d9-acf7-a598dcfb5ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:35.084587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:35.085595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:35.086503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:35.086503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:35.086503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:35.086503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:35.086503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 275/571] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:35.086503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee842c-1bbb-41d9-acf7-a598dcfb5ca1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.092858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d921e-3597-4786-a527-eb78d1badac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.093528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d921e-3597-4786-a527-eb78d1badac9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.093810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d921e-3597-4786-a527-eb78d1badac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.094084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d921e-3597-4786-a527-eb78d1badac9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.096797 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:35.106826 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d921e-3597-4786-a527-eb78d1badac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-556d921e-3597-4786-a527-eb78d1badac9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:35.112232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:35.113414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 297/572] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:35.114438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d921e-3597-4786-a527-eb78d1badac9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.144720 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:35.191346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee842c-1bbb-41d9-acf7-a598dcfb5ca1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.214709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d921e-3597-4786-a527-eb78d1badac9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.225042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7a9d7-82f6-42fa-92a2-1476539f9909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.225658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7a9d7-82f6-42fa-92a2-1476539f9909 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.225941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7a9d7-82f6-42fa-92a2-1476539f9909 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.226216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7a9d7-82f6-42fa-92a2-1476539f9909 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.226964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7a9d7-82f6-42fa-92a2-1476539f9909 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:35.227271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7a9d7-82f6-42fa-92a2-1476539f9909 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.228687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7a9d7-82f6-42fa-92a2-1476539f9909 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.240747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 276/573] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:35.241620 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7a9d7-82f6-42fa-92a2-1476539f9909 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.249742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d17258-1bf0-417e-a034-d2252e66e534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.250355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17258-1bf0-417e-a034-d2252e66e534 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.250642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17258-1bf0-417e-a034-d2252e66e534 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.250919 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17258-1bf0-417e-a034-d2252e66e534 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.251639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d17258-1bf0-417e-a034-d2252e66e534 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:35.251949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d17258-1bf0-417e-a034-d2252e66e534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.253356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d17258-1bf0-417e-a034-d2252e66e534 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.265955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 298/574] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:35.265955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d17258-1bf0-417e-a034-d2252e66e534 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.319263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:35.342373 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7a9d7-82f6-42fa-92a2-1476539f9909 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.355140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:35.365138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d17258-1bf0-417e-a034-d2252e66e534 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.380602 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeae46-a1bc-4246-9d90-6ef10ed939ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.381289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeae46-a1bc-4246-9d90-6ef10ed939ea None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.381574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeae46-a1bc-4246-9d90-6ef10ed939ea None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.381844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeae46-a1bc-4246-9d90-6ef10ed939ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.392026 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eeae46-a1bc-4246-9d90-6ef10ed939ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.393493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eeae46-a1bc-4246-9d90-6ef10ed939ea None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.399225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff94169-2954-4558-99f3-eae0056149cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.399758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff94169-2954-4558-99f3-eae0056149cc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.400039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff94169-2954-4558-99f3-eae0056149cc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.400317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff94169-2954-4558-99f3-eae0056149cc None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.401037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff94169-2954-4558-99f3-eae0056149cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:35.401342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff94169-2954-4558-99f3-eae0056149cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.403196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff94169-2954-4558-99f3-eae0056149cc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-29eeae46-a1bc-4246-9d90-6ef10ed939ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:35.408712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:35.409779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:35.410693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:35.410693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:35.410693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:35.410693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:35.410693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 277/575] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:35.410693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeae46-a1bc-4246-9d90-6ef10ed939ea None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.416816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 299/576] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:35.417636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff94169-2954-4558-99f3-eae0056149cc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.510858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeae46-a1bc-4246-9d90-6ef10ed939ea None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.516912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff94169-2954-4558-99f3-eae0056149cc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.534447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:35.545274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fca5d-c0f5-4c06-af44-928d54148521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.545893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fca5d-c0f5-4c06-af44-928d54148521 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.546177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fca5d-c0f5-4c06-af44-928d54148521 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.546459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fca5d-c0f5-4c06-af44-928d54148521 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.547165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fca5d-c0f5-4c06-af44-928d54148521 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:35.547493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fca5d-c0f5-4c06-af44-928d54148521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.548839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fca5d-c0f5-4c06-af44-928d54148521 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.551928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7143e0-cf76-489b-a9d3-8f740a7021e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.552622 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7143e0-cf76-489b-a9d3-8f740a7021e4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.552999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7143e0-cf76-489b-a9d3-8f740a7021e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.553276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7143e0-cf76-489b-a9d3-8f740a7021e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.554063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7143e0-cf76-489b-a9d3-8f740a7021e4 None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=a8d43b9ceeba432db6d141bb52d4bf1e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:35.554373 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7143e0-cf76-489b-a9d3-8f740a7021e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.555790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7143e0-cf76-489b-a9d3-8f740a7021e4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.556602 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 278/577] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:35.557439 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fca5d-c0f5-4c06-af44-928d54148521 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.565586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 300/578] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/role_assignments?user.id=a8d43b9ceeba432db6d141bb52d4bf1e&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:35.566838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7143e0-cf76-489b-a9d3-8f740a7021e4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.588140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:35.675635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fca5d-c0f5-4c06-af44-928d54148521 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.691969 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7143e0-cf76-489b-a9d3-8f740a7021e4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.714703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896abe3e-0bf3-4d08-8adc-69433a6cb5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.716103 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896abe3e-0bf3-4d08-8adc-69433a6cb5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.716397 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896abe3e-0bf3-4d08-8adc-69433a6cb5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.716669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896abe3e-0bf3-4d08-8adc-69433a6cb5e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.731345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896abe3e-0bf3-4d08-8adc-69433a6cb5e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.732780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896abe3e-0bf3-4d08-8adc-69433a6cb5e6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.734085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0156d-8f75-462c-8ad1-8402f7ab9fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.735002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0156d-8f75-462c-8ad1-8402f7ab9fff None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.735562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0156d-8f75-462c-8ad1-8402f7ab9fff None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.735989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0156d-8f75-462c-8ad1-8402f7ab9fff None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.736839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0156d-8f75-462c-8ad1-8402f7ab9fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:35.737404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0156d-8f75-462c-8ad1-8402f7ab9fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.738965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0156d-8f75-462c-8ad1-8402f7ab9fff None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-896abe3e-0bf3-4d08-8adc-69433a6cb5e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:35.747769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:35.749499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:35.750964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:35.750964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:35.750964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:35.750964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:35.750964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 279/579] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:35.750964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896abe3e-0bf3-4d08-8adc-69433a6cb5e6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.756951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 301/580] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:35.758048 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0156d-8f75-462c-8ad1-8402f7ab9fff None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.811185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:35.836650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:35.864460 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896abe3e-0bf3-4d08-8adc-69433a6cb5e6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.872976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0156d-8f75-462c-8ad1-8402f7ab9fff None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.899153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fd248-e669-4b11-933d-a7061a4b6944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.899803 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fd248-e669-4b11-933d-a7061a4b6944 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.900093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fd248-e669-4b11-933d-a7061a4b6944 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.900374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fd248-e669-4b11-933d-a7061a4b6944 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.907872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979fd248-e669-4b11-933d-a7061a4b6944 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.909352 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979fd248-e669-4b11-933d-a7061a4b6944 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.909982 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942e6b2-83b1-41ea-87e5-b9540999944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.910788 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942e6b2-83b1-41ea-87e5-b9540999944f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.911220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942e6b2-83b1-41ea-87e5-b9540999944f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.911644 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942e6b2-83b1-41ea-87e5-b9540999944f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-979fd248-e669-4b11-933d-a7061a4b6944 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:35.920940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:35.922022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:35.923111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:35.923111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:35.923111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:35.923111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:35.923111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:35.923111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:35.923111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:35.923111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:35.923111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 280/581] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:35.923607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fd248-e669-4b11-933d-a7061a4b6944 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.925489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942e6b2-83b1-41ea-87e5-b9540999944f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.927456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942e6b2-83b1-41ea-87e5-b9540999944f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4942e6b2-83b1-41ea-87e5-b9540999944f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:35.943345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:35.944271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:35.945618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:35.945618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:35.945618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:35.945618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:35.945618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 302/582] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:35.945618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942e6b2-83b1-41ea-87e5-b9540999944f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.045072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fd248-e669-4b11-933d-a7061a4b6944 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.049075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:36.056191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942e6b2-83b1-41ea-87e5-b9540999944f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.084014 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282b7b8-3f9b-49f2-ab36-a991512e3763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.084732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282b7b8-3f9b-49f2-ab36-a991512e3763 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.085060 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282b7b8-3f9b-49f2-ab36-a991512e3763 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.085341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282b7b8-3f9b-49f2-ab36-a991512e3763 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.086037 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282b7b8-3f9b-49f2-ab36-a991512e3763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:36.086346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282b7b8-3f9b-49f2-ab36-a991512e3763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.087940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282b7b8-3f9b-49f2-ab36-a991512e3763 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.092692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42be8b-a275-4fd0-baa5-bc1f7a09d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.093353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42be8b-a275-4fd0-baa5-bc1f7a09d5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.093634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42be8b-a275-4fd0-baa5-bc1f7a09d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.093906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42be8b-a275-4fd0-baa5-bc1f7a09d5f6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.096197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:36.102120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42be8b-a275-4fd0-baa5-bc1f7a09d5f6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.103564 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42be8b-a275-4fd0-baa5-bc1f7a09d5f6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.107435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 281/583] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:36.108158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282b7b8-3f9b-49f2-ab36-a991512e3763 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5f42be8b-a275-4fd0-baa5-bc1f7a09d5f6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:36.116015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:36.116989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:36.117975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:36.117975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:36.117975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:36.117975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:36.117975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:36.117975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:36.117975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:36.117975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:36.117975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:20:36.117975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:36.117975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 303/584] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:36.117975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42be8b-a275-4fd0-baa5-bc1f7a09d5f6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.216826 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282b7b8-3f9b-49f2-ab36-a991512e3763 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.229231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42be8b-a275-4fd0-baa5-bc1f7a09d5f6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.255570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b7bdd-084a-4ceb-ab30-d2d930a7ab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.256193 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b7bdd-084a-4ceb-ab30-d2d930a7ab20 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.256470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b7bdd-084a-4ceb-ab30-d2d930a7ab20 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.256747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b7bdd-084a-4ceb-ab30-d2d930a7ab20 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.257551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b7bdd-084a-4ceb-ab30-d2d930a7ab20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:36.257930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b7bdd-084a-4ceb-ab30-d2d930a7ab20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.259266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b7bdd-084a-4ceb-ab30-d2d930a7ab20 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.265272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8a942-f12c-443b-b9d9-573a0e73727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.266064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8a942-f12c-443b-b9d9-573a0e73727e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.266501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8a942-f12c-443b-b9d9-573a0e73727e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.266928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8a942-f12c-443b-b9d9-573a0e73727e None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.267795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8a942-f12c-443b-b9d9-573a0e73727e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:36.268268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8a942-f12c-443b-b9d9-573a0e73727e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.269810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8a942-f12c-443b-b9d9-573a0e73727e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.271472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 282/585] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:36.272276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b7bdd-084a-4ceb-ab30-d2d930a7ab20 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.286473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 304/586] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:36.287305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8a942-f12c-443b-b9d9-573a0e73727e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.304429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:36.348280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:36.397646 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b7bdd-084a-4ceb-ab30-d2d930a7ab20 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.402082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8a942-f12c-443b-b9d9-573a0e73727e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.434225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f35dd-a4c0-4cfb-ad5b-8d2898280b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.434865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f35dd-a4c0-4cfb-ad5b-8d2898280b39 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.435214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f35dd-a4c0-4cfb-ad5b-8d2898280b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.435599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f35dd-a4c0-4cfb-ad5b-8d2898280b39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.441487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52b941-9914-4dc6-bc25-f4b76f6705f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.442301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52b941-9914-4dc6-bc25-f4b76f6705f2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.442758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52b941-9914-4dc6-bc25-f4b76f6705f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.443206 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f35dd-a4c0-4cfb-ad5b-8d2898280b39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.443323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52b941-9914-4dc6-bc25-f4b76f6705f2 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.444321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52b941-9914-4dc6-bc25-f4b76f6705f2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:36.444663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f35dd-a4c0-4cfb-ad5b-8d2898280b39 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.445408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52b941-9914-4dc6-bc25-f4b76f6705f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.446976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52b941-9914-4dc6-bc25-f4b76f6705f2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e97f35dd-a4c0-4cfb-ad5b-8d2898280b39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:36.456704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:36.457664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:36.458599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:36.458599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:36.458599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:36.458599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:36.458599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:36.458599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:36.458599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:36.458599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:36.458599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:20:36.458599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:36.458599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 283/587] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 6 01:20:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:36.458599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f35dd-a4c0-4cfb-ad5b-8d2898280b39 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.468120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 305/588] 10.222.0.15 () {56 vars in 1137 bytes} [Sat Aug 6 01:20:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:36.469165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52b941-9914-4dc6-bc25-f4b76f6705f2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.547406 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:36.570150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f35dd-a4c0-4cfb-ad5b-8d2898280b39 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.584043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52b941-9914-4dc6-bc25-f4b76f6705f2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.589612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:36.608284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd139e09-a0c8-400a-b13d-214899a84f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.608988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139e09-a0c8-400a-b13d-214899a84f99 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.609272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139e09-a0c8-400a-b13d-214899a84f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.609548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139e09-a0c8-400a-b13d-214899a84f99 None admin] PATH_INFO: `/v3/projects/c344ed6bac754173af05207b5f444dca/users/da39170a654d4d52a39b4b2c8cfd8906/roles/f053004b279b4e95a6123572360bd655` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.621267 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172289af-28ce-4820-803c-ddc0fcb9a7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.622053 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172289af-28ce-4820-803c-ddc0fcb9a7af None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.622403 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172289af-28ce-4820-803c-ddc0fcb9a7af None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.622741 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172289af-28ce-4820-803c-ddc0fcb9a7af None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.625224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd139e09-a0c8-400a-b13d-214899a84f99 None admin] RBAC: Authorizing `identity:create_grant(project_id=c344ed6bac754173af05207b5f444dca, user_id=da39170a654d4d52a39b4b2c8cfd8906, role_id=f053004b279b4e95a6123572360bd655)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.626735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd139e09-a0c8-400a-b13d-214899a84f99 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.630990 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172289af-28ce-4820-803c-ddc0fcb9a7af None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.632580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172289af-28ce-4820-803c-ddc0fcb9a7af None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-172289af-28ce-4820-803c-ddc0fcb9a7af None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:36.645377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:36.646520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:36.647618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:36.647618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:36.647618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:36.647618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:36.647618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:36.647618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:36.647618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:36.647618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:36.647618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 01:20:36.647618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:36.647618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 306/589] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:36.648332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172289af-28ce-4820-803c-ddc0fcb9a7af None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.653012 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 284/590] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:20:36 2022] PUT /identity/v3/projects/c344ed6bac754173af05207b5f444dca/users/da39170a654d4d52a39b4b2c8cfd8906/roles/f053004b279b4e95a6123572360bd655 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:36.654178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd139e09-a0c8-400a-b13d-214899a84f99 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.793144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd139e09-a0c8-400a-b13d-214899a84f99 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.795260 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172289af-28ce-4820-803c-ddc0fcb9a7af None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.833615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0894d-f77c-4820-95e7-5667cfed726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.834421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0894d-f77c-4820-95e7-5667cfed726f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.834801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0894d-f77c-4820-95e7-5667cfed726f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.835179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0894d-f77c-4820-95e7-5667cfed726f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.836467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:36.845921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b59c-6ee2-47cc-aeb9-868d6a918d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.846555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b59c-6ee2-47cc-aeb9-868d6a918d7a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.846848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b59c-6ee2-47cc-aeb9-868d6a918d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.847132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b59c-6ee2-47cc-aeb9-868d6a918d7a None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.847977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b59c-6ee2-47cc-aeb9-868d6a918d7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:36.848290 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b59c-6ee2-47cc-aeb9-868d6a918d7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.848886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0894d-f77c-4820-95e7-5667cfed726f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.849792 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b59c-6ee2-47cc-aeb9-868d6a918d7a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.850781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0894d-f77c-4820-95e7-5667cfed726f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d4f0894d-f77c-4820-95e7-5667cfed726f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:36.868813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:36.869816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:36.870711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:36.870711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:36.870711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:36.870711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:36.870711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 285/591] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:36.870995 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0894d-f77c-4820-95e7-5667cfed726f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.873318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 307/592] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 6 01:20:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:36.875537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b59c-6ee2-47cc-aeb9-868d6a918d7a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.909322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:36.979014 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b59c-6ee2-47cc-aeb9-868d6a918d7a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.986086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0894d-f77c-4820-95e7-5667cfed726f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:37.014561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05304b-3638-4702-a0d7-2f877f8224af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:37.015227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05304b-3638-4702-a0d7-2f877f8224af None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.015507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05304b-3638-4702-a0d7-2f877f8224af None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.015783 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05304b-3638-4702-a0d7-2f877f8224af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.027049 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05304b-3638-4702-a0d7-2f877f8224af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:37.029515 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05304b-3638-4702-a0d7-2f877f8224af None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:37.029967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635f3d4-adc8-4e32-88c2-42f7afa8c737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:37.030852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635f3d4-adc8-4e32-88c2-42f7afa8c737 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.031541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635f3d4-adc8-4e32-88c2-42f7afa8c737 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.032359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635f3d4-adc8-4e32-88c2-42f7afa8c737 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.033443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635f3d4-adc8-4e32-88c2-42f7afa8c737 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:37.033957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635f3d4-adc8-4e32-88c2-42f7afa8c737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:37.035567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635f3d4-adc8-4e32-88c2-42f7afa8c737 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0f05304b-3638-4702-a0d7-2f877f8224af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:37.046169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:37.047062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:37.047965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:37.047965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:37.047965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:37.047965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:37.051776 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 308/593] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:37.052641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05304b-3638-4702-a0d7-2f877f8224af None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:37.061252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 286/594] 10.222.0.15 () {56 vars in 1139 bytes} [Sat Aug 6 01:20:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:37.063081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635f3d4-adc8-4e32-88c2-42f7afa8c737 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:37.105275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:37.166221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05304b-3638-4702-a0d7-2f877f8224af None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:37.171442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:37.198856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635f3d4-adc8-4e32-88c2-42f7afa8c737 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:37.207485 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329a4d8-13ee-4625-8af1-71f5adb9721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:37.208453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329a4d8-13ee-4625-8af1-71f5adb9721a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.208740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329a4d8-13ee-4625-8af1-71f5adb9721a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.209050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329a4d8-13ee-4625-8af1-71f5adb9721a None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.209758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329a4d8-13ee-4625-8af1-71f5adb9721a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:37.210073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329a4d8-13ee-4625-8af1-71f5adb9721a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:37.211560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329a4d8-13ee-4625-8af1-71f5adb9721a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:37.225357 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 309/595] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:37.226196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329a4d8-13ee-4625-8af1-71f5adb9721a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:37.242458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d7370-09da-446c-bc21-ac845c7183ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:37.243679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d7370-09da-446c-bc21-ac845c7183ea None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.244667 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d7370-09da-446c-bc21-ac845c7183ea None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.245427 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d7370-09da-446c-bc21-ac845c7183ea None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.246638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d7370-09da-446c-bc21-ac845c7183ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:37.247232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d7370-09da-446c-bc21-ac845c7183ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:37.249224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d7370-09da-446c-bc21-ac845c7183ea None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:37.266746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 287/596] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:37.267933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d7370-09da-446c-bc21-ac845c7183ea None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:37.343667 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329a4d8-13ee-4625-8af1-71f5adb9721a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:37.345367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:37.384090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf29cc-905b-4c4b-b233-dd8b8dcbfef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:37.384741 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf29cc-905b-4c4b-b233-dd8b8dcbfef5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.385063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf29cc-905b-4c4b-b233-dd8b8dcbfef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.385346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf29cc-905b-4c4b-b233-dd8b8dcbfef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.398137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf29cc-905b-4c4b-b233-dd8b8dcbfef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:37.399757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf29cc-905b-4c4b-b233-dd8b8dcbfef5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:37.412155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d7370-09da-446c-bc21-ac845c7183ea None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-53cf29cc-905b-4c4b-b233-dd8b8dcbfef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:37.416937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:37.417803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:37.418837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:37.418837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:37.418837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:37.418837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:37.418837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 310/597] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:37.419228 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf29cc-905b-4c4b-b233-dd8b8dcbfef5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:37.464139 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0bfdf-3ba9-48f1-aab8-629d42a5d0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:37.465870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0bfdf-3ba9-48f1-aab8-629d42a5d0ea None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.466161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0bfdf-3ba9-48f1-aab8-629d42a5d0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.466433 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0bfdf-3ba9-48f1-aab8-629d42a5d0ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.477142 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0bfdf-3ba9-48f1-aab8-629d42a5d0ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:37.479639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0bfdf-3ba9-48f1-aab8-629d42a5d0ea None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:37.482120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-46a0bfdf-3ba9-48f1-aab8-629d42a5d0ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:37.498774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:37.499746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:37.500655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:37.500655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:37.500655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:37.500655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:37.500655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:37.500655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:37.500655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:37.500655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:37.503470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 288/598] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:37.504426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0bfdf-3ba9-48f1-aab8-629d42a5d0ea None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:37.541562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf29cc-905b-4c4b-b233-dd8b8dcbfef5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:37.579538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea28f86-6ddd-48f8-80ec-43acd4f7f9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:37.580402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea28f86-6ddd-48f8-80ec-43acd4f7f9df None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.581057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea28f86-6ddd-48f8-80ec-43acd4f7f9df None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.581193 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea28f86-6ddd-48f8-80ec-43acd4f7f9df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.588274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea28f86-6ddd-48f8-80ec-43acd4f7f9df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:37.589954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea28f86-6ddd-48f8-80ec-43acd4f7f9df None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6ea28f86-6ddd-48f8-80ec-43acd4f7f9df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:37.602141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:37.603202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:37.604249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:37.604249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:37.604249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:37.604249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:37.604249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:37.604249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:37.604249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:37.604249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:37.611278 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 311/599] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:37.612004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea28f86-6ddd-48f8-80ec-43acd4f7f9df None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:37.631055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:37.643379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0bfdf-3ba9-48f1-aab8-629d42a5d0ea None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:37.680509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e6448-46bc-4145-8f7b-7e4eb6c53f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:37.681148 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e6448-46bc-4145-8f7b-7e4eb6c53f60 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.681430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e6448-46bc-4145-8f7b-7e4eb6c53f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.681700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e6448-46bc-4145-8f7b-7e4eb6c53f60 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.682387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e6448-46bc-4145-8f7b-7e4eb6c53f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:37.682691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e6448-46bc-4145-8f7b-7e4eb6c53f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:37.684743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e6448-46bc-4145-8f7b-7e4eb6c53f60 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:37.698783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 289/600] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:37.701024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e6448-46bc-4145-8f7b-7e4eb6c53f60 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:37.724742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea28f86-6ddd-48f8-80ec-43acd4f7f9df None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:37.760538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ab222-acb2-4b25-9e78-8910ab0d790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:37.761197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ab222-acb2-4b25-9e78-8910ab0d790e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.761478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ab222-acb2-4b25-9e78-8910ab0d790e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.761755 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ab222-acb2-4b25-9e78-8910ab0d790e None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.762731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ab222-acb2-4b25-9e78-8910ab0d790e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:37.763062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ab222-acb2-4b25-9e78-8910ab0d790e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:37.763366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:37.764776 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ab222-acb2-4b25-9e78-8910ab0d790e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:37.777859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 312/601] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:37.778921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90020e54-2f36-44b3-9ac2-43cfcba2077e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.779214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90020e54-2f36-44b3-9ac2-43cfcba2077e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.779490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90020e54-2f36-44b3-9ac2-43cfcba2077e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.784839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 313/602] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:37.784839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90020e54-2f36-44b3-9ac2-43cfcba2077e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:37.814346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e6448-46bc-4145-8f7b-7e4eb6c53f60 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:37.852516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708411ef-1f56-4314-9ab9-e5d7978432da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:37.853248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708411ef-1f56-4314-9ab9-e5d7978432da None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.853635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708411ef-1f56-4314-9ab9-e5d7978432da None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.854002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708411ef-1f56-4314-9ab9-e5d7978432da None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.854761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708411ef-1f56-4314-9ab9-e5d7978432da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:37.855069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708411ef-1f56-4314-9ab9-e5d7978432da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:37.857211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708411ef-1f56-4314-9ab9-e5d7978432da None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:37.868542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:37.874889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 290/603] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:37.874889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708411ef-1f56-4314-9ab9-e5d7978432da None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:37.905460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90020e54-2f36-44b3-9ac2-43cfcba2077e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:37.948139 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb174232-e974-4ef5-9bdb-ba2b2ea74981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:37.948790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb174232-e974-4ef5-9bdb-ba2b2ea74981 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.949112 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb174232-e974-4ef5-9bdb-ba2b2ea74981 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.949384 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb174232-e974-4ef5-9bdb-ba2b2ea74981 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.956653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb174232-e974-4ef5-9bdb-ba2b2ea74981 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:37.958128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb174232-e974-4ef5-9bdb-ba2b2ea74981 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-eb174232-e974-4ef5-9bdb-ba2b2ea74981 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:37.969659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:37.970585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:37.971473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:37.971473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:37.971473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:37.971473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:37.971473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:37.971473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:37.971473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:37.971473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:37.971473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 314/604] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:37.971961 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0153c3-91a4-4042-a2b6-4b572419fde5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:37.973044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0153c3-91a4-4042-a2b6-4b572419fde5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:37.973044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0153c3-91a4-4042-a2b6-4b572419fde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:37.989912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708411ef-1f56-4314-9ab9-e5d7978432da None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:37.990651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ad0153c3-91a4-4042-a2b6-4b572419fde5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:37.991836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ad0153c3-91a4-4042-a2b6-4b572419fde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:38.008552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:38.027103 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792a6e-a769-48de-bdea-5813c256cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:38.027920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792a6e-a769-48de-bdea-5813c256cd29 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.028335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792a6e-a769-48de-bdea-5813c256cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.028616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1792a6e-a769-48de-bdea-5813c256cd29 None admin] PATH_INFO: `/v3/projects/c344ed6bac754173af05207b5f444dca/users/acd6aba844f04489adec2ce9f1eb49dd/roles/f053004b279b4e95a6123572360bd655` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.044938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1792a6e-a769-48de-bdea-5813c256cd29 None admin] RBAC: Authorizing `identity:create_grant(project_id=c344ed6bac754173af05207b5f444dca, user_id=acd6aba844f04489adec2ce9f1eb49dd, role_id=f053004b279b4e95a6123572360bd655)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:38.046605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1792a6e-a769-48de-bdea-5813c256cd29 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:38.072945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 291/605] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:20:37 2022] PUT /identity/v3/projects/c344ed6bac754173af05207b5f444dca/users/acd6aba844f04489adec2ce9f1eb49dd/roles/f053004b279b4e95a6123572360bd655 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:38.072945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792a6e-a769-48de-bdea-5813c256cd29 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:38.077069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 315/606] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:38.078072 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0153c3-91a4-4042-a2b6-4b572419fde5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:38.176528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:38.230605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1792a6e-a769-48de-bdea-5813c256cd29 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:38.234889 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0153c3-91a4-4042-a2b6-4b572419fde5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:38.271582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f75dc-e91f-49d6-b3d6-bfbc120dbee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:38.271582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f75dc-e91f-49d6-b3d6-bfbc120dbee7 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.271899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f75dc-e91f-49d6-b3d6-bfbc120dbee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.271988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f75dc-e91f-49d6-b3d6-bfbc120dbee7 None admin] PATH_INFO: `/v3/projects/c344ed6bac754173af05207b5f444dca/users/666f4864832445d5a10d60f677f5cd6c/roles/f053004b279b4e95a6123572360bd655` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.274692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30ee9-9d4a-44cf-88ef-1abf9bbd2b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:38.276247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30ee9-9d4a-44cf-88ef-1abf9bbd2b64 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.276644 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30ee9-9d4a-44cf-88ef-1abf9bbd2b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.277303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30ee9-9d4a-44cf-88ef-1abf9bbd2b64 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.278468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf30ee9-9d4a-44cf-88ef-1abf9bbd2b64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:38.279064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf30ee9-9d4a-44cf-88ef-1abf9bbd2b64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:38.281074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf30ee9-9d4a-44cf-88ef-1abf9bbd2b64 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:38.288532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f75dc-e91f-49d6-b3d6-bfbc120dbee7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c344ed6bac754173af05207b5f444dca, user_id=666f4864832445d5a10d60f677f5cd6c, role_id=f053004b279b4e95a6123572360bd655)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:38.290137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f75dc-e91f-49d6-b3d6-bfbc120dbee7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:38.296656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 316/607] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:38.297815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30ee9-9d4a-44cf-88ef-1abf9bbd2b64 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:38.311731 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 292/608] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:20:38 2022] PUT /identity/v3/projects/c344ed6bac754173af05207b5f444dca/users/666f4864832445d5a10d60f677f5cd6c/roles/f053004b279b4e95a6123572360bd655 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:38.312570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f75dc-e91f-49d6-b3d6-bfbc120dbee7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:38.365403 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:38.434414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30ee9-9d4a-44cf-88ef-1abf9bbd2b64 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:38.463818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:38.477838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715f9f6-4742-46b6-903f-558c444312f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:38.478962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715f9f6-4742-46b6-903f-558c444312f0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.479253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715f9f6-4742-46b6-903f-558c444312f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.479531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715f9f6-4742-46b6-903f-558c444312f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.492770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715f9f6-4742-46b6-903f-558c444312f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c715f9f6-4742-46b6-903f-558c444312f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:38.500574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:38.501575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:38.502430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 317/609] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:38.509506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715f9f6-4742-46b6-903f-558c444312f0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:38.533028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f75dc-e91f-49d6-b3d6-bfbc120dbee7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:38.574001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b73f31-5217-4fd6-a2f3-dc380711ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:38.575233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b73f31-5217-4fd6-a2f3-dc380711ade9 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.575513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b73f31-5217-4fd6-a2f3-dc380711ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.575787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b73f31-5217-4fd6-a2f3-dc380711ade9 None admin] PATH_INFO: `/v3/projects/c344ed6bac754173af05207b5f444dca/users/403beb9eb6c04cc69579361138bea12d/roles/f053004b279b4e95a6123572360bd655` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.593106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b73f31-5217-4fd6-a2f3-dc380711ade9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c344ed6bac754173af05207b5f444dca, user_id=403beb9eb6c04cc69579361138bea12d, role_id=f053004b279b4e95a6123572360bd655)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:38.594620 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b73f31-5217-4fd6-a2f3-dc380711ade9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:38.615683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 293/610] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:20:38 2022] PUT /identity/v3/projects/c344ed6bac754173af05207b5f444dca/users/403beb9eb6c04cc69579361138bea12d/roles/f053004b279b4e95a6123572360bd655 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:38.649645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715f9f6-4742-46b6-903f-558c444312f0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:38.687934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12177c-42b7-4743-892b-c7742f5f9b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:38.688480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12177c-42b7-4743-892b-c7742f5f9b14 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.688818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12177c-42b7-4743-892b-c7742f5f9b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.689131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12177c-42b7-4743-892b-c7742f5f9b14 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.689868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12177c-42b7-4743-892b-c7742f5f9b14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:38.690177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12177c-42b7-4743-892b-c7742f5f9b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:38.691567 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12177c-42b7-4743-892b-c7742f5f9b14 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:38.702005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 318/611] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:38.707703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b73f31-5217-4fd6-a2f3-dc380711ade9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:38.822347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:38.870897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b73f31-5217-4fd6-a2f3-dc380711ade9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:38.919992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aadb24-840c-48b3-ba96-b956a0dab5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:38.920646 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aadb24-840c-48b3-ba96-b956a0dab5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.920952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aadb24-840c-48b3-ba96-b956a0dab5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.921235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aadb24-840c-48b3-ba96-b956a0dab5a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.932111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aadb24-840c-48b3-ba96-b956a0dab5a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:38.933691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aadb24-840c-48b3-ba96-b956a0dab5a2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-93aadb24-840c-48b3-ba96-b956a0dab5a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:38.950627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:38.952656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:38.954801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:38.954801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:38.954801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:38.954801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:38.954801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 294/612] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:38.958655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12177c-42b7-4743-892b-c7742f5f9b14 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:39.002021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694f651-d375-4834-a59b-5190982ea9fe None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:39.002350 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694f651-d375-4834-a59b-5190982ea9fe None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:39.002589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694f651-d375-4834-a59b-5190982ea9fe None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:39.004200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 295/613] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:20:39.012921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ee2d8-e4bc-4fb2-9337-9ed9764e1f94 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:39.012921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ee2d8-e4bc-4fb2-9337-9ed9764e1f94 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:39.012921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ee2d8-e4bc-4fb2-9337-9ed9764e1f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:39.017491 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:39.033691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7d0ee2d8-e4bc-4fb2-9337-9ed9764e1f94 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:39.035324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7d0ee2d8-e4bc-4fb2-9337-9ed9764e1f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:39.123115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12177c-42b7-4743-892b-c7742f5f9b14 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:39.205016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277a2ec-a78b-4d5a-9340-27b9e6a33964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:39.205016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277a2ec-a78b-4d5a-9340-27b9e6a33964 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:39.205016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277a2ec-a78b-4d5a-9340-27b9e6a33964 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:39.205016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277a2ec-a78b-4d5a-9340-27b9e6a33964 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:39.205427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277a2ec-a78b-4d5a-9340-27b9e6a33964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:39.205427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277a2ec-a78b-4d5a-9340-27b9e6a33964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:39.205427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277a2ec-a78b-4d5a-9340-27b9e6a33964 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:39.221510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 319/614] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:39.227417 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277a2ec-a78b-4d5a-9340-27b9e6a33964 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:39.237228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 296/615] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:39.299919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ee2d8-e4bc-4fb2-9337-9ed9764e1f94 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:39.398116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:39.428270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277a2ec-a78b-4d5a-9340-27b9e6a33964 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:39.445482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:39.499240 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65ed52-4982-4335-90e5-9aaa59a6ad80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:39.500885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65ed52-4982-4335-90e5-9aaa59a6ad80 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:39.501409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65ed52-4982-4335-90e5-9aaa59a6ad80 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:39.502507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65ed52-4982-4335-90e5-9aaa59a6ad80 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:39.508310 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ee2d8-e4bc-4fb2-9337-9ed9764e1f94 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:39.516242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65ed52-4982-4335-90e5-9aaa59a6ad80 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:39.522490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65ed52-4982-4335-90e5-9aaa59a6ad80 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6d65ed52-4982-4335-90e5-9aaa59a6ad80 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:39.544042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:39.545214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:39.546351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:39.546351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:39.546351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:39.546351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:39.546351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:39.546351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:39.546351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:39.546351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:39.546351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:20:39.546351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:39.552473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 320/616] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:20:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:39.556805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65ed52-4982-4335-90e5-9aaa59a6ad80 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:39.582791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb0fe0-373c-4c75-8145-0d5cff8ca1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:39.583431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb0fe0-373c-4c75-8145-0d5cff8ca1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:39.583720 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb0fe0-373c-4c75-8145-0d5cff8ca1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:39.583996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb0fe0-373c-4c75-8145-0d5cff8ca1f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:39.603912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb0fe0-373c-4c75-8145-0d5cff8ca1f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-29fb0fe0-373c-4c75-8145-0d5cff8ca1f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:39.612298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:39.613273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:39.614110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:39.614110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:39.614110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:39.614110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:39.614110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:39.614110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:39.614110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:39.614110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:39.614110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:39.614110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:39.614110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:39.614110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:39.615280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 297/617] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:39.625366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb0fe0-373c-4c75-8145-0d5cff8ca1f0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:39.698640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65ed52-4982-4335-90e5-9aaa59a6ad80 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:39.741418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15afe2-09e4-4b5f-a627-c6d5ad3cdded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:39.742565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15afe2-09e4-4b5f-a627-c6d5ad3cdded None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:39.743096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15afe2-09e4-4b5f-a627-c6d5ad3cdded None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:39.743567 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15afe2-09e4-4b5f-a627-c6d5ad3cdded None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:39.744563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15afe2-09e4-4b5f-a627-c6d5ad3cdded None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:39.747998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15afe2-09e4-4b5f-a627-c6d5ad3cdded None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:39.751225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15afe2-09e4-4b5f-a627-c6d5ad3cdded None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:39.790773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 321/618] 10.222.0.15 () {56 vars in 1135 bytes} [Sat Aug 6 01:20:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:39.798670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15afe2-09e4-4b5f-a627-c6d5ad3cdded None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:39.857926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:39.883709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb0fe0-373c-4c75-8145-0d5cff8ca1f0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:39.912170 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:39.968249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1893b50-f0e0-4cc9-b76c-af643ff75502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:39.968886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1893b50-f0e0-4cc9-b76c-af643ff75502 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:39.969192 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1893b50-f0e0-4cc9-b76c-af643ff75502 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:39.969469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1893b50-f0e0-4cc9-b76c-af643ff75502 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:39.970193 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1893b50-f0e0-4cc9-b76c-af643ff75502 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:39.970503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1893b50-f0e0-4cc9-b76c-af643ff75502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:39.971865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1893b50-f0e0-4cc9-b76c-af643ff75502 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:39.981857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15afe2-09e4-4b5f-a627-c6d5ad3cdded None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:39.987825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 298/619] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:39.997988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1893b50-f0e0-4cc9-b76c-af643ff75502 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.055681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1b91-acfe-4498-a8b1-46010d96a1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.056944 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1b91-acfe-4498-a8b1-46010d96a1fc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.058538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1b91-acfe-4498-a8b1-46010d96a1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.059256 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1b91-acfe-4498-a8b1-46010d96a1fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.078982 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa1b91-acfe-4498-a8b1-46010d96a1fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.081522 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa1b91-acfe-4498-a8b1-46010d96a1fc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b3aa1b91-acfe-4498-a8b1-46010d96a1fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:40.112554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:40.113719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:40.114613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:40.114613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:40.114613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:40.114613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:40.116570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 322/620] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:40.122463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1b91-acfe-4498-a8b1-46010d96a1fc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.205632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:40.207432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1893b50-f0e0-4cc9-b76c-af643ff75502 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.233881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1b91-acfe-4498-a8b1-46010d96a1fc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.258646 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561db33-479e-40fa-bb5d-8b3e90ae2586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.259320 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561db33-479e-40fa-bb5d-8b3e90ae2586 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.259607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561db33-479e-40fa-bb5d-8b3e90ae2586 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.259886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561db33-479e-40fa-bb5d-8b3e90ae2586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.271225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9477d-747d-4948-9c03-2677f1115477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.271967 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9477d-747d-4948-9c03-2677f1115477 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.272350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9477d-747d-4948-9c03-2677f1115477 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.272770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9477d-747d-4948-9c03-2677f1115477 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.273590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9477d-747d-4948-9c03-2677f1115477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:40.273992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9477d-747d-4948-9c03-2677f1115477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.275588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9477d-747d-4948-9c03-2677f1115477 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.282958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561db33-479e-40fa-bb5d-8b3e90ae2586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.284419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561db33-479e-40fa-bb5d-8b3e90ae2586 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.293011 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 323/621] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:40.295328 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9477d-747d-4948-9c03-2677f1115477 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b561db33-479e-40fa-bb5d-8b3e90ae2586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:40.311496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:40.312598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:40.313728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:40.313728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:40.313728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:40.313728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:40.318457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 299/622] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:40.321829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561db33-479e-40fa-bb5d-8b3e90ae2586 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.405391 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9477d-747d-4948-9c03-2677f1115477 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.409925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:40.442726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1b946-25c4-4a96-aa1f-41f51a6bb78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.443849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1b946-25c4-4a96-aa1f-41f51a6bb78e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.444463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1b946-25c4-4a96-aa1f-41f51a6bb78e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.445006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1b946-25c4-4a96-aa1f-41f51a6bb78e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.452233 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1b946-25c4-4a96-aa1f-41f51a6bb78e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.453938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1b946-25c4-4a96-aa1f-41f51a6bb78e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-2cf1b946-25c4-4a96-aa1f-41f51a6bb78e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:40.466786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:40.467720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:40.468602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:40.468602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:40.468602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:40.468602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:40.468602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:40.468602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:40.468602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:40.468602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:40.471194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 324/623] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:40.475899 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:40.477135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1b946-25c4-4a96-aa1f-41f51a6bb78e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.568487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561db33-479e-40fa-bb5d-8b3e90ae2586 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.597992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1b946-25c4-4a96-aa1f-41f51a6bb78e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.604507 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76609e8-8229-450f-b700-2094b2b4f260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.605282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76609e8-8229-450f-b700-2094b2b4f260 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.606233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76609e8-8229-450f-b700-2094b2b4f260 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.606638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76609e8-8229-450f-b700-2094b2b4f260 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.607443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76609e8-8229-450f-b700-2094b2b4f260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:40.607857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76609e8-8229-450f-b700-2094b2b4f260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.609353 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76609e8-8229-450f-b700-2094b2b4f260 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.622604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 300/624] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:40.624106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddc167-4843-45a0-949f-a82c4b885736 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.624499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddc167-4843-45a0-949f-a82c4b885736 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.624890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddc167-4843-45a0-949f-a82c4b885736 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.626606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 301/625] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:40.631282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddc167-4843-45a0-949f-a82c4b885736 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.638293 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f5aa6-b34f-4ecd-95d8-5e36967ff215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.638925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f5aa6-b34f-4ecd-95d8-5e36967ff215 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.639464 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f5aa6-b34f-4ecd-95d8-5e36967ff215 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.639742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f5aa6-b34f-4ecd-95d8-5e36967ff215 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.640500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f5aa6-b34f-4ecd-95d8-5e36967ff215 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:40.640812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f5aa6-b34f-4ecd-95d8-5e36967ff215 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.642284 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f5aa6-b34f-4ecd-95d8-5e36967ff215 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.654766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 325/626] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:40.656045 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893a3f-95c9-4091-ab77-017da5932064 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.656334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893a3f-95c9-4091-ab77-017da5932064 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.656607 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88893a3f-95c9-4091-ab77-017da5932064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.675763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-88893a3f-95c9-4091-ab77-017da5932064 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:40.676977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-88893a3f-95c9-4091-ab77-017da5932064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:40.724307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:40.741311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:40.742801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddc167-4843-45a0-949f-a82c4b885736 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.757813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 326/627] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:40.758951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88893a3f-95c9-4091-ab77-017da5932064 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.787676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d4d64-e14b-4be7-8276-7b476a320baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.788337 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d4d64-e14b-4be7-8276-7b476a320baf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.788621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d4d64-e14b-4be7-8276-7b476a320baf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.788933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d4d64-e14b-4be7-8276-7b476a320baf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.802943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d4d64-e14b-4be7-8276-7b476a320baf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.805107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d4d64-e14b-4be7-8276-7b476a320baf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8a4d4d64-e14b-4be7-8276-7b476a320baf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:40.821307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:40.822360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:40.823333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:40.823333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:40.823333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:40.823333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:40.823333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:40.823333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:40.823333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:40.823333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:40.823333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 01:20:40.823333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:40.826528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 302/628] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:40.828073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d4d64-e14b-4be7-8276-7b476a320baf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.901609 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88893a3f-95c9-4091-ab77-017da5932064 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.941206 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d4d64-e14b-4be7-8276-7b476a320baf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.944586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aac907-586a-4952-92dc-6fb1b1d98b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.945321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aac907-586a-4952-92dc-6fb1b1d98b7c None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.945780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aac907-586a-4952-92dc-6fb1b1d98b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.945888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aac907-586a-4952-92dc-6fb1b1d98b7c None admin] PATH_INFO: `/v3/projects/c344ed6bac754173af05207b5f444dca/users/a8d43b9ceeba432db6d141bb52d4bf1e/roles/f053004b279b4e95a6123572360bd655` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.961171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aac907-586a-4952-92dc-6fb1b1d98b7c None admin] RBAC: Authorizing `identity:create_grant(project_id=c344ed6bac754173af05207b5f444dca, user_id=a8d43b9ceeba432db6d141bb52d4bf1e, role_id=f053004b279b4e95a6123572360bd655)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.962603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aac907-586a-4952-92dc-6fb1b1d98b7c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.977175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 327/629] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:20:40 2022] PUT /identity/v3/projects/c344ed6bac754173af05207b5f444dca/users/a8d43b9ceeba432db6d141bb52d4bf1e/roles/f053004b279b4e95a6123572360bd655 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:40.977864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aac907-586a-4952-92dc-6fb1b1d98b7c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.989713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cddad9-cf51-4c47-bd33-dfafa3c62ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.991339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cddad9-cf51-4c47-bd33-dfafa3c62ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.991841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cddad9-cf51-4c47-bd33-dfafa3c62ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.992784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cddad9-cf51-4c47-bd33-dfafa3c62ff5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.011269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cddad9-cf51-4c47-bd33-dfafa3c62ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-84cddad9-cf51-4c47-bd33-dfafa3c62ff5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:41.022394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:41.023437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:41.024288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:41.024288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:41.024288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:41.024288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:41.024288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:41.024288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:41.024288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:41.024288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:41.024288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:41.024288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:41.024288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:41.024288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:41.033246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 303/630] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:41.033246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49e183-39f0-4f08-85d6-a04e56a351d4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.033246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49e183-39f0-4f08-85d6-a04e56a351d4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.033246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49e183-39f0-4f08-85d6-a04e56a351d4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.033246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 304/631] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:41.034512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:41.037583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49e183-39f0-4f08-85d6-a04e56a351d4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:41.045069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:41.119697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aac907-586a-4952-92dc-6fb1b1d98b7c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:41.160654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1e535-dee7-40a9-b034-77a50e208039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:41.161472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1e535-dee7-40a9-b034-77a50e208039 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.161585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1e535-dee7-40a9-b034-77a50e208039 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.161848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1e535-dee7-40a9-b034-77a50e208039 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.162686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1e535-dee7-40a9-b034-77a50e208039 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:41.162979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1e535-dee7-40a9-b034-77a50e208039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:41.164410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1e535-dee7-40a9-b034-77a50e208039 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:41.169297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49e183-39f0-4f08-85d6-a04e56a351d4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:41.183550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 328/632] 10.222.0.15 () {56 vars in 1137 bytes} [Sat Aug 6 01:20:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:41.185733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a3511-974f-495e-b8d5-5f5ff18b0edf None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.185922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a3511-974f-495e-b8d5-5f5ff18b0edf None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.186204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a3511-974f-495e-b8d5-5f5ff18b0edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.205416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-379a3511-974f-495e-b8d5-5f5ff18b0edf None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:41.206130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95158568-0ff6-448e-af12-85e9cceb43ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:41.206612 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-379a3511-974f-495e-b8d5-5f5ff18b0edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:41.207226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95158568-0ff6-448e-af12-85e9cceb43ac None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.207713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95158568-0ff6-448e-af12-85e9cceb43ac None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.208199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95158568-0ff6-448e-af12-85e9cceb43ac None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.209154 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95158568-0ff6-448e-af12-85e9cceb43ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:41.209670 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95158568-0ff6-448e-af12-85e9cceb43ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:41.211127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95158568-0ff6-448e-af12-85e9cceb43ac None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:41.220777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 305/633] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:41.221838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95158568-0ff6-448e-af12-85e9cceb43ac None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:41.278879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 329/634] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:41.280298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba60e9a-fe05-47c1-a845-4ae5a7030fd8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.280650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba60e9a-fe05-47c1-a845-4ae5a7030fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.281029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba60e9a-fe05-47c1-a845-4ae5a7030fd8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.282340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 330/635] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:41.283092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba60e9a-fe05-47c1-a845-4ae5a7030fd8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:41.302854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:41.312436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:41.342281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95158568-0ff6-448e-af12-85e9cceb43ac None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:41.385756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f99b9-4882-44f8-abe9-0072b5050e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:41.386388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f99b9-4882-44f8-abe9-0072b5050e6e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.386699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f99b9-4882-44f8-abe9-0072b5050e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.387040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f99b9-4882-44f8-abe9-0072b5050e6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.395909 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba60e9a-fe05-47c1-a845-4ae5a7030fd8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:41.430989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9a084-4a59-43ae-bc8d-f9c3bf433dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:41.431631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9a084-4a59-43ae-bc8d-f9c3bf433dce None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.431917 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9a084-4a59-43ae-bc8d-f9c3bf433dce None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.432194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9a084-4a59-43ae-bc8d-f9c3bf433dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.442342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9a084-4a59-43ae-bc8d-f9c3bf433dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:41.443807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9a084-4a59-43ae-bc8d-f9c3bf433dce None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a6e9a084-4a59-43ae-bc8d-f9c3bf433dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:41.459586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:41.460510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:41.461462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:41.461462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:41.461462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:41.461462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:41.461462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 331/636] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:41.462040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b8297-9750-45a3-90c6-5b68db58c9ca None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.462171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b8297-9750-45a3-90c6-5b68db58c9ca None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.462439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b8297-9750-45a3-90c6-5b68db58c9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.467492 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f99b9-4882-44f8-abe9-0072b5050e6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:41.468960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f99b9-4882-44f8-abe9-0072b5050e6e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:41.483577 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-804b8297-9750-45a3-90c6-5b68db58c9ca None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:41.484754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-804b8297-9750-45a3-90c6-5b68db58c9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:41.542138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:41.555833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 332/637] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:41.556501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b8297-9750-45a3-90c6-5b68db58c9ca None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:41.564752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:41.586910 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 306/638] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:41.588133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f99b9-4882-44f8-abe9-0072b5050e6e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:41.664524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b8297-9750-45a3-90c6-5b68db58c9ca None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:41.691493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f99b9-4882-44f8-abe9-0072b5050e6e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:41.703125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c352623-ca22-49cd-addc-891cb858792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:41.704263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c352623-ca22-49cd-addc-891cb858792d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.704803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c352623-ca22-49cd-addc-891cb858792d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.705114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c352623-ca22-49cd-addc-891cb858792d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.716534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c352623-ca22-49cd-addc-891cb858792d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6c352623-ca22-49cd-addc-891cb858792d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:41.721480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:41.722427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:41.723346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 333/639] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:41.724045 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c352623-ca22-49cd-addc-891cb858792d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:41.734017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac36e2c-35eb-4310-b0ff-41fd0a56450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:41.734935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac36e2c-35eb-4310-b0ff-41fd0a56450a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.735390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac36e2c-35eb-4310-b0ff-41fd0a56450a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.735836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac36e2c-35eb-4310-b0ff-41fd0a56450a None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.736703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac36e2c-35eb-4310-b0ff-41fd0a56450a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:41.737615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac36e2c-35eb-4310-b0ff-41fd0a56450a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:41.739529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac36e2c-35eb-4310-b0ff-41fd0a56450a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:41.755872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 307/640] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:41.757590 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac36e2c-35eb-4310-b0ff-41fd0a56450a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:41.791447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:41.801028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:41.838557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c352623-ca22-49cd-addc-891cb858792d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:41.874227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac36e2c-35eb-4310-b0ff-41fd0a56450a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:41.876811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6564051-e032-49c2-b399-b5bed5a886bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:41.877565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6564051-e032-49c2-b399-b5bed5a886bd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.877879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6564051-e032-49c2-b399-b5bed5a886bd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.878110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6564051-e032-49c2-b399-b5bed5a886bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.888425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6564051-e032-49c2-b399-b5bed5a886bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d6564051-e032-49c2-b399-b5bed5a886bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:41.893523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:41.894445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:41.895300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 334/641] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:41.896000 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6564051-e032-49c2-b399-b5bed5a886bd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:41.915904 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441b887-e3fb-4c92-9d1c-283a6ff84616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:41.916810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441b887-e3fb-4c92-9d1c-283a6ff84616 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.917262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441b887-e3fb-4c92-9d1c-283a6ff84616 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.917689 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441b887-e3fb-4c92-9d1c-283a6ff84616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.930051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441b887-e3fb-4c92-9d1c-283a6ff84616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:41.931529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441b887-e3fb-4c92-9d1c-283a6ff84616 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d441b887-e3fb-4c92-9d1c-283a6ff84616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:41.953392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:41.954543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:41.955476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:41.955476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:41.955476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:41.955476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:41.955476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 308/642] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:41.955763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441b887-e3fb-4c92-9d1c-283a6ff84616 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:42.005902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6564051-e032-49c2-b399-b5bed5a886bd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:42.031853 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:42.040578 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:42.041556 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a831337-c7eb-49e3-b63a-64a2258e2d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:42.042124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a831337-c7eb-49e3-b63a-64a2258e2d20 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:42.042427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a831337-c7eb-49e3-b63a-64a2258e2d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:42.042611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a831337-c7eb-49e3-b63a-64a2258e2d20 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:42.043425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a831337-c7eb-49e3-b63a-64a2258e2d20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:42.043728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a831337-c7eb-49e3-b63a-64a2258e2d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:42.045097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a831337-c7eb-49e3-b63a-64a2258e2d20 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:42.053024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 335/643] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:42.053798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a831337-c7eb-49e3-b63a-64a2258e2d20 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:42.077318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441b887-e3fb-4c92-9d1c-283a6ff84616 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:42.118443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0a847-d998-4414-877b-24fd77b10a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:42.119249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0a847-d998-4414-877b-24fd77b10a78 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:42.119841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0a847-d998-4414-877b-24fd77b10a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:42.120123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0a847-d998-4414-877b-24fd77b10a78 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:42.130715 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0a847-d998-4414-877b-24fd77b10a78 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:42.132149 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0a847-d998-4414-877b-24fd77b10a78 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-56a0a847-d998-4414-877b-24fd77b10a78 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:42.144939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:42.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:42.147516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:42.147516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:42.147516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:42.147516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:42.147516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:42.147516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:42.147516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:42.147516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:42.147516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:20:42.147516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:42.151039 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 309/644] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:42.152003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0a847-d998-4414-877b-24fd77b10a78 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:42.166206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a831337-c7eb-49e3-b63a-64a2258e2d20 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:42.202397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63682f-7aa2-4527-b55a-3b94be35eb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:42.203029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63682f-7aa2-4527-b55a-3b94be35eb5d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:42.203337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63682f-7aa2-4527-b55a-3b94be35eb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:42.203587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63682f-7aa2-4527-b55a-3b94be35eb5d None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:42.204306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63682f-7aa2-4527-b55a-3b94be35eb5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:42.204631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63682f-7aa2-4527-b55a-3b94be35eb5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:42.206020 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63682f-7aa2-4527-b55a-3b94be35eb5d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:42.214385 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 336/645] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:42.215695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63682f-7aa2-4527-b55a-3b94be35eb5d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:42.266248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0a847-d998-4414-877b-24fd77b10a78 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:42.270551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:42.302491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f97c3-68e9-4ca5-a50a-422c2ea0258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:42.303100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f97c3-68e9-4ca5-a50a-422c2ea0258e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:42.303379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f97c3-68e9-4ca5-a50a-422c2ea0258e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:42.303652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f97c3-68e9-4ca5-a50a-422c2ea0258e None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:42.304340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f97c3-68e9-4ca5-a50a-422c2ea0258e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:42.304648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f97c3-68e9-4ca5-a50a-422c2ea0258e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:42.306279 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f97c3-68e9-4ca5-a50a-422c2ea0258e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:42.313605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:42.319016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 310/646] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:42.320127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f97c3-68e9-4ca5-a50a-422c2ea0258e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:42.330163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63682f-7aa2-4527-b55a-3b94be35eb5d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:42.364861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904d9e4-10fc-4bf7-8a88-c6b688ccb59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:42.365540 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904d9e4-10fc-4bf7-8a88-c6b688ccb59a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:42.365821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904d9e4-10fc-4bf7-8a88-c6b688ccb59a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:42.366152 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904d9e4-10fc-4bf7-8a88-c6b688ccb59a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:42.377006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904d9e4-10fc-4bf7-8a88-c6b688ccb59a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:42.378432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904d9e4-10fc-4bf7-8a88-c6b688ccb59a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3904d9e4-10fc-4bf7-8a88-c6b688ccb59a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:42.393875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:42.394891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:42.395857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:42.395857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:42.395857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:42.395857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:42.395857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 337/647] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:42.396147 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904d9e4-10fc-4bf7-8a88-c6b688ccb59a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:42.442772 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f97c3-68e9-4ca5-a50a-422c2ea0258e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:42.480859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9bcb3-45ae-42f5-9349-1daa50a6ed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:42.481672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9bcb3-45ae-42f5-9349-1daa50a6ed35 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:42.481953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9bcb3-45ae-42f5-9349-1daa50a6ed35 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:42.482225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9bcb3-45ae-42f5-9349-1daa50a6ed35 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:42.483020 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9bcb3-45ae-42f5-9349-1daa50a6ed35 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:42.483322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9bcb3-45ae-42f5-9349-1daa50a6ed35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:42.484741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9bcb3-45ae-42f5-9349-1daa50a6ed35 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:42.500682 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904d9e4-10fc-4bf7-8a88-c6b688ccb59a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:42.502513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:42.503932 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 311/648] 10.222.0.15 () {56 vars in 1137 bytes} [Sat Aug 6 01:20:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:42.504258 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9bcb3-45ae-42f5-9349-1daa50a6ed35 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:42.542465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d35a69-c30f-471e-90af-ae6b6957eb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:42.543182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d35a69-c30f-471e-90af-ae6b6957eb63 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:42.543466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d35a69-c30f-471e-90af-ae6b6957eb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:42.543747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d35a69-c30f-471e-90af-ae6b6957eb63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:42.554783 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d35a69-c30f-471e-90af-ae6b6957eb63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:42.556242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d35a69-c30f-471e-90af-ae6b6957eb63 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:42.566596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d5d35a69-c30f-471e-90af-ae6b6957eb63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:42.571274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:42.572369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:42.573466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:42.573466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:42.573466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:42.573466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:42.577728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 338/649] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:42.578563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d35a69-c30f-471e-90af-ae6b6957eb63 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:42.618348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9bcb3-45ae-42f5-9349-1daa50a6ed35 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:42.655902 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb3ab5-59d2-4e5b-97cb-aa40aa4328bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:42.656551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb3ab5-59d2-4e5b-97cb-aa40aa4328bf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:42.656836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb3ab5-59d2-4e5b-97cb-aa40aa4328bf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:42.657153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb3ab5-59d2-4e5b-97cb-aa40aa4328bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:42.665685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb3ab5-59d2-4e5b-97cb-aa40aa4328bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:42.667536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb3ab5-59d2-4e5b-97cb-aa40aa4328bf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-65cb3ab5-59d2-4e5b-97cb-aa40aa4328bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:42.680454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:42.681548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:42.682479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:42.682479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:42.682479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:42.682479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:42.682479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:42.682479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:42.682479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:42.682479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:42.682479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 312/650] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:42.682966 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb3ab5-59d2-4e5b-97cb-aa40aa4328bf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:42.691337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d35a69-c30f-471e-90af-ae6b6957eb63 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:42.726973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaa736-8926-461e-856e-a689e57ac3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:42.727532 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaa736-8926-461e-856e-a689e57ac3ad None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:42.727816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaa736-8926-461e-856e-a689e57ac3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:42.728087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aaa736-8926-461e-856e-a689e57ac3ad None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:42.728780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aaa736-8926-461e-856e-a689e57ac3ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:42.729525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aaa736-8926-461e-856e-a689e57ac3ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:42.731561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aaa736-8926-461e-856e-a689e57ac3ad None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:42.744652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 339/651] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:42.750157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaa736-8926-461e-856e-a689e57ac3ad None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:42.766528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:42.795254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb3ab5-59d2-4e5b-97cb-aa40aa4328bf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:42.814198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:42.834961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90da98-2893-4923-9fde-36144b368739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:42.835603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90da98-2893-4923-9fde-36144b368739 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:42.835886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90da98-2893-4923-9fde-36144b368739 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:42.836160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90da98-2893-4923-9fde-36144b368739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:42.854947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aaa736-8926-461e-856e-a689e57ac3ad None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:42.892232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01224f-d45a-41ce-85fb-1452eaa20003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:42.893306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01224f-d45a-41ce-85fb-1452eaa20003 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:42.893880 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01224f-d45a-41ce-85fb-1452eaa20003 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:42.894356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01224f-d45a-41ce-85fb-1452eaa20003 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:42.895236 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01224f-d45a-41ce-85fb-1452eaa20003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:42.895839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01224f-d45a-41ce-85fb-1452eaa20003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:42.897619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01224f-d45a-41ce-85fb-1452eaa20003 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:42.906645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90da98-2893-4923-9fde-36144b368739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:42.908120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90da98-2893-4923-9fde-36144b368739 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:42.910852 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 340/652] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:42.916366 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01224f-d45a-41ce-85fb-1452eaa20003 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:43.002784 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:43.023807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 313/653] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:43.023807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90da98-2893-4923-9fde-36144b368739 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:43.034383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01224f-d45a-41ce-85fb-1452eaa20003 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:43.039955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:43.069931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018cdd5-e3cb-4fc5-a1f8-b63c9fd4b6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:43.070550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018cdd5-e3cb-4fc5-a1f8-b63c9fd4b6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:43.070824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018cdd5-e3cb-4fc5-a1f8-b63c9fd4b6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:43.071093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018cdd5-e3cb-4fc5-a1f8-b63c9fd4b6d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:43.071839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018cdd5-e3cb-4fc5-a1f8-b63c9fd4b6d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:43.072142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018cdd5-e3cb-4fc5-a1f8-b63c9fd4b6d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:43.073588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018cdd5-e3cb-4fc5-a1f8-b63c9fd4b6d2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:43.085180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 341/654] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:43.085980 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018cdd5-e3cb-4fc5-a1f8-b63c9fd4b6d2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:43.124794 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90da98-2893-4923-9fde-36144b368739 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:43.159037 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbd2fe-c0e8-45e8-8887-6264e54ba34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:43.159676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbd2fe-c0e8-45e8-8887-6264e54ba34a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:43.159962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbd2fe-c0e8-45e8-8887-6264e54ba34a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:43.160237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbd2fe-c0e8-45e8-8887-6264e54ba34a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:43.167763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbd2fe-c0e8-45e8-8887-6264e54ba34a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:43.169824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbd2fe-c0e8-45e8-8887-6264e54ba34a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b1cbd2fe-c0e8-45e8-8887-6264e54ba34a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:43.181246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:43.182226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:43.183208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:43.183208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:43.183208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:43.183208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:43.183208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:43.183208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:43.183208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:43.183208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:43.183208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:20:43.183208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:43.183208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 314/655] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 6 01:20:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:43.183208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbd2fe-c0e8-45e8-8887-6264e54ba34a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:43.197648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018cdd5-e3cb-4fc5-a1f8-b63c9fd4b6d2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:43.232542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a461c2-2371-4ea8-ac99-c54ea1071c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:43.233208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a461c2-2371-4ea8-ac99-c54ea1071c22 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:43.233493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a461c2-2371-4ea8-ac99-c54ea1071c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:43.233766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a461c2-2371-4ea8-ac99-c54ea1071c22 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:43.235689 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:43.241933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a461c2-2371-4ea8-ac99-c54ea1071c22 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:43.243527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a461c2-2371-4ea8-ac99-c54ea1071c22 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-54a461c2-2371-4ea8-ac99-c54ea1071c22 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:43.256217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:43.257206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:43.258189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:43.258189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:43.258189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:43.258189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:43.258189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:43.258189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:43.258189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:43.258189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:43.258189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 01:20:43.258189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:43.258189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 342/656] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:43.258803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749eb9-c640-42b3-9f89-fb0ff44197c9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:43.258803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749eb9-c640-42b3-9f89-fb0ff44197c9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:43.259095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749eb9-c640-42b3-9f89-fb0ff44197c9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:43.260220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 343/657] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:43.260925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749eb9-c640-42b3-9f89-fb0ff44197c9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:43.266382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:43.289717 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbd2fe-c0e8-45e8-8887-6264e54ba34a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:43.323689 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8a5b2-aaea-42b8-9835-a8dc0bfa8042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:43.325299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8a5b2-aaea-42b8-9835-a8dc0bfa8042 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:43.325299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8a5b2-aaea-42b8-9835-a8dc0bfa8042 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:43.325676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8a5b2-aaea-42b8-9835-a8dc0bfa8042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:43.336061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8a5b2-aaea-42b8-9835-a8dc0bfa8042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:43.337540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8a5b2-aaea-42b8-9835-a8dc0bfa8042 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a4d8a5b2-aaea-42b8-9835-a8dc0bfa8042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:43.352135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:43.353195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:43.354109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:43.354109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:43.354109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:43.354109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:43.354109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 315/658] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:43.354109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8a5b2-aaea-42b8-9835-a8dc0bfa8042 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:43.367106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749eb9-c640-42b3-9f89-fb0ff44197c9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:43.401369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70839995-b0fd-4b85-a3fb-c684c5a02c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:43.401983 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70839995-b0fd-4b85-a3fb-c684c5a02c9d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:43.402332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70839995-b0fd-4b85-a3fb-c684c5a02c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:43.403207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70839995-b0fd-4b85-a3fb-c684c5a02c9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:43.404003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70839995-b0fd-4b85-a3fb-c684c5a02c9d None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=da39170a654d4d52a39b4b2c8cfd8906) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:43.404314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70839995-b0fd-4b85-a3fb-c684c5a02c9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:43.405762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70839995-b0fd-4b85-a3fb-c684c5a02c9d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:43.411398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 344/659] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:43 2022] GET /identity/v3/role_assignments?user.id=da39170a654d4d52a39b4b2c8cfd8906&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:43.412156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70839995-b0fd-4b85-a3fb-c684c5a02c9d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:43.472377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8a5b2-aaea-42b8-9835-a8dc0bfa8042 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:43.478897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:43.501619 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:43.510105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef40b5-2de4-44a5-97d1-c5c38c1fda3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:43.510646 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef40b5-2de4-44a5-97d1-c5c38c1fda3b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:43.510930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef40b5-2de4-44a5-97d1-c5c38c1fda3b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:43.511204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef40b5-2de4-44a5-97d1-c5c38c1fda3b None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:43.512670 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef40b5-2de4-44a5-97d1-c5c38c1fda3b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:43.513032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef40b5-2de4-44a5-97d1-c5c38c1fda3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:43.514713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef40b5-2de4-44a5-97d1-c5c38c1fda3b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:43.530921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70839995-b0fd-4b85-a3fb-c684c5a02c9d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:43.540589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 316/660] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 6 01:20:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:43.540589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c42560-51e7-49c2-8778-66c2de25e1ef None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:43.540589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c42560-51e7-49c2-8778-66c2de25e1ef None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:43.540589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c42560-51e7-49c2-8778-66c2de25e1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:43.557702 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-88c42560-51e7-49c2-8778-66c2de25e1ef None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:43.559534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-88c42560-51e7-49c2-8778-66c2de25e1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:43.569811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c5862-6287-4cbd-9a40-0f46eeaff0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:43.570434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c5862-6287-4cbd-9a40-0f46eeaff0fb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:43.570714 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c5862-6287-4cbd-9a40-0f46eeaff0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:43.570988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c5862-6287-4cbd-9a40-0f46eeaff0fb None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:43.571785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c5862-6287-4cbd-9a40-0f46eeaff0fb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:43.572090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c5862-6287-4cbd-9a40-0f46eeaff0fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:43.573982 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c5862-6287-4cbd-9a40-0f46eeaff0fb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:43.592364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 345/661] 10.222.0.15 () {56 vars in 1139 bytes} [Sat Aug 6 01:20:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:43.593314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c5862-6287-4cbd-9a40-0f46eeaff0fb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:43.645000 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 317/662] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:43.646502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c42560-51e7-49c2-8778-66c2de25e1ef None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:43.713635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c5862-6287-4cbd-9a40-0f46eeaff0fb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:43.732238 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:43.751482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3c64d-509e-47f8-b99f-1678483f75a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:43.752105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3c64d-509e-47f8-b99f-1678483f75a5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:43.752388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3c64d-509e-47f8-b99f-1678483f75a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:43.752664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3c64d-509e-47f8-b99f-1678483f75a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:43.753394 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3c64d-509e-47f8-b99f-1678483f75a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:43.753705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3c64d-509e-47f8-b99f-1678483f75a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:43.755077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3c64d-509e-47f8-b99f-1678483f75a5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:43.758810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c42560-51e7-49c2-8778-66c2de25e1ef None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:43.767877 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 346/663] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:43.768493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3c64d-509e-47f8-b99f-1678483f75a5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:43.782146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:43.801668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6fedf-78d6-407c-95e5-be5e867e84ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:43.802349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6fedf-78d6-407c-95e5-be5e867e84ef None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:43.802639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6fedf-78d6-407c-95e5-be5e867e84ef None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:43.802916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6fedf-78d6-407c-95e5-be5e867e84ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:43.875105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6fedf-78d6-407c-95e5-be5e867e84ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:43.876566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6fedf-78d6-407c-95e5-be5e867e84ef None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:43.881218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3c64d-509e-47f8-b99f-1678483f75a5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:43.916857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbea96a-17f7-4ddd-83c1-672b8bbc8992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:43.917552 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbea96a-17f7-4ddd-83c1-672b8bbc8992 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:43.917876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbea96a-17f7-4ddd-83c1-672b8bbc8992 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:43.918169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbea96a-17f7-4ddd-83c1-672b8bbc8992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:43.967188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:43.983706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 318/664] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:43.984555 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6fedf-78d6-407c-95e5-be5e867e84ef None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:43.998017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbea96a-17f7-4ddd-83c1-672b8bbc8992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:43.999482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbea96a-17f7-4ddd-83c1-672b8bbc8992 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:44.005384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:44.098703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6fedf-78d6-407c-95e5-be5e867e84ef None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:44.106482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 347/665] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:44.107337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbea96a-17f7-4ddd-83c1-672b8bbc8992 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:44.140819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7427880-1bc6-45c7-883d-a689c80db565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:44.141492 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7427880-1bc6-45c7-883d-a689c80db565 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:44.141778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7427880-1bc6-45c7-883d-a689c80db565 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:44.142055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7427880-1bc6-45c7-883d-a689c80db565 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:44.153108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7427880-1bc6-45c7-883d-a689c80db565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d7427880-1bc6-45c7-883d-a689c80db565 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:44.158307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:44.159260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:44.160133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 319/666] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:44.160843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7427880-1bc6-45c7-883d-a689c80db565 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:44.196445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:44.223652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbea96a-17f7-4ddd-83c1-672b8bbc8992 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:44.253788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:44.267148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c2afc-504a-4ba1-bbb3-8dcad79b1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:44.267784 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c2afc-504a-4ba1-bbb3-8dcad79b1741 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:44.268217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c2afc-504a-4ba1-bbb3-8dcad79b1741 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:44.268497 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c2afc-504a-4ba1-bbb3-8dcad79b1741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:44.277047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7427880-1bc6-45c7-883d-a689c80db565 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:44.277225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c2afc-504a-4ba1-bbb3-8dcad79b1741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:44.278761 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c2afc-504a-4ba1-bbb3-8dcad79b1741 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b34c2afc-504a-4ba1-bbb3-8dcad79b1741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:44.292763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:44.293937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:44.294954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:44.294954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:44.294954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:44.294954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:44.294954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:44.294954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:44.294954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:44.294954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:44.294954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 348/667] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:44.295473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c2afc-504a-4ba1-bbb3-8dcad79b1741 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:44.316580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfb950-acf2-4c7b-a83a-e85664be7f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:44.317287 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfb950-acf2-4c7b-a83a-e85664be7f08 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:44.317573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfb950-acf2-4c7b-a83a-e85664be7f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:44.317993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfb950-acf2-4c7b-a83a-e85664be7f08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:44.329254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfb950-acf2-4c7b-a83a-e85664be7f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:44.330676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfb950-acf2-4c7b-a83a-e85664be7f08 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-32cfb950-acf2-4c7b-a83a-e85664be7f08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:44.344815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:44.345926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:44.346836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:44.346836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:44.346836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:44.346836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:44.346836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 320/668] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:44.346836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfb950-acf2-4c7b-a83a-e85664be7f08 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:44.414535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c2afc-504a-4ba1-bbb3-8dcad79b1741 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:44.457272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac437307-a8a8-4284-9b94-71614e5fdb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:44.458313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac437307-a8a8-4284-9b94-71614e5fdb79 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:44.458598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac437307-a8a8-4284-9b94-71614e5fdb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:44.459021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac437307-a8a8-4284-9b94-71614e5fdb79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:44.461781 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:44.465361 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfb950-acf2-4c7b-a83a-e85664be7f08 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:44.469988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac437307-a8a8-4284-9b94-71614e5fdb79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:44.471464 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac437307-a8a8-4284-9b94-71614e5fdb79 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-ac437307-a8a8-4284-9b94-71614e5fdb79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:44.485704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:44.486624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:44.487538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:44.487538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:44.487538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:44.487538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:44.487538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 349/669] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:44.488628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac437307-a8a8-4284-9b94-71614e5fdb79 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:44.495036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:44.503693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726bd4d-bc52-41ed-954f-4f76c255c02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:44.504308 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726bd4d-bc52-41ed-954f-4f76c255c02c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:44.504587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726bd4d-bc52-41ed-954f-4f76c255c02c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:44.504857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726bd4d-bc52-41ed-954f-4f76c255c02c None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:44.505593 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726bd4d-bc52-41ed-954f-4f76c255c02c None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:44.505896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726bd4d-bc52-41ed-954f-4f76c255c02c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:44.507246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726bd4d-bc52-41ed-954f-4f76c255c02c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:44.520282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 321/670] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:44.520282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726bd4d-bc52-41ed-954f-4f76c255c02c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:44.605248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac437307-a8a8-4284-9b94-71614e5fdb79 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:44.619720 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726bd4d-bc52-41ed-954f-4f76c255c02c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:44.642843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41759296-7e43-406d-b0f5-ba5dbb5ae0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:44.643386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41759296-7e43-406d-b0f5-ba5dbb5ae0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:44.643780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41759296-7e43-406d-b0f5-ba5dbb5ae0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:44.644053 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41759296-7e43-406d-b0f5-ba5dbb5ae0d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:44.644924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41759296-7e43-406d-b0f5-ba5dbb5ae0d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:44.645234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41759296-7e43-406d-b0f5-ba5dbb5ae0d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:44.646777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41759296-7e43-406d-b0f5-ba5dbb5ae0d0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:44.655929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd044f-8179-4407-8dde-c6aa584b06ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:44.657089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd044f-8179-4407-8dde-c6aa584b06ab None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:44.657566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd044f-8179-4407-8dde-c6aa584b06ab None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:44.657910 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd044f-8179-4407-8dde-c6aa584b06ab None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:44.658678 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd044f-8179-4407-8dde-c6aa584b06ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:44.659059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd044f-8179-4407-8dde-c6aa584b06ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:44.659466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 350/671] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:44.660275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41759296-7e43-406d-b0f5-ba5dbb5ae0d0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:44.665443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd044f-8179-4407-8dde-c6aa584b06ab None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:44.682254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 322/672] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:44.682254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd044f-8179-4407-8dde-c6aa584b06ab None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:44.719681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:44.729528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:44.775859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41759296-7e43-406d-b0f5-ba5dbb5ae0d0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:44.783963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd044f-8179-4407-8dde-c6aa584b06ab None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:44.811811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5a391-8023-4664-9371-3178f41b7882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:44.812527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5a391-8023-4664-9371-3178f41b7882 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:44.812807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5a391-8023-4664-9371-3178f41b7882 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:44.813102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5a391-8023-4664-9371-3178f41b7882 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:44.813900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5a391-8023-4664-9371-3178f41b7882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:44.814209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5a391-8023-4664-9371-3178f41b7882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:44.815571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5a391-8023-4664-9371-3178f41b7882 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:44.818330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3178a7c-46bf-4359-b4ee-3a6ad3c8b78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:44.819080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3178a7c-46bf-4359-b4ee-3a6ad3c8b78a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:44.819465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3178a7c-46bf-4359-b4ee-3a6ad3c8b78a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:44.819842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3178a7c-46bf-4359-b4ee-3a6ad3c8b78a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:44.832005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 351/673] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:44.832005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5a391-8023-4664-9371-3178f41b7882 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:44.835323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3178a7c-46bf-4359-b4ee-3a6ad3c8b78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:44.836872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3178a7c-46bf-4359-b4ee-3a6ad3c8b78a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e3178a7c-46bf-4359-b4ee-3a6ad3c8b78a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:44.853651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:44.854760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:44.856420 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:44.856420 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:44.856420 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:44.856420 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:44.861825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 323/674] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:44.861825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3178a7c-46bf-4359-b4ee-3a6ad3c8b78a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:44.945318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5a391-8023-4664-9371-3178f41b7882 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:44.955148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:44.963643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3178a7c-46bf-4359-b4ee-3a6ad3c8b78a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:44.966685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:44.985688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74b56-c21f-4170-a42c-4aebec00a94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:44.986409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74b56-c21f-4170-a42c-4aebec00a94d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:44.986746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74b56-c21f-4170-a42c-4aebec00a94d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:44.986963 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74b56-c21f-4170-a42c-4aebec00a94d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:44.987750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec74b56-c21f-4170-a42c-4aebec00a94d None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=acd6aba844f04489adec2ce9f1eb49dd) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:44.988063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec74b56-c21f-4170-a42c-4aebec00a94d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:44.989514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec74b56-c21f-4170-a42c-4aebec00a94d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:45.004941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 352/675] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:44 2022] GET /identity/v3/role_assignments?user.id=acd6aba844f04489adec2ce9f1eb49dd&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:45.004941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74b56-c21f-4170-a42c-4aebec00a94d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:45.011255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e5993-3a59-4277-80e4-3440b531be90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:45.012116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e5993-3a59-4277-80e4-3440b531be90 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:45.012409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e5993-3a59-4277-80e4-3440b531be90 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:45.012783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e5993-3a59-4277-80e4-3440b531be90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:45.021536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e5993-3a59-4277-80e4-3440b531be90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:45.023351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e5993-3a59-4277-80e4-3440b531be90 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d14e5993-3a59-4277-80e4-3440b531be90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:45.038101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:45.039253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:45.040349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:45.040349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:45.040349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:45.040349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:45.040349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:45.040349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:45.040349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:45.040349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:45.046381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 324/676] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:45.046381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e5993-3a59-4277-80e4-3440b531be90 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:45.155893 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74b56-c21f-4170-a42c-4aebec00a94d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:45.175692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e5993-3a59-4277-80e4-3440b531be90 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:45.195266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92c096-7753-493f-bb07-554024448b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:45.196065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92c096-7753-493f-bb07-554024448b5a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:45.197208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92c096-7753-493f-bb07-554024448b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:45.197550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92c096-7753-493f-bb07-554024448b5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:45.206299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92c096-7753-493f-bb07-554024448b5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:45.207879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92c096-7753-493f-bb07-554024448b5a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:45.214856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff7204-3fda-4234-a389-0fa5964c1a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:45.215732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff7204-3fda-4234-a389-0fa5964c1a78 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:45.216017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff7204-3fda-4234-a389-0fa5964c1a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:45.216278 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff7204-3fda-4234-a389-0fa5964c1a78 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:45.217025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff7204-3fda-4234-a389-0fa5964c1a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:45.217336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff7204-3fda-4234-a389-0fa5964c1a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:45.218731 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff7204-3fda-4234-a389-0fa5964c1a78 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-7c92c096-7753-493f-bb07-554024448b5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:45.222250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:45.223319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:45.224458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:45.224458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:45.224458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:45.224458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:45.224458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:45.224458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:45.224458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:45.224458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:45.226156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 353/677] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:45.226911 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92c096-7753-493f-bb07-554024448b5a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:45.239223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 325/678] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:45.240626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff7204-3fda-4234-a389-0fa5964c1a78 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:45.266257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:45.271966 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:45.354673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff7204-3fda-4234-a389-0fa5964c1a78 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:45.364336 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92c096-7753-493f-bb07-554024448b5a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:45.398553 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e21b8-5bc2-4189-94b0-de836dc8db63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:45.399503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e21b8-5bc2-4189-94b0-de836dc8db63 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:45.399795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e21b8-5bc2-4189-94b0-de836dc8db63 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:45.400077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e21b8-5bc2-4189-94b0-de836dc8db63 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:45.401190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e21b8-5bc2-4189-94b0-de836dc8db63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:45.401506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e21b8-5bc2-4189-94b0-de836dc8db63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:45.403703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e21b8-5bc2-4189-94b0-de836dc8db63 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:45.410471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1382c3-5011-41a5-8e27-3ef7c9f3a033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:45.411279 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1382c3-5011-41a5-8e27-3ef7c9f3a033 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:45.411726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1382c3-5011-41a5-8e27-3ef7c9f3a033 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:45.412162 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1382c3-5011-41a5-8e27-3ef7c9f3a033 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:45.413107 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1382c3-5011-41a5-8e27-3ef7c9f3a033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:45.413574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1382c3-5011-41a5-8e27-3ef7c9f3a033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:45.415148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1382c3-5011-41a5-8e27-3ef7c9f3a033 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:45.423070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 326/679] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:45.423070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e21b8-5bc2-4189-94b0-de836dc8db63 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:45.440550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 354/680] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:45.441742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1382c3-5011-41a5-8e27-3ef7c9f3a033 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:45.525662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:45.542672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:45.545342 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e21b8-5bc2-4189-94b0-de836dc8db63 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:45.553167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1382c3-5011-41a5-8e27-3ef7c9f3a033 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:45.580375 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fdbdb-6cba-4c65-aee4-cf0b47334ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:45.581047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fdbdb-6cba-4c65-aee4-cf0b47334ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:45.581326 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fdbdb-6cba-4c65-aee4-cf0b47334ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:45.581598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fdbdb-6cba-4c65-aee4-cf0b47334ac4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:45.589328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fdbdb-6cba-4c65-aee4-cf0b47334ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:45.589646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afe9e4-d922-4501-a9f2-dec92bca291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:45.590805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afe9e4-d922-4501-a9f2-dec92bca291b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:45.591164 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afe9e4-d922-4501-a9f2-dec92bca291b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:45.591370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fdbdb-6cba-4c65-aee4-cf0b47334ac4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:45.591469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afe9e4-d922-4501-a9f2-dec92bca291b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:45.592237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afe9e4-d922-4501-a9f2-dec92bca291b None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=403beb9eb6c04cc69579361138bea12d) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:45.592551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afe9e4-d922-4501-a9f2-dec92bca291b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:45.594240 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afe9e4-d922-4501-a9f2-dec92bca291b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:45.600960 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 355/681] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:45 2022] GET /identity/v3/role_assignments?user.id=403beb9eb6c04cc69579361138bea12d&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:45.601127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afe9e4-d922-4501-a9f2-dec92bca291b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e11fdbdb-6cba-4c65-aee4-cf0b47334ac4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:45.603136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:45.604063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:45.605058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:45.605058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:45.605058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:45.605058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:45.605058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:45.605058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:45.605058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:45.605058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:45.605058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:20:45.605058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:45.605058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 327/682] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:20:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:45.606142 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd441a6-a7a1-426f-aa02-c3c2f8bcc35c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:45.606319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd441a6-a7a1-426f-aa02-c3c2f8bcc35c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:45.606558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd441a6-a7a1-426f-aa02-c3c2f8bcc35c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:45.607935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 328/683] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:45.612850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd441a6-a7a1-426f-aa02-c3c2f8bcc35c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:45.742020 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd441a6-a7a1-426f-aa02-c3c2f8bcc35c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:45.746733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afe9e4-d922-4501-a9f2-dec92bca291b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:45.785266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a431920-a8c2-4f89-b24a-d3d8434e5921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:45.786404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a431920-a8c2-4f89-b24a-d3d8434e5921 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:45.787990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a431920-a8c2-4f89-b24a-d3d8434e5921 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:45.788562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a431920-a8c2-4f89-b24a-d3d8434e5921 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:45.789682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a431920-a8c2-4f89-b24a-d3d8434e5921 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:45.790177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a431920-a8c2-4f89-b24a-d3d8434e5921 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:45.791836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a431920-a8c2-4f89-b24a-d3d8434e5921 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:45.791994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62c771-cdfc-4671-af27-3849e4df5884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:45.792606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62c771-cdfc-4671-af27-3849e4df5884 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:45.792927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62c771-cdfc-4671-af27-3849e4df5884 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:45.793706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62c771-cdfc-4671-af27-3849e4df5884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:45.794006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62c771-cdfc-4671-af27-3849e4df5884 None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=666f4864832445d5a10d60f677f5cd6c) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:45.794316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62c771-cdfc-4671-af27-3849e4df5884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:45.795902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62c771-cdfc-4671-af27-3849e4df5884 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:45.806810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 356/684] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:45 2022] GET /identity/v3/role_assignments?user.id=666f4864832445d5a10d60f677f5cd6c&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:45.809886 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcdd9d-e9c8-44bb-b598-1e0f764b69c4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:45.809886 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcdd9d-e9c8-44bb-b598-1e0f764b69c4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:45.809886 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcdd9d-e9c8-44bb-b598-1e0f764b69c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:45.828576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:45.831687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-64dcdd9d-e9c8-44bb-b598-1e0f764b69c4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:45.832165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 329/685] 10.222.0.15 () {56 vars in 1135 bytes} [Sat Aug 6 01:20:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:45.832433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-64dcdd9d-e9c8-44bb-b598-1e0f764b69c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:45.845491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a431920-a8c2-4f89-b24a-d3d8434e5921 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:45.858971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:45.929737 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 357/686] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:45.957845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcdd9d-e9c8-44bb-b598-1e0f764b69c4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:45.988603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a431920-a8c2-4f89-b24a-d3d8434e5921 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:46.028023 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d7ac8-db13-4e55-8879-3557c670241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:46.028772 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d7ac8-db13-4e55-8879-3557c670241e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:46.029089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d7ac8-db13-4e55-8879-3557c670241e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:46.029459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d7ac8-db13-4e55-8879-3557c670241e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:46.088574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcdd9d-e9c8-44bb-b598-1e0f764b69c4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:46.108025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:46.112786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d7ac8-db13-4e55-8879-3557c670241e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:46.114418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d7ac8-db13-4e55-8879-3557c670241e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:46.138215 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137458c-47e7-4825-b7e1-cb50275532c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:46.138965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137458c-47e7-4825-b7e1-cb50275532c3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:46.139504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137458c-47e7-4825-b7e1-cb50275532c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:46.139775 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137458c-47e7-4825-b7e1-cb50275532c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:46.152041 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137458c-47e7-4825-b7e1-cb50275532c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:46.154195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137458c-47e7-4825-b7e1-cb50275532c3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5137458c-47e7-4825-b7e1-cb50275532c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:46.171593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:46.173021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:46.173939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:46.173939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:46.173939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:46.173939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:46.173939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 358/687] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:46.181944 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137458c-47e7-4825-b7e1-cb50275532c3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:46.187679 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:46.244880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 330/688] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:46.251588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d7ac8-db13-4e55-8879-3557c670241e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:46.321280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137458c-47e7-4825-b7e1-cb50275532c3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:46.376857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:46.382878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d7ac8-db13-4e55-8879-3557c670241e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:46.404835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d95bd-b631-490f-adf6-979fea48114d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:46.405492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d95bd-b631-490f-adf6-979fea48114d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:46.405776 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d95bd-b631-490f-adf6-979fea48114d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:46.406052 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d95bd-b631-490f-adf6-979fea48114d None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:46.406757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d95bd-b631-490f-adf6-979fea48114d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:46.407071 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d95bd-b631-490f-adf6-979fea48114d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:46.408453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d95bd-b631-490f-adf6-979fea48114d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:46.430800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 359/689] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:46.437337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d95bd-b631-490f-adf6-979fea48114d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:46.462201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3d9c9-6169-4f62-b494-788c579357e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:46.462862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3d9c9-6169-4f62-b494-788c579357e3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:46.463149 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3d9c9-6169-4f62-b494-788c579357e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:46.463429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3d9c9-6169-4f62-b494-788c579357e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:46.484954 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf3d9c9-6169-4f62-b494-788c579357e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:46.486448 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf3d9c9-6169-4f62-b494-788c579357e3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-acf3d9c9-6169-4f62-b494-788c579357e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:46.518886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:46.520266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:46.521198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:46.521198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:46.521198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:46.521198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:46.521198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 331/690] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:46.528178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3d9c9-6169-4f62-b494-788c579357e3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:46.629343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:46.657231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3d9c9-6169-4f62-b494-788c579357e3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:46.665674 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d95bd-b631-490f-adf6-979fea48114d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:46.703969 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a510850-6661-4d36-8d78-1422cff32393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:46.704602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a510850-6661-4d36-8d78-1422cff32393 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:46.704887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a510850-6661-4d36-8d78-1422cff32393 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:46.705192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a510850-6661-4d36-8d78-1422cff32393 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:46.705891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a510850-6661-4d36-8d78-1422cff32393 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:46.707317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a510850-6661-4d36-8d78-1422cff32393 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:46.712579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7939741-8e2f-42bf-9f3d-fcc69827c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:46.713226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7939741-8e2f-42bf-9f3d-fcc69827c221 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:46.713511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7939741-8e2f-42bf-9f3d-fcc69827c221 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:46.713792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7939741-8e2f-42bf-9f3d-fcc69827c221 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:46.714491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7939741-8e2f-42bf-9f3d-fcc69827c221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:46.715510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7939741-8e2f-42bf-9f3d-fcc69827c221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:46.716888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7939741-8e2f-42bf-9f3d-fcc69827c221 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:46.739784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 332/691] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:46.745228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7939741-8e2f-42bf-9f3d-fcc69827c221 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:46.759336 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 360/692] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:20:46 2022] POST /identity/v3/users => generated 254 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:46.801310 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:46.892938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7939741-8e2f-42bf-9f3d-fcc69827c221 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:46.940240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98097e9a-ffaa-486b-8218-d3c8926395b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:46.940961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98097e9a-ffaa-486b-8218-d3c8926395b1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:46.941231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98097e9a-ffaa-486b-8218-d3c8926395b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:46.941529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98097e9a-ffaa-486b-8218-d3c8926395b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:46.950158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98097e9a-ffaa-486b-8218-d3c8926395b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:46.951624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98097e9a-ffaa-486b-8218-d3c8926395b1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-98097e9a-ffaa-486b-8218-d3c8926395b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:46.967539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:46.968481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:46.969404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:46.969404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:46.969404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:46.969404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:46.969404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:46.969404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:46.969404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:46.969404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:46.969404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 333/693] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:46.978017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a510850-6661-4d36-8d78-1422cff32393 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:47.110351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a510850-6661-4d36-8d78-1422cff32393 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:47.142341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:47.148415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd28ec9-247c-4cc6-b47f-e9f3c530139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:47.149323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd28ec9-247c-4cc6-b47f-e9f3c530139d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:47.149907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd28ec9-247c-4cc6-b47f-e9f3c530139d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:47.150709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd28ec9-247c-4cc6-b47f-e9f3c530139d None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:47.151774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd28ec9-247c-4cc6-b47f-e9f3c530139d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:47.152983 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd28ec9-247c-4cc6-b47f-e9f3c530139d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:47.154823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd28ec9-247c-4cc6-b47f-e9f3c530139d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:47.168602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 361/694] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:47.177992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98097e9a-ffaa-486b-8218-d3c8926395b1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:47.254274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:47.289466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98097e9a-ffaa-486b-8218-d3c8926395b1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:47.328382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89486d09-c180-4576-afdb-7b042d03afaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:47.329045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486d09-c180-4576-afdb-7b042d03afaf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:47.329328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486d09-c180-4576-afdb-7b042d03afaf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:47.329602 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486d09-c180-4576-afdb-7b042d03afaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:47.330402 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89486d09-c180-4576-afdb-7b042d03afaf None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=a8d43b9ceeba432db6d141bb52d4bf1e) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:47.330714 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89486d09-c180-4576-afdb-7b042d03afaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:47.332136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89486d09-c180-4576-afdb-7b042d03afaf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:47.338777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 334/695] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:47 2022] GET /identity/v3/role_assignments?user.id=a8d43b9ceeba432db6d141bb52d4bf1e&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:47.480551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ddee3-68b9-4193-8d2b-d90df3f85aab None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:47.481092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ddee3-68b9-4193-8d2b-d90df3f85aab None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:47.481452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ddee3-68b9-4193-8d2b-d90df3f85aab None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:47.483160 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 362/696] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:47.488653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5eab-325d-400e-9b56-605b05807fab None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:47.488964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5eab-325d-400e-9b56-605b05807fab None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:47.489247 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5eab-325d-400e-9b56-605b05807fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:47.514229 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0e1a5eab-325d-400e-9b56-605b05807fab None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:47.515444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0e1a5eab-325d-400e-9b56-605b05807fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:47.605080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 335/697] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:47.628672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ddee3-68b9-4193-8d2b-d90df3f85aab None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:47.758578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ddee3-68b9-4193-8d2b-d90df3f85aab None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:47.805291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385b6fd-ca7b-4a83-9d85-da2ee05d8c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:47.805941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385b6fd-ca7b-4a83-9d85-da2ee05d8c3c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:47.806223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385b6fd-ca7b-4a83-9d85-da2ee05d8c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:47.806497 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385b6fd-ca7b-4a83-9d85-da2ee05d8c3c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:47.807130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385b6fd-ca7b-4a83-9d85-da2ee05d8c3c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:47.808981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385b6fd-ca7b-4a83-9d85-da2ee05d8c3c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-8385b6fd-ca7b-4a83-9d85-da2ee05d8c3c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:47.825869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:47.826876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:47.827719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 363/698] 10.222.0.15 () {56 vars in 1129 bytes} [Sat Aug 6 01:20:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:47.833197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5eab-325d-400e-9b56-605b05807fab None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:47.951833 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:48.002924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5eab-325d-400e-9b56-605b05807fab None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:48.049876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff5178-a948-4f5e-aadf-00969d556d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:48.050426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff5178-a948-4f5e-aadf-00969d556d28 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:48.050778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff5178-a948-4f5e-aadf-00969d556d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:48.051061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff5178-a948-4f5e-aadf-00969d556d28 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:48.051754 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff5178-a948-4f5e-aadf-00969d556d28 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:48.052065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff5178-a948-4f5e-aadf-00969d556d28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:48.053463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff5178-a948-4f5e-aadf-00969d556d28 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:48.061076 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 336/699] 10.222.0.15 () {56 vars in 1124 bytes} [Sat Aug 6 01:20:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:48.066765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385b6fd-ca7b-4a83-9d85-da2ee05d8c3c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:48.139260 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:48.212939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385b6fd-ca7b-4a83-9d85-da2ee05d8c3c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:48.250978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c71072-9723-452d-a0ba-52fcc41a5995 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:48.251285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c71072-9723-452d-a0ba-52fcc41a5995 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:48.251549 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c71072-9723-452d-a0ba-52fcc41a5995 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:48.256795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 337/700] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:48.257994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361e0bb-9083-4983-978c-1c2e39793542 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:48.258285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361e0bb-9083-4983-978c-1c2e39793542 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:48.258566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361e0bb-9083-4983-978c-1c2e39793542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:48.261185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286459b-66ab-45d6-91b1-01f9da2370f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:48.262647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286459b-66ab-45d6-91b1-01f9da2370f3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:48.263138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286459b-66ab-45d6-91b1-01f9da2370f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:48.263623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286459b-66ab-45d6-91b1-01f9da2370f3 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:48.264779 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286459b-66ab-45d6-91b1-01f9da2370f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:48.265301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286459b-66ab-45d6-91b1-01f9da2370f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:48.266867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286459b-66ab-45d6-91b1-01f9da2370f3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:48.283441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 364/701] 10.222.0.15 () {56 vars in 1124 bytes} [Sat Aug 6 01:20:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:48.294450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0361e0bb-9083-4983-978c-1c2e39793542 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:48.296053 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0361e0bb-9083-4983-978c-1c2e39793542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:48.404513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 338/702] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:48.439027 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286459b-66ab-45d6-91b1-01f9da2370f3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:48.453851 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c047b-f55f-433c-b5b6-587f2106c9c8 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:48.454494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c047b-f55f-433c-b5b6-587f2106c9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:48.455001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c047b-f55f-433c-b5b6-587f2106c9c8 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:48.456797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 339/703] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:20:48.483006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aac1d-31da-4350-976d-065b671917d2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:48.483816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aac1d-31da-4350-976d-065b671917d2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:48.484327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aac1d-31da-4350-976d-065b671917d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:48.509736 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cf9aac1d-31da-4350-976d-065b671917d2 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:48.512781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cf9aac1d-31da-4350-976d-065b671917d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:48.584278 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286459b-66ab-45d6-91b1-01f9da2370f3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:48.595068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:48.610697 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:48.623592 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 340/704] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:48.640726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959af8a-d383-430c-80af-9e199a5afb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:48.641688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959af8a-d383-430c-80af-9e199a5afb29 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:48.642167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959af8a-d383-430c-80af-9e199a5afb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:48.642634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959af8a-d383-430c-80af-9e199a5afb29 None admin] PATH_INFO: `/v3/services/network` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:48.643482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959af8a-d383-430c-80af-9e199a5afb29 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:48.645064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959af8a-d383-430c-80af-9e199a5afb29 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3959af8a-d383-430c-80af-9e199a5afb29 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:48.657057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:48.658060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:20:48.658965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:48.661690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 365/705] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:48 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:48.667184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9aac1d-31da-4350-976d-065b671917d2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:48.677290 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959af8a-d383-430c-80af-9e199a5afb29 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:48.796015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959af8a-d383-430c-80af-9e199a5afb29 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:48.843010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b0950-6c4f-4f12-b04c-114491112df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:48.844002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b0950-6c4f-4f12-b04c-114491112df0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:48.844478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b0950-6c4f-4f12-b04c-114491112df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:48.844973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b0950-6c4f-4f12-b04c-114491112df0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:48.857411 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b0950-6c4f-4f12-b04c-114491112df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c60b0950-6c4f-4f12-b04c-114491112df0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:48.863146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:48.864083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:48.864951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:48.864951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:48.864951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:48.864951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:48.864951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:48.864951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:48.864951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:48.864951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:48.864951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:48.864951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:48.864951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:48.864951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:48.867655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 366/706] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:20:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:48.874005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b0950-6c4f-4f12-b04c-114491112df0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:48.904928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9aac1d-31da-4350-976d-065b671917d2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:48.920821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:48.940943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a506ffd-ed1a-42de-b297-a61ffb83f5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:48.940943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a506ffd-ed1a-42de-b297-a61ffb83f5fb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:48.940943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a506ffd-ed1a-42de-b297-a61ffb83f5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:48.940943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a506ffd-ed1a-42de-b297-a61ffb83f5fb None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:48.941378 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a506ffd-ed1a-42de-b297-a61ffb83f5fb None admin] RBAC: Adding query filter params (name=network) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:48.941378 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a506ffd-ed1a-42de-b297-a61ffb83f5fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:48.941378 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a506ffd-ed1a-42de-b297-a61ffb83f5fb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:48.945817 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 341/707] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:20:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:48.952160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a506ffd-ed1a-42de-b297-a61ffb83f5fb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:49.051086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:49.068673 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b0950-6c4f-4f12-b04c-114491112df0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:49.139699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6515c40-a57b-4861-8104-c390d765fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:49.140248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6515c40-a57b-4861-8104-c390d765fc1d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:49.140534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6515c40-a57b-4861-8104-c390d765fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:49.140812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6515c40-a57b-4861-8104-c390d765fc1d None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:49.141566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6515c40-a57b-4861-8104-c390d765fc1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:49.141873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6515c40-a57b-4861-8104-c390d765fc1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:49.143351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6515c40-a57b-4861-8104-c390d765fc1d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:49.146195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a506ffd-ed1a-42de-b297-a61ffb83f5fb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:49.166610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 367/708] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:49.172636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6515c40-a57b-4861-8104-c390d765fc1d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:49.217509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d1c1c-ff73-420e-9d36-8717d06ea8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:49.218131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1c1c-ff73-420e-9d36-8717d06ea8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:49.218417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1c1c-ff73-420e-9d36-8717d06ea8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:49.218692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1c1c-ff73-420e-9d36-8717d06ea8f8 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:49.219377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d1c1c-ff73-420e-9d36-8717d06ea8f8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:49.219683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d1c1c-ff73-420e-9d36-8717d06ea8f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:49.221072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d1c1c-ff73-420e-9d36-8717d06ea8f8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:49.233106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 342/709] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:20:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:49.317970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:49.330094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6515c40-a57b-4861-8104-c390d765fc1d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:49.381163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a10f69-c966-4cf7-b2f8-82a60a9425d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:49.381912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a10f69-c966-4cf7-b2f8-82a60a9425d5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:49.382203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a10f69-c966-4cf7-b2f8-82a60a9425d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:49.382486 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a10f69-c966-4cf7-b2f8-82a60a9425d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:49.396116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a10f69-c966-4cf7-b2f8-82a60a9425d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:49.405816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a10f69-c966-4cf7-b2f8-82a60a9425d5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d5a10f69-c966-4cf7-b2f8-82a60a9425d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:49.422504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:49.423495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:49.424398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:49.424398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:49.424398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:49.424398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:49.424398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 368/710] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:49.430078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d1c1c-ff73-420e-9d36-8717d06ea8f8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:49.524288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41eab7-ddfa-4e0c-a9a4-36048aee305d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:49.524665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41eab7-ddfa-4e0c-a9a4-36048aee305d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:49.525778 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41eab7-ddfa-4e0c-a9a4-36048aee305d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:49.526708 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 369/711] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:49.532935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6130-205c-48b0-9461-b5fbb77738fc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:49.533351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6130-205c-48b0-9461-b5fbb77738fc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:49.533719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6130-205c-48b0-9461-b5fbb77738fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:49.558838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4e6e6130-205c-48b0-9461-b5fbb77738fc None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:49.560169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4e6e6130-205c-48b0-9461-b5fbb77738fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:49.564506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d1c1c-ff73-420e-9d36-8717d06ea8f8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:49.586486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:49.607947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85dbfb-0af3-43b1-83ed-64beead68cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:49.608937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85dbfb-0af3-43b1-83ed-64beead68cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:49.609408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85dbfb-0af3-43b1-83ed-64beead68cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:49.610131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85dbfb-0af3-43b1-83ed-64beead68cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:49.611058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85dbfb-0af3-43b1-83ed-64beead68cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:49.611834 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85dbfb-0af3-43b1-83ed-64beead68cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:49.614148 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85dbfb-0af3-43b1-83ed-64beead68cb8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:49.635854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 343/712] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:49.637949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85dbfb-0af3-43b1-83ed-64beead68cb8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:49.747231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 370/713] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:20:49.749360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85dbfb-0af3-43b1-83ed-64beead68cb8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:49.784928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e6130-205c-48b0-9461-b5fbb77738fc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:49.795781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9e242-d4bf-4c47-babb-ef28e9f05d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:49.796436 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9e242-d4bf-4c47-babb-ef28e9f05d84 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:49.796714 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9e242-d4bf-4c47-babb-ef28e9f05d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:49.797019 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9e242-d4bf-4c47-babb-ef28e9f05d84 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:49.810594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9e242-d4bf-4c47-babb-ef28e9f05d84 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:49.812018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9e242-d4bf-4c47-babb-ef28e9f05d84 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-bbe9e242-d4bf-4c47-babb-ef28e9f05d84 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:49.829990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:49.831003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:49.832116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:49.832116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:49.832116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:49.832116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:49.832116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:49.832116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:49.832116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:49.832116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:49.832116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:20:49.832116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:49.832116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 344/714] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 6 01:20:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:49.842092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9e242-d4bf-4c47-babb-ef28e9f05d84 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:49.924525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:49.924720 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:49.978474 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e6130-205c-48b0-9461-b5fbb77738fc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:50.033268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9e242-d4bf-4c47-babb-ef28e9f05d84 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:50.039157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5232a9b-2937-4a7a-910d-1e907eb4ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:50.039806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5232a9b-2937-4a7a-910d-1e907eb4ec19 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.040083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5232a9b-2937-4a7a-910d-1e907eb4ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.040353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5232a9b-2937-4a7a-910d-1e907eb4ec19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.051925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5232a9b-2937-4a7a-910d-1e907eb4ec19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b5232a9b-2937-4a7a-910d-1e907eb4ec19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:50.056860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:50.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:50.059782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 371/715] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:50.065022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5232a9b-2937-4a7a-910d-1e907eb4ec19 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:50.106678 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c0364-e28d-4404-82d8-c5cad9f7d5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:50.107346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c0364-e28d-4404-82d8-c5cad9f7d5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.107630 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c0364-e28d-4404-82d8-c5cad9f7d5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.107900 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c0364-e28d-4404-82d8-c5cad9f7d5d6 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.108699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c0364-e28d-4404-82d8-c5cad9f7d5d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:50.109610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c0364-e28d-4404-82d8-c5cad9f7d5d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:50.111016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c0364-e28d-4404-82d8-c5cad9f7d5d6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:50.147220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 345/716] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 6 01:20:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:50.151109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c0364-e28d-4404-82d8-c5cad9f7d5d6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:50.209693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5232a9b-2937-4a7a-910d-1e907eb4ec19 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:50.247940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5d124-56f1-4810-925d-4b11c0064e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:50.248967 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5d124-56f1-4810-925d-4b11c0064e94 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.249480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5d124-56f1-4810-925d-4b11c0064e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.249964 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5d124-56f1-4810-925d-4b11c0064e94 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.250879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5d124-56f1-4810-925d-4b11c0064e94 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:50.251386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5d124-56f1-4810-925d-4b11c0064e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:50.252966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5d124-56f1-4810-925d-4b11c0064e94 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:50.260783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:50.262884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:50.263451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 372/717] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:50.268084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c0364-e28d-4404-82d8-c5cad9f7d5d6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:50.269063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5d124-56f1-4810-925d-4b11c0064e94 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:50.326854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c2462-f509-4603-8091-ca1b69b75cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:50.327645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c2462-f509-4603-8091-ca1b69b75cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.328307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c2462-f509-4603-8091-ca1b69b75cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.328595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c2462-f509-4603-8091-ca1b69b75cd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.421475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c2462-f509-4603-8091-ca1b69b75cd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:50.422857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c2462-f509-4603-8091-ca1b69b75cd3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:50.424885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5d124-56f1-4810-925d-4b11c0064e94 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:50.470976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc1933-50fb-45d0-b20c-593d31d0867c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:50.472292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1933-50fb-45d0-b20c-593d31d0867c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.473086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1933-50fb-45d0-b20c-593d31d0867c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.473625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1933-50fb-45d0-b20c-593d31d0867c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.488684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc1933-50fb-45d0-b20c-593d31d0867c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:50.491218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc1933-50fb-45d0-b20c-593d31d0867c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6ffc1933-50fb-45d0-b20c-593d31d0867c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:50.511507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:50.512445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:50.513377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:50.513377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:50.513377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:50.513377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:50.520946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 373/718] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:50.522235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d963e-6f51-4729-8b9c-10399fe15949 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.522527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d963e-6f51-4729-8b9c-10399fe15949 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.522802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d963e-6f51-4729-8b9c-10399fe15949 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.524303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 374/719] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:50.525032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d963e-6f51-4729-8b9c-10399fe15949 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:50.526512 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:50.544044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 346/720] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:20:50.545493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0c8a7-270a-442b-970c-36ae80362b8d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.546162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0c8a7-270a-442b-970c-36ae80362b8d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.546541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0c8a7-270a-442b-970c-36ae80362b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.570986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-40c0c8a7-270a-442b-970c-36ae80362b8d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:50.572395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-40c0c8a7-270a-442b-970c-36ae80362b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:50.584327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:50.650933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d963e-6f51-4729-8b9c-10399fe15949 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:50.655122 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 347/721] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:50.655973 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0c8a7-270a-442b-970c-36ae80362b8d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:50.693310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e349688-e7cf-4af7-8dce-9c1433828f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:50.693935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e349688-e7cf-4af7-8dce-9c1433828f12 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.694223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e349688-e7cf-4af7-8dce-9c1433828f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.694506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e349688-e7cf-4af7-8dce-9c1433828f12 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.695205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e349688-e7cf-4af7-8dce-9c1433828f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:50.695516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e349688-e7cf-4af7-8dce-9c1433828f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:50.696880 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e349688-e7cf-4af7-8dce-9c1433828f12 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:50.709411 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 375/722] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:50.710623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dfebd-fb3c-46bb-97e5-a76423f3a397 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.710913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dfebd-fb3c-46bb-97e5-a76423f3a397 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.711190 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dfebd-fb3c-46bb-97e5-a76423f3a397 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.716938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 376/723] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:50.716938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dfebd-fb3c-46bb-97e5-a76423f3a397 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:50.779812 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0c8a7-270a-442b-970c-36ae80362b8d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:50.811902 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:50.819955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dfebd-fb3c-46bb-97e5-a76423f3a397 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:50.823213 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c20ed-1fdd-4040-ab84-ddd567fb9534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:50.824380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c20ed-1fdd-4040-ab84-ddd567fb9534 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.824658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c20ed-1fdd-4040-ab84-ddd567fb9534 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.824944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c20ed-1fdd-4040-ab84-ddd567fb9534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.831195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:50.837268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c20ed-1fdd-4040-ab84-ddd567fb9534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:50.839190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c20ed-1fdd-4040-ab84-ddd567fb9534 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:50.857141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77330ed4-ad2b-4383-853a-ec5e49bb996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:50.857826 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77330ed4-ad2b-4383-853a-ec5e49bb996b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-067c20ed-1fdd-4040-ab84-ddd567fb9534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:50.858086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:50.858967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:50.859865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:50.859865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:50.859865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:50.859865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:50.860084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77330ed4-ad2b-4383-853a-ec5e49bb996b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.860084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77330ed4-ad2b-4383-853a-ec5e49bb996b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.860223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 348/724] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:50.860223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c20ed-1fdd-4040-ab84-ddd567fb9534 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:50.870805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77330ed4-ad2b-4383-853a-ec5e49bb996b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-77330ed4-ad2b-4383-853a-ec5e49bb996b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:50.875681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:50.876594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 377/725] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:20:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:50.878245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc66f7-105e-47c3-90a8-785b60e0c38a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.879008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc66f7-105e-47c3-90a8-785b60e0c38a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.879008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc66f7-105e-47c3-90a8-785b60e0c38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.897402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-74fc66f7-105e-47c3-90a8-785b60e0c38a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:50.898800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-74fc66f7-105e-47c3-90a8-785b60e0c38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:50.970222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 378/726] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:50.971087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc66f7-105e-47c3-90a8-785b60e0c38a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.090150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:51.094892 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc66f7-105e-47c3-90a8-785b60e0c38a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.098238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c20ed-1fdd-4040-ab84-ddd567fb9534 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.132725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af47a1-43d0-4c43-bf5a-610d2f25f82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.133784 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af47a1-43d0-4c43-bf5a-610d2f25f82e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.134263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af47a1-43d0-4c43-bf5a-610d2f25f82e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.134384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829824b6-a4d7-429d-96f6-81e8979cd05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.134845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af47a1-43d0-4c43-bf5a-610d2f25f82e None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.134965 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829824b6-a4d7-429d-96f6-81e8979cd05e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.135179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829824b6-a4d7-429d-96f6-81e8979cd05e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.135449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829824b6-a4d7-429d-96f6-81e8979cd05e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.136432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af47a1-43d0-4c43-bf5a-610d2f25f82e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:51.136928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af47a1-43d0-4c43-bf5a-610d2f25f82e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.138537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af47a1-43d0-4c43-bf5a-610d2f25f82e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.144603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829824b6-a4d7-429d-96f6-81e8979cd05e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.147301 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829824b6-a4d7-429d-96f6-81e8979cd05e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.157037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 379/727] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:51.157037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af47a1-43d0-4c43-bf5a-610d2f25f82e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-829824b6-a4d7-429d-96f6-81e8979cd05e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:51.161457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:51.162406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:51.163349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:51.163349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:51.163349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:51.163349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:51.163349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:51.163349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:51.163349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:51.163349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:51.163349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:20:51.163349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:51.167137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 349/728] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 6 01:20:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:51.168961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829824b6-a4d7-429d-96f6-81e8979cd05e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.212945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:51.263360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af47a1-43d0-4c43-bf5a-610d2f25f82e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.282875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829824b6-a4d7-429d-96f6-81e8979cd05e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.298606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13c2e6-3240-4bea-adf7-7a1dc38be6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.299247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13c2e6-3240-4bea-adf7-7a1dc38be6da None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.299528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13c2e6-3240-4bea-adf7-7a1dc38be6da None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.299812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13c2e6-3240-4bea-adf7-7a1dc38be6da None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.300526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13c2e6-3240-4bea-adf7-7a1dc38be6da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:51.300832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13c2e6-3240-4bea-adf7-7a1dc38be6da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.302207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13c2e6-3240-4bea-adf7-7a1dc38be6da None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.312941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 380/729] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:51.312941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13c2e6-3240-4bea-adf7-7a1dc38be6da None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.328382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628327b0-7d9b-4a5f-baf6-8a5dfdcd6ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.329027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628327b0-7d9b-4a5f-baf6-8a5dfdcd6ea5 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.329308 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628327b0-7d9b-4a5f-baf6-8a5dfdcd6ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.329587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628327b0-7d9b-4a5f-baf6-8a5dfdcd6ea5 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.330294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628327b0-7d9b-4a5f-baf6-8a5dfdcd6ea5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.331646 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628327b0-7d9b-4a5f-baf6-8a5dfdcd6ea5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.335333 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:51.357021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 350/730] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:20:51 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:51.357021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628327b0-7d9b-4a5f-baf6-8a5dfdcd6ea5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.444700 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13c2e6-3240-4bea-adf7-7a1dc38be6da None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.492337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32ac85-a7a2-4929-8649-42686859a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.493183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32ac85-a7a2-4929-8649-42686859a5ca None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.493569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32ac85-a7a2-4929-8649-42686859a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.493905 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32ac85-a7a2-4929-8649-42686859a5ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.502640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32ac85-a7a2-4929-8649-42686859a5ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.504036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:51.504247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32ac85-a7a2-4929-8649-42686859a5ca None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.510484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628327b0-7d9b-4a5f-baf6-8a5dfdcd6ea5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-fa32ac85-a7a2-4929-8649-42686859a5ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:51.522414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:51.523359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:51.524270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:51.524270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:51.524270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:51.524270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:51.524270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:51.524270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:51.524270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:51.524270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:51.528262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 381/731] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:51.529169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32ac85-a7a2-4929-8649-42686859a5ca None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.558446 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acadc6-1e61-4ebe-802c-77d651915d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.559865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acadc6-1e61-4ebe-802c-77d651915d79 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.560225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acadc6-1e61-4ebe-802c-77d651915d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.560578 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acadc6-1e61-4ebe-802c-77d651915d79 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.561503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acadc6-1e61-4ebe-802c-77d651915d79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:51.561883 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acadc6-1e61-4ebe-802c-77d651915d79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.563390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acadc6-1e61-4ebe-802c-77d651915d79 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.585314 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 351/732] 10.222.0.15 () {56 vars in 1149 bytes} [Sat Aug 6 01:20:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:51.586720 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acadc6-1e61-4ebe-802c-77d651915d79 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.622945 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:51.648654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32ac85-a7a2-4929-8649-42686859a5ca None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.685003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4094c-825b-42bf-b0cd-60f22afc76c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.685786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4094c-825b-42bf-b0cd-60f22afc76c7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.686170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4094c-825b-42bf-b0cd-60f22afc76c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.686542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4094c-825b-42bf-b0cd-60f22afc76c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.695458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acadc6-1e61-4ebe-802c-77d651915d79 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.698141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4094c-825b-42bf-b0cd-60f22afc76c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.699808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4094c-825b-42bf-b0cd-60f22afc76c7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a9a4094c-825b-42bf-b0cd-60f22afc76c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:51.715900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:51.717043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:51.718157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:51.718157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:51.718157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:51.718157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:51.721726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 382/733] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:51.722977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cc429-6dc8-4b71-8929-c07c05dcede3 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.723263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cc429-6dc8-4b71-8929-c07c05dcede3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.723542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cc429-6dc8-4b71-8929-c07c05dcede3 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.725058 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 383/734] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:51.729389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cc429-6dc8-4b71-8929-c07c05dcede3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.734863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db014a6-1155-4d54-9aa5-30955c889ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.735484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db014a6-1155-4d54-9aa5-30955c889ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.735767 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db014a6-1155-4d54-9aa5-30955c889ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.736043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db014a6-1155-4d54-9aa5-30955c889ef5 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.736794 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db014a6-1155-4d54-9aa5-30955c889ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:51.737142 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db014a6-1155-4d54-9aa5-30955c889ef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.738559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db014a6-1155-4d54-9aa5-30955c889ef5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.751630 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 352/735] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:51.752737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db014a6-1155-4d54-9aa5-30955c889ef5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.774423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:51.846431 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cc429-6dc8-4b71-8929-c07c05dcede3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.862661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db014a6-1155-4d54-9aa5-30955c889ef5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.875402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:51.883692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2aecc-fde0-4dcf-b914-d4dee3ab5630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.884311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2aecc-fde0-4dcf-b914-d4dee3ab5630 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.884854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2aecc-fde0-4dcf-b914-d4dee3ab5630 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.884854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2aecc-fde0-4dcf-b914-d4dee3ab5630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.900061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4d29b-eece-4d25-a839-780692084c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.900997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d29b-eece-4d25-a839-780692084c04 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.901284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d29b-eece-4d25-a839-780692084c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.901564 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d29b-eece-4d25-a839-780692084c04 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.902949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d29b-eece-4d25-a839-780692084c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:51.903322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d29b-eece-4d25-a839-780692084c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.905324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d29b-eece-4d25-a839-780692084c04 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.921902 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 353/736] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:51.923495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671132d9-292b-421b-8de7-042be401b60f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.923993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671132d9-292b-421b-8de7-042be401b60f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.924475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671132d9-292b-421b-8de7-042be401b60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.942273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-671132d9-292b-421b-8de7-042be401b60f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:51.943444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-671132d9-292b-421b-8de7-042be401b60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:51.963231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2aecc-fde0-4dcf-b914-d4dee3ab5630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.966033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2aecc-fde0-4dcf-b914-d4dee3ab5630 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:52.013415 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 354/737] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:20:52.014840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671132d9-292b-421b-8de7-042be401b60f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:52.024875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:52.092739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 384/738] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:51 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:20:52.093907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2aecc-fde0-4dcf-b914-d4dee3ab5630 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:52.119062 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671132d9-292b-421b-8de7-042be401b60f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:52.124251 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:52.157248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f10e09-e598-4d1d-ac66-9c96e57ceeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:52.157792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10e09-e598-4d1d-ac66-9c96e57ceeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:52.158072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10e09-e598-4d1d-ac66-9c96e57ceeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:52.158350 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f10e09-e598-4d1d-ac66-9c96e57ceeb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:52.159140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f10e09-e598-4d1d-ac66-9c96e57ceeb3 None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=666f4864832445d5a10d60f677f5cd6c) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:52.159453 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f10e09-e598-4d1d-ac66-9c96e57ceeb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:52.160875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f10e09-e598-4d1d-ac66-9c96e57ceeb3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:52.176949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 355/739] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:52 2022] GET /identity/v3/role_assignments?user.id=666f4864832445d5a10d60f677f5cd6c&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:52.176949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f10e09-e598-4d1d-ac66-9c96e57ceeb3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:52.212316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2aecc-fde0-4dcf-b914-d4dee3ab5630 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:52.254631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dbcea-b9c3-47f1-8124-fe216be85bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:52.255346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dbcea-b9c3-47f1-8124-fe216be85bcd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:52.255638 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dbcea-b9c3-47f1-8124-fe216be85bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:52.255912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dbcea-b9c3-47f1-8124-fe216be85bcd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:52.260946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:52.270180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8dbcea-b9c3-47f1-8124-fe216be85bcd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:52.272095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8dbcea-b9c3-47f1-8124-fe216be85bcd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5e8dbcea-b9c3-47f1-8124-fe216be85bcd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:52.293455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:52.294695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:52.295868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:52.295868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:52.295868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:52.295868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:52.295868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:52.295868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:52.295868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:52.295868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:52.295868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:20:52.295868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:52.303683 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 385/740] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:20:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:52.303683 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dbcea-b9c3-47f1-8124-fe216be85bcd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:52.310058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f10e09-e598-4d1d-ac66-9c96e57ceeb3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:52.350906 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998be9d-abb6-46ba-8e35-e40ca807f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:52.351525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998be9d-abb6-46ba-8e35-e40ca807f520 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:52.351806 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998be9d-abb6-46ba-8e35-e40ca807f520 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:52.352080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998be9d-abb6-46ba-8e35-e40ca807f520 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:52.352774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998be9d-abb6-46ba-8e35-e40ca807f520 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:52.355531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998be9d-abb6-46ba-8e35-e40ca807f520 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:52.379201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 356/741] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:20:52 2022] POST /identity/v3/services => generated 240 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:52.380410 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998be9d-abb6-46ba-8e35-e40ca807f520 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:52.417924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:52.444926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dbcea-b9c3-47f1-8124-fe216be85bcd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:52.518316 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998be9d-abb6-46ba-8e35-e40ca807f520 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:52.545555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35c5f2-1b8b-4cb6-b73b-19fbab45616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:52.546217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35c5f2-1b8b-4cb6-b73b-19fbab45616e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:52.546513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35c5f2-1b8b-4cb6-b73b-19fbab45616e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:52.546791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35c5f2-1b8b-4cb6-b73b-19fbab45616e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:52.553279 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:52.569286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f00b14-b9d3-40cf-b4f2-e3dfada43625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:52.570024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f00b14-b9d3-40cf-b4f2-e3dfada43625 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:52.570305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f00b14-b9d3-40cf-b4f2-e3dfada43625 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:52.570639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f00b14-b9d3-40cf-b4f2-e3dfada43625 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:52.571459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f00b14-b9d3-40cf-b4f2-e3dfada43625 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:52.572554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f00b14-b9d3-40cf-b4f2-e3dfada43625 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:52.573847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f00b14-b9d3-40cf-b4f2-e3dfada43625 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:52.575641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35c5f2-1b8b-4cb6-b73b-19fbab45616e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:52.578032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35c5f2-1b8b-4cb6-b73b-19fbab45616e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:52.599665 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 357/742] 10.222.0.15 () {56 vars in 1135 bytes} [Sat Aug 6 01:20:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6c35c5f2-1b8b-4cb6-b73b-19fbab45616e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:52.600559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:52.601509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:52.602410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:52.602410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:52.602410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:52.602410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:52.604528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 386/743] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:52.606652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f00b14-b9d3-40cf-b4f2-e3dfada43625 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:52.610649 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35c5f2-1b8b-4cb6-b73b-19fbab45616e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:52.734183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f00b14-b9d3-40cf-b4f2-e3dfada43625 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:52.739518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35c5f2-1b8b-4cb6-b73b-19fbab45616e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:52.777427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3281123-d2f5-4210-a005-a0e3586b00c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:52.778168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3281123-d2f5-4210-a005-a0e3586b00c6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:52.778522 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3281123-d2f5-4210-a005-a0e3586b00c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:52.778861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3281123-d2f5-4210-a005-a0e3586b00c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:52.779626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3281123-d2f5-4210-a005-a0e3586b00c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:52.779999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3281123-d2f5-4210-a005-a0e3586b00c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:52.781502 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3281123-d2f5-4210-a005-a0e3586b00c6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:52.782150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f386892-4d20-4a39-9fe1-918fa82583b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:52.783324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f386892-4d20-4a39-9fe1-918fa82583b8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:52.783790 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f386892-4d20-4a39-9fe1-918fa82583b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:52.784794 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f386892-4d20-4a39-9fe1-918fa82583b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:52.791841 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:52.803371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 387/744] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:52.808662 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3281123-d2f5-4210-a005-a0e3586b00c6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:52.848894 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:52.870611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f386892-4d20-4a39-9fe1-918fa82583b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:52.872605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f386892-4d20-4a39-9fe1-918fa82583b8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:52.990551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 358/745] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:20:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:20:52.999856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f386892-4d20-4a39-9fe1-918fa82583b8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:53.033458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3281123-d2f5-4210-a005-a0e3586b00c6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:53.114981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482ac57-d237-4571-9efc-f4e0ed0aa772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:53.115672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:53.115789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482ac57-d237-4571-9efc-f4e0ed0aa772 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:53.115971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482ac57-d237-4571-9efc-f4e0ed0aa772 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:53.116259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482ac57-d237-4571-9efc-f4e0ed0aa772 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:53.127868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482ac57-d237-4571-9efc-f4e0ed0aa772 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:53.129639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482ac57-d237-4571-9efc-f4e0ed0aa772 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:53.136988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f386892-4d20-4a39-9fe1-918fa82583b8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-1482ac57-d237-4571-9efc-f4e0ed0aa772 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:53.155105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:53.156062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:53.157069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:53.157069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:53.157069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:53.157069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:53.157069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:53.157069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:53.157069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:53.157069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:53.157069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 388/746] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:53.171185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482ac57-d237-4571-9efc-f4e0ed0aa772 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:53.186255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577584d-42d5-41c1-9427-2b689e03c037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:53.186912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577584d-42d5-41c1-9427-2b689e03c037 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:53.187199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577584d-42d5-41c1-9427-2b689e03c037 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:53.187479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577584d-42d5-41c1-9427-2b689e03c037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:53.198181 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577584d-42d5-41c1-9427-2b689e03c037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:53.200461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577584d-42d5-41c1-9427-2b689e03c037 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2577584d-42d5-41c1-9427-2b689e03c037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:53.215862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:53.216800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:53.217746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:53.217746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:53.217746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:53.217746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:53.217746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 359/747] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:53.222876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577584d-42d5-41c1-9427-2b689e03c037 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:53.290438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:53.335566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577584d-42d5-41c1-9427-2b689e03c037 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:53.361458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482ac57-d237-4571-9efc-f4e0ed0aa772 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:53.371280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff7931-9350-4345-80de-ebedf0cf78ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:53.372283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff7931-9350-4345-80de-ebedf0cf78ca None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:53.372718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff7931-9350-4345-80de-ebedf0cf78ca None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:53.373190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff7931-9350-4345-80de-ebedf0cf78ca None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:53.374035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff7931-9350-4345-80de-ebedf0cf78ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:53.374478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff7931-9350-4345-80de-ebedf0cf78ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:53.376532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff7931-9350-4345-80de-ebedf0cf78ca None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:53.389942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 360/748] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:53.394392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:53.395503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff7931-9350-4345-80de-ebedf0cf78ca None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:53.413655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb3e27-9e34-4377-b824-54d3844603b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:53.414337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb3e27-9e34-4377-b824-54d3844603b7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:53.414621 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb3e27-9e34-4377-b824-54d3844603b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:53.414891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb3e27-9e34-4377-b824-54d3844603b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:53.415652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb3e27-9e34-4377-b824-54d3844603b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:53.416028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb3e27-9e34-4377-b824-54d3844603b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:53.417470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb3e27-9e34-4377-b824-54d3844603b7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:53.444110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 389/749] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:53.455919 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb3e27-9e34-4377-b824-54d3844603b7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:53.574457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff7931-9350-4345-80de-ebedf0cf78ca None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:53.641987 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb3e27-9e34-4377-b824-54d3844603b7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:53.643727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47879b0e-538a-4ac2-b6ca-846d6ad9d8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:53.645986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47879b0e-538a-4ac2-b6ca-846d6ad9d8dd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:53.646421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47879b0e-538a-4ac2-b6ca-846d6ad9d8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:53.647557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47879b0e-538a-4ac2-b6ca-846d6ad9d8dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:53.661256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47879b0e-538a-4ac2-b6ca-846d6ad9d8dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:53.662925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47879b0e-538a-4ac2-b6ca-846d6ad9d8dd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-47879b0e-538a-4ac2-b6ca-846d6ad9d8dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:53.680017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:53.681143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:53.682252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:53.682252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:53.682252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:53.682252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:53.682252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:53.682252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:53.682252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:53.682252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:53.689257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:53.689541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 361/750] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:53.695963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47879b0e-538a-4ac2-b6ca-846d6ad9d8dd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:53.721524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef89357-705e-46a8-97ef-2cf860ec1391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:53.722365 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef89357-705e-46a8-97ef-2cf860ec1391 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:53.722656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef89357-705e-46a8-97ef-2cf860ec1391 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:53.723275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef89357-705e-46a8-97ef-2cf860ec1391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:53.724086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef89357-705e-46a8-97ef-2cf860ec1391 None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=f922f2209fff4986b04e1f0aaeb20fe5) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:53.724403 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef89357-705e-46a8-97ef-2cf860ec1391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:53.726297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef89357-705e-46a8-97ef-2cf860ec1391 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:53.734703 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 390/751] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:53 2022] GET /identity/v3/role_assignments?user.id=f922f2209fff4986b04e1f0aaeb20fe5&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:53.736019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129b6b1-3ab0-4999-b3cc-01c92f42cc2d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:53.736312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129b6b1-3ab0-4999-b3cc-01c92f42cc2d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:53.736623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129b6b1-3ab0-4999-b3cc-01c92f42cc2d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:53.738161 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 391/752] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:53.753543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424471b4-3e52-4b46-bced-3108bc6f501f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:53.753965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424471b4-3e52-4b46-bced-3108bc6f501f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:53.754311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424471b4-3e52-4b46-bced-3108bc6f501f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:53.790417 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-424471b4-3e52-4b46-bced-3108bc6f501f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:53.794363 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-424471b4-3e52-4b46-bced-3108bc6f501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:53.797291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:53.904347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47879b0e-538a-4ac2-b6ca-846d6ad9d8dd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:53.926143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 392/753] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:20:53.953826 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424471b4-3e52-4b46-bced-3108bc6f501f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:53.983349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025a00b-da40-4244-8671-d1cf5e9dc5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:53.985176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025a00b-da40-4244-8671-d1cf5e9dc5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:53.988174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025a00b-da40-4244-8671-d1cf5e9dc5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:53.988655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025a00b-da40-4244-8671-d1cf5e9dc5c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:53.989711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025a00b-da40-4244-8671-d1cf5e9dc5c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:53.990238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025a00b-da40-4244-8671-d1cf5e9dc5c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:53.991977 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025a00b-da40-4244-8671-d1cf5e9dc5c4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:54.010437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 362/754] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:54.017962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025a00b-da40-4244-8671-d1cf5e9dc5c4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:54.116132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424471b4-3e52-4b46-bced-3108bc6f501f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:54.145265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:54.179295 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025a00b-da40-4244-8671-d1cf5e9dc5c4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:54.196756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d26112-1df5-426b-b100-10e39e8bd5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:54.197499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d26112-1df5-426b-b100-10e39e8bd5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:54.197703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:54.197814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d26112-1df5-426b-b100-10e39e8bd5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:54.198061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d26112-1df5-426b-b100-10e39e8bd5c0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:54.198865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d26112-1df5-426b-b100-10e39e8bd5c0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:54.200247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d26112-1df5-426b-b100-10e39e8bd5c0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:54.216700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dcca2-c8ab-45f0-8bad-92b2b0a273e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:54.217348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dcca2-c8ab-45f0-8bad-92b2b0a273e2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:54.217628 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dcca2-c8ab-45f0-8bad-92b2b0a273e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:54.217905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dcca2-c8ab-45f0-8bad-92b2b0a273e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:54.218841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dcca2-c8ab-45f0-8bad-92b2b0a273e2 None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=a8d43b9ceeba432db6d141bb52d4bf1e) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:54.219153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dcca2-c8ab-45f0-8bad-92b2b0a273e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-35d26112-1df5-426b-b100-10e39e8bd5c0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:54.219993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:54.221131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:20:54.222017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:54.222809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dcca2-c8ab-45f0-8bad-92b2b0a273e2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:54.226390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 363/755] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:20:54 2022] GET /identity/v3/role_assignments?user.id=a8d43b9ceeba432db6d141bb52d4bf1e&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:54.229352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 393/756] 10.222.0.15 () {56 vars in 1129 bytes} [Sat Aug 6 01:20:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:54.238961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dcca2-c8ab-45f0-8bad-92b2b0a273e2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:54.383347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dcca2-c8ab-45f0-8bad-92b2b0a273e2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:54.433141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2bc20-9500-4ef7-919d-3912d6802168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:54.434216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2bc20-9500-4ef7-919d-3912d6802168 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:54.434710 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2bc20-9500-4ef7-919d-3912d6802168 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:54.435191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2bc20-9500-4ef7-919d-3912d6802168 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:54.436099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2bc20-9500-4ef7-919d-3912d6802168 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:54.436613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2bc20-9500-4ef7-919d-3912d6802168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:54.438271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2bc20-9500-4ef7-919d-3912d6802168 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:54.444093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 364/757] 10.222.0.15 () {56 vars in 1124 bytes} [Sat Aug 6 01:20:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:54.450529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d26112-1df5-426b-b100-10e39e8bd5c0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:54.452544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1751a-bea2-407b-9f76-1943e66c7554 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:54.453117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1751a-bea2-407b-9f76-1943e66c7554 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:54.453618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1751a-bea2-407b-9f76-1943e66c7554 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:54.455433 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 365/758] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:20:54.461162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c6f88-61fc-4c64-a7cd-3cbad49409e0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:54.461780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c6f88-61fc-4c64-a7cd-3cbad49409e0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:54.462257 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c6f88-61fc-4c64-a7cd-3cbad49409e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:54.482770 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e73c6f88-61fc-4c64-a7cd-3cbad49409e0 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:54.484505 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e73c6f88-61fc-4c64-a7cd-3cbad49409e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:54.555585 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:54.602949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 366/759] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:20:54.624526 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c6f88-61fc-4c64-a7cd-3cbad49409e0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:54.659919 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d26112-1df5-426b-b100-10e39e8bd5c0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:54.750022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c6f88-61fc-4c64-a7cd-3cbad49409e0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:54.757629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb7e1a-8966-41ba-a5b5-5e7de583c2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:54.758667 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb7e1a-8966-41ba-a5b5-5e7de583c2ae None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:54.758954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb7e1a-8966-41ba-a5b5-5e7de583c2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:54.759231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb7e1a-8966-41ba-a5b5-5e7de583c2ae None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:54.759923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb7e1a-8966-41ba-a5b5-5e7de583c2ae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:54.760229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb7e1a-8966-41ba-a5b5-5e7de583c2ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:54.763741 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb7e1a-8966-41ba-a5b5-5e7de583c2ae None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:54.777353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 394/760] 10.222.0.15 () {56 vars in 1124 bytes} [Sat Aug 6 01:20:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:54.793069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb7e1a-8966-41ba-a5b5-5e7de583c2ae None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:54.810774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0873bf-6368-45d8-85c9-115d2edc9783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:54.811434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0873bf-6368-45d8-85c9-115d2edc9783 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:54.811769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0873bf-6368-45d8-85c9-115d2edc9783 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:54.812054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0873bf-6368-45d8-85c9-115d2edc9783 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:54.837907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0873bf-6368-45d8-85c9-115d2edc9783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-db0873bf-6368-45d8-85c9-115d2edc9783 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:54.844679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:54.845645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:54.846540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:54.846540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:54.846540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:54.846540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:54.846540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:54.846540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:54.846540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:54.846540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:54.846540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:54.846540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:54.846540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:54.846540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:54.852271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 367/761] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:54.854582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0873bf-6368-45d8-85c9-115d2edc9783 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:54.872766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:54.914082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:54.972003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb7e1a-8966-41ba-a5b5-5e7de583c2ae None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:54.999872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0873bf-6368-45d8-85c9-115d2edc9783 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:55.010799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dc1b2-c893-419c-b249-c6c9a9d5505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:55.011439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dc1b2-c893-419c-b249-c6c9a9d5505b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.011839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dc1b2-c893-419c-b249-c6c9a9d5505b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.012122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dc1b2-c893-419c-b249-c6c9a9d5505b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.013543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dc1b2-c893-419c-b249-c6c9a9d5505b None admin] RBAC: Adding query filter params (interface=public, service_id=6e783f91089349929f6087f24adb6bf2, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:55.014128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dc1b2-c893-419c-b249-c6c9a9d5505b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:55.015671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dc1b2-c893-419c-b249-c6c9a9d5505b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:55.025694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 395/762] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 6 01:20:54 2022] GET /identity/v3/endpoints?service_id=6e783f91089349929f6087f24adb6bf2&interface=public®ion_id=RegionOne => generated 194 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:55.027258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075baf5-7c3a-4253-8f38-1d4e46ae3866 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.027557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075baf5-7c3a-4253-8f38-1d4e46ae3866 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.027839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075baf5-7c3a-4253-8f38-1d4e46ae3866 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.029578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 396/763] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:55.030953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075baf5-7c3a-4253-8f38-1d4e46ae3866 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:55.049596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12ac4b-0a02-45cc-88b3-74a3f5efa826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:55.050220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12ac4b-0a02-45cc-88b3-74a3f5efa826 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.050498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12ac4b-0a02-45cc-88b3-74a3f5efa826 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.050767 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12ac4b-0a02-45cc-88b3-74a3f5efa826 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.051488 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12ac4b-0a02-45cc-88b3-74a3f5efa826 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:55.051791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12ac4b-0a02-45cc-88b3-74a3f5efa826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:55.053175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12ac4b-0a02-45cc-88b3-74a3f5efa826 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:55.062935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 368/764] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:55.064309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431fd63-4b43-47fd-8dc7-87147777c5c4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.064599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431fd63-4b43-47fd-8dc7-87147777c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.064872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431fd63-4b43-47fd-8dc7-87147777c5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.086474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f431fd63-4b43-47fd-8dc7-87147777c5c4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:55.087800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f431fd63-4b43-47fd-8dc7-87147777c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:55.168282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075baf5-7c3a-4253-8f38-1d4e46ae3866 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:55.173251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 369/765] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:20:55.174214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431fd63-4b43-47fd-8dc7-87147777c5c4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:55.175745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:55.215822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a05a7-0f09-4725-98a6-cf153bce546f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:55.216452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a05a7-0f09-4725-98a6-cf153bce546f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.216745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a05a7-0f09-4725-98a6-cf153bce546f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.217310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a05a7-0f09-4725-98a6-cf153bce546f None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.217992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a05a7-0f09-4725-98a6-cf153bce546f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:55.219119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:55.221061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a05a7-0f09-4725-98a6-cf153bce546f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:55.232423 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 397/766] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 6 01:20:55 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:55.232423 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a05a7-0f09-4725-98a6-cf153bce546f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:55.381573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a05a7-0f09-4725-98a6-cf153bce546f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:55.418264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5ebcc-8c94-4048-a5cb-1ac69424c0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:55.418920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5ebcc-8c94-4048-a5cb-1ac69424c0de None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.419205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5ebcc-8c94-4048-a5cb-1ac69424c0de None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.419480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5ebcc-8c94-4048-a5cb-1ac69424c0de None admin] PATH_INFO: `/v3/services/network` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.420118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5ebcc-8c94-4048-a5cb-1ac69424c0de None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:55.422485 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5ebcc-8c94-4048-a5cb-1ac69424c0de None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:55.432610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431fd63-4b43-47fd-8dc7-87147777c5c4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-2fe5ebcc-8c94-4048-a5cb-1ac69424c0de None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:55.434707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:55.435704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:20:55.436537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:55.441023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 398/767] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:55 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:55.443274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5ebcc-8c94-4048-a5cb-1ac69424c0de None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:55.486155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288fe94-30ce-4bf2-897f-77d9301c55eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:55.487228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288fe94-30ce-4bf2-897f-77d9301c55eb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.487828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:55.488973 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288fe94-30ce-4bf2-897f-77d9301c55eb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.490419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288fe94-30ce-4bf2-897f-77d9301c55eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.504963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288fe94-30ce-4bf2-897f-77d9301c55eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:55.507532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288fe94-30ce-4bf2-897f-77d9301c55eb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2288fe94-30ce-4bf2-897f-77d9301c55eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:55.529135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:55.530070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:55.531040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:55.531040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:55.531040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:55.531040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:55.534048 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 370/768] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:55.539256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288fe94-30ce-4bf2-897f-77d9301c55eb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:55.582338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5ebcc-8c94-4048-a5cb-1ac69424c0de None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:55.642074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854b1d0-5218-4707-b587-819f58c99aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:55.642920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854b1d0-5218-4707-b587-819f58c99aca None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.643350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854b1d0-5218-4707-b587-819f58c99aca None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.643783 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854b1d0-5218-4707-b587-819f58c99aca None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.644602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854b1d0-5218-4707-b587-819f58c99aca None admin] RBAC: Adding query filter params (name=network) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:55.645070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854b1d0-5218-4707-b587-819f58c99aca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:55.646671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854b1d0-5218-4707-b587-819f58c99aca None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:55.652799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 399/769] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:20:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:55.658718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854b1d0-5218-4707-b587-819f58c99aca None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:55.688939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:55.707282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288fe94-30ce-4bf2-897f-77d9301c55eb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:55.769158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2c30-8de5-47c4-99f9-bda727a30f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:55.769486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2c30-8de5-47c4-99f9-bda727a30f15 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.769780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2c30-8de5-47c4-99f9-bda727a30f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.770059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2c30-8de5-47c4-99f9-bda727a30f15 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.770763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2c30-8de5-47c4-99f9-bda727a30f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:55.771073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2c30-8de5-47c4-99f9-bda727a30f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:55.772443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2c30-8de5-47c4-99f9-bda727a30f15 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:55.792990 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:55.797863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854b1d0-5218-4707-b587-819f58c99aca None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:55.799581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 371/770] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:55.805191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2c30-8de5-47c4-99f9-bda727a30f15 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:55.839780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55162d2-fcc5-4743-b812-24447d220588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:55.841659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55162d2-fcc5-4743-b812-24447d220588 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.841953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55162d2-fcc5-4743-b812-24447d220588 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.842291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55162d2-fcc5-4743-b812-24447d220588 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.842992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55162d2-fcc5-4743-b812-24447d220588 None admin] RBAC: Adding query filter params (type=network) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:55.843307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55162d2-fcc5-4743-b812-24447d220588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:55.844740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55162d2-fcc5-4743-b812-24447d220588 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:55.854306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 400/771] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:20:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:55.862083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55162d2-fcc5-4743-b812-24447d220588 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:55.974611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2c30-8de5-47c4-99f9-bda727a30f15 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:55.977092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55162d2-fcc5-4743-b812-24447d220588 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:56.035569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b7e6f-589c-4831-b1fe-fb3d991bd00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:56.036198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b7e6f-589c-4831-b1fe-fb3d991bd00f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.036482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b7e6f-589c-4831-b1fe-fb3d991bd00f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.036758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b7e6f-589c-4831-b1fe-fb3d991bd00f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.037554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b7e6f-589c-4831-b1fe-fb3d991bd00f None admin] RBAC: Adding query filter params (interface=public, service_id=a59a8373c0fd40aeb20a1e52b8021603, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:56.037871 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b7e6f-589c-4831-b1fe-fb3d991bd00f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:56.039242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b7e6f-589c-4831-b1fe-fb3d991bd00f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:56.050732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 401/772] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 6 01:20:55 2022] GET /identity/v3/endpoints?service_id=a59a8373c0fd40aeb20a1e52b8021603&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:56.051885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9673de-08f7-4265-8724-a53b676a8ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:56.052599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9673de-08f7-4265-8724-a53b676a8ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.052884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9673de-08f7-4265-8724-a53b676a8ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.053184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9673de-08f7-4265-8724-a53b676a8ef3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.060848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b7e6f-589c-4831-b1fe-fb3d991bd00f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:56.070494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9673de-08f7-4265-8724-a53b676a8ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:56.071953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9673de-08f7-4265-8724-a53b676a8ef3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:56.074938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-fb9673de-08f7-4265-8724-a53b676a8ef3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:56.094561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:56.095562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:56.096510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:56.096510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:56.096510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:56.096510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:56.096510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:56.096510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:56.096510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:56.096510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:56.096510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:20:56.096510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:56.096510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 372/773] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 6 01:20:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:56.104071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9673de-08f7-4265-8724-a53b676a8ef3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:56.110492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:56.212638 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b7e6f-589c-4831-b1fe-fb3d991bd00f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:56.224521 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9673de-08f7-4265-8724-a53b676a8ef3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:56.250924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe176d-a93c-4f71-9ef6-617697da5ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:56.251859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe176d-a93c-4f71-9ef6-617697da5ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.252220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe176d-a93c-4f71-9ef6-617697da5ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.252571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe176d-a93c-4f71-9ef6-617697da5ea2 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.253941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe176d-a93c-4f71-9ef6-617697da5ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:56.255577 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe176d-a93c-4f71-9ef6-617697da5ea2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:56.262675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 402/774] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 6 01:20:56 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:56.262811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee6524-d29b-4bd6-b799-b0b676d4721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:56.263516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee6524-d29b-4bd6-b799-b0b676d4721a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.264220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8238-9e47-47dc-ae6e-92ced07f19fc None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.264328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee6524-d29b-4bd6-b799-b0b676d4721a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.264514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8238-9e47-47dc-ae6e-92ced07f19fc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.264613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee6524-d29b-4bd6-b799-b0b676d4721a None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.264796 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af8238-9e47-47dc-ae6e-92ced07f19fc None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.265529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee6524-d29b-4bd6-b799-b0b676d4721a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:56.265909 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee6524-d29b-4bd6-b799-b0b676d4721a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:56.267557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee6524-d29b-4bd6-b799-b0b676d4721a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:56.270524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 403/775] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:56.273083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f5bc-0c4d-4d63-a0ac-528228c0a2a9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.273378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f5bc-0c4d-4d63-a0ac-528228c0a2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.273663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f5bc-0c4d-4d63-a0ac-528228c0a2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.292787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 373/776] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 6 01:20:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:56.295986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-69d1f5bc-0c4d-4d63-a0ac-528228c0a2a9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:56.297492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-69d1f5bc-0c4d-4d63-a0ac-528228c0a2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:56.297989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee6524-d29b-4bd6-b799-b0b676d4721a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:56.409306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:56.431297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 404/777] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:20:56.459025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1f5bc-0c4d-4d63-a0ac-528228c0a2a9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:56.486012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:56.490299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee6524-d29b-4bd6-b799-b0b676d4721a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:56.533192 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5fad6-44e2-427d-943e-6ee3f89f2337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:56.533866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5fad6-44e2-427d-943e-6ee3f89f2337 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.534217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5fad6-44e2-427d-943e-6ee3f89f2337 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.534499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5fad6-44e2-427d-943e-6ee3f89f2337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.546804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5fad6-44e2-427d-943e-6ee3f89f2337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:56.548265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5fad6-44e2-427d-943e-6ee3f89f2337 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-65e5fad6-44e2-427d-943e-6ee3f89f2337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:56.566679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:56.567659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:56.568573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:56.568573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:56.568573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:56.568573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:56.568573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 374/778] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:56.576112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5fad6-44e2-427d-943e-6ee3f89f2337 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:56.582832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1f5bc-0c4d-4d63-a0ac-528228c0a2a9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:56.653086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa01eab-dd78-4dfa-a879-8cad4f996e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:56.653742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa01eab-dd78-4dfa-a879-8cad4f996e6c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.654020 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa01eab-dd78-4dfa-a879-8cad4f996e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.654290 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa01eab-dd78-4dfa-a879-8cad4f996e6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.676186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa01eab-dd78-4dfa-a879-8cad4f996e6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5aa01eab-dd78-4dfa-a879-8cad4f996e6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:56.684424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:56.686593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:56.688557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:56.688557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:56.688557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:56.688557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:56.688557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:56.688557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:56.688557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:56.688557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:56.688557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:56.688557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:56.688557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:20:56.688557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:56.692922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 405/779] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:20:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:20:56.696187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa01eab-dd78-4dfa-a879-8cad4f996e6c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:56.773416 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5fad6-44e2-427d-943e-6ee3f89f2337 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:56.783839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:56.810708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aa492-0e36-4271-9707-c1e77f93b19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:56.811395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa492-0e36-4271-9707-c1e77f93b19b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.811693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa492-0e36-4271-9707-c1e77f93b19b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.811976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa492-0e36-4271-9707-c1e77f93b19b None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.812677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aa492-0e36-4271-9707-c1e77f93b19b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:56.813030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aa492-0e36-4271-9707-c1e77f93b19b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:56.814400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aa492-0e36-4271-9707-c1e77f93b19b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:56.814896 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:56.828860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 375/780] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:56.830216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41468646-63f4-4136-bce4-be3edd59298d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.830513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41468646-63f4-4136-bce4-be3edd59298d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.830794 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41468646-63f4-4136-bce4-be3edd59298d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.834428 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa01eab-dd78-4dfa-a879-8cad4f996e6c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:56.836166 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 376/781] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:56.836959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41468646-63f4-4136-bce4-be3edd59298d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:56.879859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f481f88-5aea-4fd0-ae83-1a2343ef2535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:56.880486 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f481f88-5aea-4fd0-ae83-1a2343ef2535 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.880770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f481f88-5aea-4fd0-ae83-1a2343ef2535 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.881081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f481f88-5aea-4fd0-ae83-1a2343ef2535 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.881805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f481f88-5aea-4fd0-ae83-1a2343ef2535 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:56.882176 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f481f88-5aea-4fd0-ae83-1a2343ef2535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:56.883555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f481f88-5aea-4fd0-ae83-1a2343ef2535 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:56.895766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 406/782] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:20:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:56.897733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0005-69c7-485c-9144-bbbc020b91a6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.898084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0005-69c7-485c-9144-bbbc020b91a6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.898380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0005-69c7-485c-9144-bbbc020b91a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.926440 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9a2e0005-69c7-485c-9144-bbbc020b91a6 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:56.927810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9a2e0005-69c7-485c-9144-bbbc020b91a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:56.954188 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41468646-63f4-4136-bce4-be3edd59298d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:56.999624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32878ca-9560-4b68-bf6b-c06735774481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.000603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32878ca-9560-4b68-bf6b-c06735774481 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.000897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32878ca-9560-4b68-bf6b-c06735774481 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.001214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32878ca-9560-4b68-bf6b-c06735774481 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.004030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 407/783] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:20:57.004881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0005-69c7-485c-9144-bbbc020b91a6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.022625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32878ca-9560-4b68-bf6b-c06735774481 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.024088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32878ca-9560-4b68-bf6b-c06735774481 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c32878ca-9560-4b68-bf6b-c06735774481 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:57.039307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:57.040191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:57.041130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:57.041130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:57.041130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:57.041130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:57.041130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:57.041130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:57.041130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:57.041130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:57.041130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 377/784] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:57.042241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32878ca-9560-4b68-bf6b-c06735774481 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.071001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:57.105793 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:57.146234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0005-69c7-485c-9144-bbbc020b91a6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.150552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32878ca-9560-4b68-bf6b-c06735774481 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.194105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cc166-2e45-4e1d-86b1-2461ef4a1f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.194745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc166-2e45-4e1d-86b1-2461ef4a1f21 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.195030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc166-2e45-4e1d-86b1-2461ef4a1f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.195309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc166-2e45-4e1d-86b1-2461ef4a1f21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.197619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7007e50-4251-4058-b5f1-396cd3b78106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.199907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007e50-4251-4058-b5f1-396cd3b78106 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.200447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007e50-4251-4058-b5f1-396cd3b78106 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.200975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007e50-4251-4058-b5f1-396cd3b78106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.207924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cc166-2e45-4e1d-86b1-2461ef4a1f21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-657cc166-2e45-4e1d-86b1-2461ef4a1f21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:20:57.213382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:57.215201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:57.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:57.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:57.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:57.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:57.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:20:57.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:20:57.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:20:57.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:20:57.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:20:57.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:20:57.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:20:57.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:57.218468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7007e50-4251-4058-b5f1-396cd3b78106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.220010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 378/785] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:20:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:57.220864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cc166-2e45-4e1d-86b1-2461ef4a1f21 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.220991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7007e50-4251-4058-b5f1-396cd3b78106 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d7007e50-4251-4058-b5f1-396cd3b78106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:57.237769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:57.238734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:57.240061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:57.240061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:57.240061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:57.240061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:57.240061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 408/786] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:57.240061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7007e50-4251-4058-b5f1-396cd3b78106 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.325417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:57.339465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cc166-2e45-4e1d-86b1-2461ef4a1f21 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.380711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f660c68-770e-4a59-9de5-321a65590c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.381374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7007e50-4251-4058-b5f1-396cd3b78106 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.381960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f660c68-770e-4a59-9de5-321a65590c8a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.382538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f660c68-770e-4a59-9de5-321a65590c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.384766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f660c68-770e-4a59-9de5-321a65590c8a None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.385776 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f660c68-770e-4a59-9de5-321a65590c8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:57.386945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f660c68-770e-4a59-9de5-321a65590c8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.389032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f660c68-770e-4a59-9de5-321a65590c8a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.406856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 379/787] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:57.408567 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:57.409640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f660c68-770e-4a59-9de5-321a65590c8a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.428003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdb898-00ce-4a10-9a46-50cbff5e2ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.428689 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdb898-00ce-4a10-9a46-50cbff5e2ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.429012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdb898-00ce-4a10-9a46-50cbff5e2ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.429285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdb898-00ce-4a10-9a46-50cbff5e2ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.430017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdb898-00ce-4a10-9a46-50cbff5e2ac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:57.430326 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdb898-00ce-4a10-9a46-50cbff5e2ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.431728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdb898-00ce-4a10-9a46-50cbff5e2ac2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.446148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 409/788] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:20:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:57.447095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdb898-00ce-4a10-9a46-50cbff5e2ac2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.539467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f660c68-770e-4a59-9de5-321a65590c8a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.561028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdb898-00ce-4a10-9a46-50cbff5e2ac2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.583158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8df43b-ccd3-4a84-a035-2ef9ada7b499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.584024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8df43b-ccd3-4a84-a035-2ef9ada7b499 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.584309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8df43b-ccd3-4a84-a035-2ef9ada7b499 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.584586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8df43b-ccd3-4a84-a035-2ef9ada7b499 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.585318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8df43b-ccd3-4a84-a035-2ef9ada7b499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:57.585626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8df43b-ccd3-4a84-a035-2ef9ada7b499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.586984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8df43b-ccd3-4a84-a035-2ef9ada7b499 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.596524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fa08b-6aba-4b3f-9d88-477d7480b200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.597231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fa08b-6aba-4b3f-9d88-477d7480b200 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.597519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fa08b-6aba-4b3f-9d88-477d7480b200 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.597806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fa08b-6aba-4b3f-9d88-477d7480b200 None admin] PATH_INFO: `/v3/projects/c344ed6bac754173af05207b5f444dca/users/666f4864832445d5a10d60f677f5cd6c/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.603657 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 380/789] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:57.603657 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8df43b-ccd3-4a84-a035-2ef9ada7b499 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.604394 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fa08b-6aba-4b3f-9d88-477d7480b200 None admin] RBAC: Authorizing `identity:create_grant(project_id=c344ed6bac754173af05207b5f444dca, user_id=666f4864832445d5a10d60f677f5cd6c, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.606627 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fa08b-6aba-4b3f-9d88-477d7480b200 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.618899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:57.622310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 410/790] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:20:57 2022] PUT /identity/v3/projects/c344ed6bac754173af05207b5f444dca/users/666f4864832445d5a10d60f677f5cd6c/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:57.626360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6c1aa-b7f3-4054-8d57-0958823c489d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.626648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6c1aa-b7f3-4054-8d57-0958823c489d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.626923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6c1aa-b7f3-4054-8d57-0958823c489d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.628476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 411/791] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:57.633659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6c1aa-b7f3-4054-8d57-0958823c489d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.707542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:57.754164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8df43b-ccd3-4a84-a035-2ef9ada7b499 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.772746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6c1aa-b7f3-4054-8d57-0958823c489d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.795270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632a49e-ffc4-43f8-b516-a8964b02620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.795929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632a49e-ffc4-43f8-b516-a8964b02620b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.796257 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632a49e-ffc4-43f8-b516-a8964b02620b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.796548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632a49e-ffc4-43f8-b516-a8964b02620b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.811861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632a49e-ffc4-43f8-b516-a8964b02620b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.812577 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408faaf9-897b-4557-a387-69a2e334194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.813519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408faaf9-897b-4557-a387-69a2e334194b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.814012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408faaf9-897b-4557-a387-69a2e334194b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.814479 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408faaf9-897b-4557-a387-69a2e334194b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.815174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632a49e-ffc4-43f8-b516-a8964b02620b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.822956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408faaf9-897b-4557-a387-69a2e334194b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.824823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408faaf9-897b-4557-a387-69a2e334194b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-1632a49e-ffc4-43f8-b516-a8964b02620b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:57.833696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:57.834608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:57.835559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:57.835559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:57.835559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:57.835559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:57.835559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 381/792] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:57.836362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2dbc4-86be-4d38-88c4-76ff173470fd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.836653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2dbc4-86be-4d38-88c4-76ff173470fd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.843842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2dbc4-86be-4d38-88c4-76ff173470fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-408faaf9-897b-4557-a387-69a2e334194b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:57.843984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:57.845061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:57.846202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:57.846202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:57.846202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:57.846202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:57.846202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:57.846202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:57.846202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:57.846202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:57.846202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:20:57.846202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:57.846202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 412/793] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 6 01:20:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:57.846202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408faaf9-897b-4557-a387-69a2e334194b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.862741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-98c2dbc4-86be-4d38-88c4-76ff173470fd None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:57.864148 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-98c2dbc4-86be-4d38-88c4-76ff173470fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:57.928752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:57.949019 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 382/794] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:20:57.949950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2dbc4-86be-4d38-88c4-76ff173470fd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.971998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408faaf9-897b-4557-a387-69a2e334194b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.983099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:58.013595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db728d-9fb4-498d-81aa-ca6ec655a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.014498 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db728d-9fb4-498d-81aa-ca6ec655a808 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.014786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db728d-9fb4-498d-81aa-ca6ec655a808 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.015063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db728d-9fb4-498d-81aa-ca6ec655a808 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.015867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db728d-9fb4-498d-81aa-ca6ec655a808 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:58.016177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db728d-9fb4-498d-81aa-ca6ec655a808 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.017626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db728d-9fb4-498d-81aa-ca6ec655a808 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.036008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 413/795] 10.222.0.15 () {56 vars in 1149 bytes} [Sat Aug 6 01:20:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:58.036849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db728d-9fb4-498d-81aa-ca6ec655a808 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.105140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2dbc4-86be-4d38-88c4-76ff173470fd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.145418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db728d-9fb4-498d-81aa-ca6ec655a808 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.152962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41fb76-234e-4328-9d16-2eb55d7f7d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.154317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41fb76-234e-4328-9d16-2eb55d7f7d25 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.154709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41fb76-234e-4328-9d16-2eb55d7f7d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.155095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41fb76-234e-4328-9d16-2eb55d7f7d25 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.155916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41fb76-234e-4328-9d16-2eb55d7f7d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:58.156331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41fb76-234e-4328-9d16-2eb55d7f7d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.158232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41fb76-234e-4328-9d16-2eb55d7f7d25 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.173917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 383/796] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:58.174769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41fb76-234e-4328-9d16-2eb55d7f7d25 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.194615 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dfb4c-8459-458a-a6f8-708f0adf1d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.195369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dfb4c-8459-458a-a6f8-708f0adf1d11 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.195726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dfb4c-8459-458a-a6f8-708f0adf1d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.196074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dfb4c-8459-458a-a6f8-708f0adf1d11 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.197115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dfb4c-8459-458a-a6f8-708f0adf1d11 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.199723 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dfb4c-8459-458a-a6f8-708f0adf1d11 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4e0dfb4c-8459-458a-a6f8-708f0adf1d11 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:58.211942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:58.213716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:20:58.216050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:58.217686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 414/797] 10.222.0.15 () {56 vars in 1129 bytes} [Sat Aug 6 01:20:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:58.224954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dfb4c-8459-458a-a6f8-708f0adf1d11 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.244537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:58.260118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:58.310917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41fb76-234e-4328-9d16-2eb55d7f7d25 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.343760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dfb4c-8459-458a-a6f8-708f0adf1d11 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.348454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80922746-c729-4c4c-b971-371ea1e292e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.349627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80922746-c729-4c4c-b971-371ea1e292e3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.350088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80922746-c729-4c4c-b971-371ea1e292e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.350520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80922746-c729-4c4c-b971-371ea1e292e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.374484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80922746-c729-4c4c-b971-371ea1e292e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.376619 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80922746-c729-4c4c-b971-371ea1e292e3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.388549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329e0f9-7a05-4562-84d9-b77e453f8d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.389535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329e0f9-7a05-4562-84d9-b77e453f8d18 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.389823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329e0f9-7a05-4562-84d9-b77e453f8d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.390104 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329e0f9-7a05-4562-84d9-b77e453f8d18 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-80922746-c729-4c4c-b971-371ea1e292e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:58.396960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:58.397875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:58.398859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:58.398859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:58.398859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:58.398859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:58.400590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329e0f9-7a05-4562-84d9-b77e453f8d18 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.401328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 384/798] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:58.402605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80922746-c729-4c4c-b971-371ea1e292e3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.403308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329e0f9-7a05-4562-84d9-b77e453f8d18 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5329e0f9-7a05-4562-84d9-b77e453f8d18 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:20:58.417468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:58.418641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:58.419820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:58.419820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:58.419820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:20:58.419820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:20:58.419820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:20:58.419820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:20:58.419820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:20:58.419820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:20:58.419820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:20:58.419820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:58.427252 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 415/799] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:20:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:58.428555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329e0f9-7a05-4562-84d9-b77e453f8d18 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.521511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80922746-c729-4c4c-b971-371ea1e292e3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.523328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:58.547579 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:58.562132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329e0f9-7a05-4562-84d9-b77e453f8d18 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.576473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02daf11-e60e-4c73-bdbd-79ce8de194a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.577150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02daf11-e60e-4c73-bdbd-79ce8de194a5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.577438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02daf11-e60e-4c73-bdbd-79ce8de194a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.577722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02daf11-e60e-4c73-bdbd-79ce8de194a5 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.578411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02daf11-e60e-4c73-bdbd-79ce8de194a5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:58.578812 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02daf11-e60e-4c73-bdbd-79ce8de194a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.580073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02daf11-e60e-4c73-bdbd-79ce8de194a5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.589899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 385/800] 10.222.0.15 () {56 vars in 1124 bytes} [Sat Aug 6 01:20:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:58.590746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02daf11-e60e-4c73-bdbd-79ce8de194a5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.598359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ac0f9-afc6-43fc-b264-ed4f4c993517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.599056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac0f9-afc6-43fc-b264-ed4f4c993517 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.599412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac0f9-afc6-43fc-b264-ed4f4c993517 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.599764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac0f9-afc6-43fc-b264-ed4f4c993517 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.600538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ac0f9-afc6-43fc-b264-ed4f4c993517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:58.600945 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ac0f9-afc6-43fc-b264-ed4f4c993517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.602808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ac0f9-afc6-43fc-b264-ed4f4c993517 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.616488 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 416/801] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:58.617706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced631c-0871-45aa-a127-9aa9867bcfc3 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.617993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced631c-0871-45aa-a127-9aa9867bcfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.618268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced631c-0871-45aa-a127-9aa9867bcfc3 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.619618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 417/802] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:58.621623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced631c-0871-45aa-a127-9aa9867bcfc3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.704565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02daf11-e60e-4c73-bdbd-79ce8de194a5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.737177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced631c-0871-45aa-a127-9aa9867bcfc3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.738823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b312ba0-5ad8-4991-ae49-b4df1cc73da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.739439 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b312ba0-5ad8-4991-ae49-b4df1cc73da3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.739719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b312ba0-5ad8-4991-ae49-b4df1cc73da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.739990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b312ba0-5ad8-4991-ae49-b4df1cc73da3 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.740785 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b312ba0-5ad8-4991-ae49-b4df1cc73da3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:58.741120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b312ba0-5ad8-4991-ae49-b4df1cc73da3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.742537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b312ba0-5ad8-4991-ae49-b4df1cc73da3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.761803 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 386/803] 10.222.0.15 () {56 vars in 1135 bytes} [Sat Aug 6 01:20:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:58.762510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b312ba0-5ad8-4991-ae49-b4df1cc73da3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.782584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0697cd-d1b5-40d4-a15b-9c0cc41ab73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.783204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0697cd-d1b5-40d4-a15b-9c0cc41ab73f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.783484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0697cd-d1b5-40d4-a15b-9c0cc41ab73f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.783762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0697cd-d1b5-40d4-a15b-9c0cc41ab73f None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.784443 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0697cd-d1b5-40d4-a15b-9c0cc41ab73f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:58.784749 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0697cd-d1b5-40d4-a15b-9c0cc41ab73f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.786149 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0697cd-d1b5-40d4-a15b-9c0cc41ab73f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.796401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 418/804] 10.222.0.15 () {56 vars in 1124 bytes} [Sat Aug 6 01:20:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:58.796401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eff1f-c3fa-4051-b6c8-8af7576489c6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.796401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eff1f-c3fa-4051-b6c8-8af7576489c6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.796401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eff1f-c3fa-4051-b6c8-8af7576489c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.799743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:58.814504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c93eff1f-c3fa-4051-b6c8-8af7576489c6 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:58.815705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c93eff1f-c3fa-4051-b6c8-8af7576489c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:58.824764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:58.886251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b312ba0-5ad8-4991-ae49-b4df1cc73da3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.889802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 419/805] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:20:58.890789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eff1f-c3fa-4051-b6c8-8af7576489c6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.933208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb81fc-85d8-404b-a270-c6d49d92949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.933961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb81fc-85d8-404b-a270-c6d49d92949b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.934295 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb81fc-85d8-404b-a270-c6d49d92949b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.934579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb81fc-85d8-404b-a270-c6d49d92949b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.941410 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb81fc-85d8-404b-a270-c6d49d92949b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.942840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb81fc-85d8-404b-a270-c6d49d92949b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-efeb81fc-85d8-404b-a270-c6d49d92949b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:58.955551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:58.956479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:58.957643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:58.957643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:58.957643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:58.957643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:58.957643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:58.957643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:58.957643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:58.957643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:58.957643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 387/806] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:58.957643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb81fc-85d8-404b-a270-c6d49d92949b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.009655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eff1f-c3fa-4051-b6c8-8af7576489c6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.046336 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6517ebb-2918-4a97-aaff-2872e0c88a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.046980 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6517ebb-2918-4a97-aaff-2872e0c88a87 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.047263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6517ebb-2918-4a97-aaff-2872e0c88a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.047539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6517ebb-2918-4a97-aaff-2872e0c88a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.056300 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:59.057535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6517ebb-2918-4a97-aaff-2872e0c88a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.059934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6517ebb-2918-4a97-aaff-2872e0c88a87 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.062101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:59.075410 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb81fc-85d8-404b-a270-c6d49d92949b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f6517ebb-2918-4a97-aaff-2872e0c88a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:20:59.079208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:59.080070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:59.081394 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:20:59.081394 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:20:59.081394 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:20:59.081394 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:59.081394 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 420/807] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:59.082242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6517ebb-2918-4a97-aaff-2872e0c88a87 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.117388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743d24-7795-43ba-9499-acac10d60025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.118013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743d24-7795-43ba-9499-acac10d60025 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.118317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743d24-7795-43ba-9499-acac10d60025 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.118568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743d24-7795-43ba-9499-acac10d60025 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.119621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af743d24-7795-43ba-9499-acac10d60025 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.121262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af743d24-7795-43ba-9499-acac10d60025 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.156934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 388/808] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:59.156934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743d24-7795-43ba-9499-acac10d60025 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.221954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6517ebb-2918-4a97-aaff-2872e0c88a87 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.270901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89215625-8ed5-445c-bce1-f5a2fb11614c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.271706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89215625-8ed5-445c-bce1-f5a2fb11614c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.272096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89215625-8ed5-445c-bce1-f5a2fb11614c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.272473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89215625-8ed5-445c-bce1-f5a2fb11614c None admin] PATH_INFO: `/v3/services/network` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.273296 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89215625-8ed5-445c-bce1-f5a2fb11614c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.274781 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89215625-8ed5-445c-bce1-f5a2fb11614c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-89215625-8ed5-445c-bce1-f5a2fb11614c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:59.285069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:59.286207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:20:59.287056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 421/809] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:59 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:59.288593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89215625-8ed5-445c-bce1-f5a2fb11614c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.311911 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743d24-7795-43ba-9499-acac10d60025 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.356997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd416eb6-a801-4e7d-9181-faaf2b7dbe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.357676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd416eb6-a801-4e7d-9181-faaf2b7dbe5f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.357963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd416eb6-a801-4e7d-9181-faaf2b7dbe5f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.358294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd416eb6-a801-4e7d-9181-faaf2b7dbe5f None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.358858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:59.360465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd416eb6-a801-4e7d-9181-faaf2b7dbe5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:59.360873 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd416eb6-a801-4e7d-9181-faaf2b7dbe5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.362518 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd416eb6-a801-4e7d-9181-faaf2b7dbe5f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.378440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:59.384283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 389/810] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:59.386255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd416eb6-a801-4e7d-9181-faaf2b7dbe5f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.422131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89215625-8ed5-445c-bce1-f5a2fb11614c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.472198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a5d19-f58c-4e76-b6f8-2f762d4a5b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.472750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a5d19-f58c-4e76-b6f8-2f762d4a5b81 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.473067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a5d19-f58c-4e76-b6f8-2f762d4a5b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.473350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a5d19-f58c-4e76-b6f8-2f762d4a5b81 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.474058 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a5d19-f58c-4e76-b6f8-2f762d4a5b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:59.474369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a5d19-f58c-4e76-b6f8-2f762d4a5b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.475742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a5d19-f58c-4e76-b6f8-2f762d4a5b81 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.491730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 422/811] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:59.493157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a5d19-f58c-4e76-b6f8-2f762d4a5b81 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.506120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd416eb6-a801-4e7d-9181-faaf2b7dbe5f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.545691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49579589-8207-4bd5-910a-1cf1639664f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.546470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49579589-8207-4bd5-910a-1cf1639664f3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.546917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49579589-8207-4bd5-910a-1cf1639664f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.547257 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49579589-8207-4bd5-910a-1cf1639664f3 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.548040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49579589-8207-4bd5-910a-1cf1639664f3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:59.548452 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49579589-8207-4bd5-910a-1cf1639664f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.550025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49579589-8207-4bd5-910a-1cf1639664f3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.555720 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 390/812] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:20:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:59.556695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49579589-8207-4bd5-910a-1cf1639664f3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.628968 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:59.630259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a5d19-f58c-4e76-b6f8-2f762d4a5b81 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.649175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:59.672414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd99cd4-2c56-4ca0-8643-968485c621d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.673259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd99cd4-2c56-4ca0-8643-968485c621d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.673605 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd99cd4-2c56-4ca0-8643-968485c621d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.673946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd99cd4-2c56-4ca0-8643-968485c621d9 None admin] PATH_INFO: `/v3/projects/c344ed6bac754173af05207b5f444dca/users/f922f2209fff4986b04e1f0aaeb20fe5/roles/f053004b279b4e95a6123572360bd655` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.680192 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49579589-8207-4bd5-910a-1cf1639664f3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.689961 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd99cd4-2c56-4ca0-8643-968485c621d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c344ed6bac754173af05207b5f444dca, user_id=f922f2209fff4986b04e1f0aaeb20fe5, role_id=f053004b279b4e95a6123572360bd655)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.691799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd99cd4-2c56-4ca0-8643-968485c621d9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.716934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 423/813] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:20:59 2022] PUT /identity/v3/projects/c344ed6bac754173af05207b5f444dca/users/f922f2209fff4986b04e1f0aaeb20fe5/roles/f053004b279b4e95a6123572360bd655 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:59.716934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd99cd4-2c56-4ca0-8643-968485c621d9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.740611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8b7d6-6de8-4aa2-9d42-76b4638dfe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.741645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8b7d6-6de8-4aa2-9d42-76b4638dfe75 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.742101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8b7d6-6de8-4aa2-9d42-76b4638dfe75 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.742501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8b7d6-6de8-4aa2-9d42-76b4638dfe75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.753374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8b7d6-6de8-4aa2-9d42-76b4638dfe75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.755126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8b7d6-6de8-4aa2-9d42-76b4638dfe75 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2bd8b7d6-6de8-4aa2-9d42-76b4638dfe75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:20:59.772184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:20:59.773190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:20:59.774099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:20:59.774099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:20:59.774099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:20:59.774099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:20:59.774099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:20:59.774099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:20:59.774099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:20:59.774099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:20:59.774539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 391/814] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:20:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:20:59.775795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387271d0-a525-468e-8489-e8f45abf681a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.776077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387271d0-a525-468e-8489-e8f45abf681a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.776424 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387271d0-a525-468e-8489-e8f45abf681a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.781102 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 392/815] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:20:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:59.782175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387271d0-a525-468e-8489-e8f45abf681a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.838283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd99cd4-2c56-4ca0-8643-968485c621d9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.878007 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3144-544c-465a-91fb-3d930eff39e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.878701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3144-544c-465a-91fb-3d930eff39e0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.878919 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3144-544c-465a-91fb-3d930eff39e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.879257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3144-544c-465a-91fb-3d930eff39e0 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.879956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3144-544c-465a-91fb-3d930eff39e0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:59.880316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3144-544c-465a-91fb-3d930eff39e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.881970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3144-544c-465a-91fb-3d930eff39e0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.888520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 424/816] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:20:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:59.890472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102e5c0-0ad0-4742-95ab-10259f98239b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.890472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102e5c0-0ad0-4742-95ab-10259f98239b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.890647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102e5c0-0ad0-4742-95ab-10259f98239b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.905323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387271d0-a525-468e-8489-e8f45abf681a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.910226 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3102e5c0-0ad0-4742-95ab-10259f98239b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:59.911410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3102e5c0-0ad0-4742-95ab-10259f98239b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:59.936725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:59.938100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:59.955477 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ebd71-7cb9-4ad9-bd2e-11d8abbf94fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.956102 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ebd71-7cb9-4ad9-bd2e-11d8abbf94fa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.956382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ebd71-7cb9-4ad9-bd2e-11d8abbf94fa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.956656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ebd71-7cb9-4ad9-bd2e-11d8abbf94fa None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.957458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ebd71-7cb9-4ad9-bd2e-11d8abbf94fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:59.957766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ebd71-7cb9-4ad9-bd2e-11d8abbf94fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.959768 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ebd71-7cb9-4ad9-bd2e-11d8abbf94fa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.977701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 393/817] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:20:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:59.978867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ebd71-7cb9-4ad9-bd2e-11d8abbf94fa None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.987080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 425/818] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:20:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:20:59.987903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102e5c0-0ad0-4742-95ab-10259f98239b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:00.111417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ebd71-7cb9-4ad9-bd2e-11d8abbf94fa None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:00.117338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102e5c0-0ad0-4742-95ab-10259f98239b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:00.155908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50ca77-8435-4d7b-b3ff-4c4062a51894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:00.156867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50ca77-8435-4d7b-b3ff-4c4062a51894 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:00.157270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50ca77-8435-4d7b-b3ff-4c4062a51894 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:00.157384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef1124-6a8a-4356-a2e7-30dc2058b905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:00.157725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50ca77-8435-4d7b-b3ff-4c4062a51894 None admin] PATH_INFO: `/v3/projects/c344ed6bac754173af05207b5f444dca/users/a8d43b9ceeba432db6d141bb52d4bf1e/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:00.157929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef1124-6a8a-4356-a2e7-30dc2058b905 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:00.158216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef1124-6a8a-4356-a2e7-30dc2058b905 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:00.158490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef1124-6a8a-4356-a2e7-30dc2058b905 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:00.159293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef1124-6a8a-4356-a2e7-30dc2058b905 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:00.160102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50ca77-8435-4d7b-b3ff-4c4062a51894 None admin] RBAC: Authorizing `identity:create_grant(project_id=c344ed6bac754173af05207b5f444dca, user_id=a8d43b9ceeba432db6d141bb52d4bf1e, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:00.160742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef1124-6a8a-4356-a2e7-30dc2058b905 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:00.161719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50ca77-8435-4d7b-b3ff-4c4062a51894 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:00.185152 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 426/819] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:20:59 2022] PUT /identity/v3/projects/c344ed6bac754173af05207b5f444dca/users/a8d43b9ceeba432db6d141bb52d4bf1e/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:00.186422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50ca77-8435-4d7b-b3ff-4c4062a51894 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:00.188589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 394/820] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:00.231016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:00.359498 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50ca77-8435-4d7b-b3ff-4c4062a51894 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:00.418752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d09039-123a-4ef6-803a-d7f965637588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:00.419426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d09039-123a-4ef6-803a-d7f965637588 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:00.419710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d09039-123a-4ef6-803a-d7f965637588 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:00.419990 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d09039-123a-4ef6-803a-d7f965637588 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:00.435102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d09039-123a-4ef6-803a-d7f965637588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-93d09039-123a-4ef6-803a-d7f965637588 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:00.440274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:00.441305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:00.442493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 427/821] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:21:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:00.447548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef1124-6a8a-4356-a2e7-30dc2058b905 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:00.502514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:00.564883 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef1124-6a8a-4356-a2e7-30dc2058b905 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:00.600751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2126ff-4e9a-4f51-a7f0-3d026d08b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:00.601407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2126ff-4e9a-4f51-a7f0-3d026d08b8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:00.601690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2126ff-4e9a-4f51-a7f0-3d026d08b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:00.601966 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2126ff-4e9a-4f51-a7f0-3d026d08b8f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:00.602682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2126ff-4e9a-4f51-a7f0-3d026d08b8f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:00.602986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2126ff-4e9a-4f51-a7f0-3d026d08b8f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:00.604348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2126ff-4e9a-4f51-a7f0-3d026d08b8f8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:00.614334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 395/822] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:21:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:00.619448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d09039-123a-4ef6-803a-d7f965637588 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:00.710214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:00.740221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d09039-123a-4ef6-803a-d7f965637588 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:00.782992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129cf7a-bc44-4cc1-830d-5c03324548ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:00.783972 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129cf7a-bc44-4cc1-830d-5c03324548ab None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:00.784474 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129cf7a-bc44-4cc1-830d-5c03324548ab None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:00.784978 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129cf7a-bc44-4cc1-830d-5c03324548ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:00.800895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129cf7a-bc44-4cc1-830d-5c03324548ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:00.802654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129cf7a-bc44-4cc1-830d-5c03324548ab None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0129cf7a-bc44-4cc1-830d-5c03324548ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:00.819022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:00.819935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:00.820822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:00.820822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:00.820822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:00.820822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:00.823008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 428/823] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:00.829570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2126ff-4e9a-4f51-a7f0-3d026d08b8f8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:00.932250 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2126ff-4e9a-4f51-a7f0-3d026d08b8f8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:00.934694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:00.975471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903bd94-6e97-4200-95b7-2dd3f03272da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:00.976018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903bd94-6e97-4200-95b7-2dd3f03272da None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:00.976304 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903bd94-6e97-4200-95b7-2dd3f03272da None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:00.976583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903bd94-6e97-4200-95b7-2dd3f03272da None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:00.977326 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903bd94-6e97-4200-95b7-2dd3f03272da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:00.977636 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903bd94-6e97-4200-95b7-2dd3f03272da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:00.979018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903bd94-6e97-4200-95b7-2dd3f03272da None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:00.993734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 396/824] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:01.002055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129cf7a-bc44-4cc1-830d-5c03324548ab None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:01.111196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129cf7a-bc44-4cc1-830d-5c03324548ab None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:01.139461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:01.148586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553b2f1-8058-4a48-a69c-a0cadce6d281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:01.149858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553b2f1-8058-4a48-a69c-a0cadce6d281 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:01.150605 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553b2f1-8058-4a48-a69c-a0cadce6d281 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:01.151087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553b2f1-8058-4a48-a69c-a0cadce6d281 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:01.159291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553b2f1-8058-4a48-a69c-a0cadce6d281 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:01.161015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553b2f1-8058-4a48-a69c-a0cadce6d281 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4553b2f1-8058-4a48-a69c-a0cadce6d281 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:21:01.173693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:01.175462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:01.177426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:01.177426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:01.177426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:21:01.177426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:21:01.177426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:21:01.177426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:21:01.177426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:21:01.177426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:21:01.177426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:21:01.177426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:01.181308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 429/825] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 6 01:21:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:01.187974 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903bd94-6e97-4200-95b7-2dd3f03272da None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:01.293502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903bd94-6e97-4200-95b7-2dd3f03272da None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:01.329104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2b7ab-227e-4681-9b80-8289e535e05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:01.330099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b7ab-227e-4681-9b80-8289e535e05e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:01.330577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b7ab-227e-4681-9b80-8289e535e05e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:01.331046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b7ab-227e-4681-9b80-8289e535e05e None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:01.332089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2b7ab-227e-4681-9b80-8289e535e05e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:01.332644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2b7ab-227e-4681-9b80-8289e535e05e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:01.334327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2b7ab-227e-4681-9b80-8289e535e05e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:01.352798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 397/826] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 6 01:21:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:01.359297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553b2f1-8058-4a48-a69c-a0cadce6d281 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:01.454212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a3296-9b1d-475c-a099-4d329fdc5d0f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:01.454776 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a3296-9b1d-475c-a099-4d329fdc5d0f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:01.454776 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a3296-9b1d-475c-a099-4d329fdc5d0f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:01.456529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 398/827] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:01.462529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccac1c-dac1-4185-8389-1504622a2d9e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:01.462842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccac1c-dac1-4185-8389-1504622a2d9e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:01.463083 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccac1c-dac1-4185-8389-1504622a2d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:01.479204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553b2f1-8058-4a48-a69c-a0cadce6d281 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:01.485883 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-abccac1c-dac1-4185-8389-1504622a2d9e None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:01.487241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-abccac1c-dac1-4185-8389-1504622a2d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:01.507220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:01.525335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada363c-c249-44ae-a030-64dc3c5b4a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:01.526740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada363c-c249-44ae-a030-64dc3c5b4a47 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:01.527034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada363c-c249-44ae-a030-64dc3c5b4a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:01.527310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada363c-c249-44ae-a030-64dc3c5b4a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:01.567083 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 399/828] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:01.593289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccac1c-dac1-4185-8389-1504622a2d9e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:01.600393 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:01.616330 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada363c-c249-44ae-a030-64dc3c5b4a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:01.618243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada363c-c249-44ae-a030-64dc3c5b4a47 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:01.720993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccac1c-dac1-4185-8389-1504622a2d9e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:01.728170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 430/829] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:21:01.735186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada363c-c249-44ae-a030-64dc3c5b4a47 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:01.763161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828248a-d34c-4335-84e1-6d16ef6f8b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:01.764377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828248a-d34c-4335-84e1-6d16ef6f8b31 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:01.764664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828248a-d34c-4335-84e1-6d16ef6f8b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:01.764964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828248a-d34c-4335-84e1-6d16ef6f8b31 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:01.765877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828248a-d34c-4335-84e1-6d16ef6f8b31 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:01.767469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828248a-d34c-4335-84e1-6d16ef6f8b31 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d828248a-d34c-4335-84e1-6d16ef6f8b31 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:01.779520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:01.780574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:21:01.781871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:01.784985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 400/830] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:21:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:01.787437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828248a-d34c-4335-84e1-6d16ef6f8b31 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:01.809321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:01.832608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:01.850230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada363c-c249-44ae-a030-64dc3c5b4a47 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:01.888326 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe023c-a8f1-4556-9f3e-ac2abac9461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:01.889694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe023c-a8f1-4556-9f3e-ac2abac9461e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:01.890187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe023c-a8f1-4556-9f3e-ac2abac9461e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:01.890681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe023c-a8f1-4556-9f3e-ac2abac9461e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:01.901780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe023c-a8f1-4556-9f3e-ac2abac9461e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:01.903525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe023c-a8f1-4556-9f3e-ac2abac9461e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:01.918502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828248a-d34c-4335-84e1-6d16ef6f8b31 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9dfe023c-a8f1-4556-9f3e-ac2abac9461e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:01.920527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:01.921448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:01.922371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:01.922371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:01.922371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:01.922371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:01.928882 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 431/831] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:01.930461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe023c-a8f1-4556-9f3e-ac2abac9461e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:01.960475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303da5c-dd30-491d-878c-200f3af688da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:01.961127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303da5c-dd30-491d-878c-200f3af688da None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:01.961416 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303da5c-dd30-491d-878c-200f3af688da None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:01.961699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303da5c-dd30-491d-878c-200f3af688da None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:01.962373 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303da5c-dd30-491d-878c-200f3af688da None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:01.962668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303da5c-dd30-491d-878c-200f3af688da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:01.964226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303da5c-dd30-491d-878c-200f3af688da None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:01.969100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 401/832] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:21:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:01.972934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f1a09-6b2c-4f3d-8fe7-85f8f4f37639 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:01.972934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f1a09-6b2c-4f3d-8fe7-85f8f4f37639 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:01.972934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f1a09-6b2c-4f3d-8fe7-85f8f4f37639 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:01.972934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 402/833] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:01.977832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f1a09-6b2c-4f3d-8fe7-85f8f4f37639 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:02.046560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe023c-a8f1-4556-9f3e-ac2abac9461e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:02.061011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:02.083594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eeffc-57d6-4d8a-ab37-9d6c32058c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:02.084272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eeffc-57d6-4d8a-ab37-9d6c32058c9c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.084510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eeffc-57d6-4d8a-ab37-9d6c32058c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.084793 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eeffc-57d6-4d8a-ab37-9d6c32058c9c None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.085417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f1a09-6b2c-4f3d-8fe7-85f8f4f37639 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:02.085518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251eeffc-57d6-4d8a-ab37-9d6c32058c9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:02.085818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251eeffc-57d6-4d8a-ab37-9d6c32058c9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:02.087180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251eeffc-57d6-4d8a-ab37-9d6c32058c9c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:02.094517 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:02.106424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 432/834] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:02.107841 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905eca10-2a6c-43a4-a25c-9d2aa7163605 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.108129 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905eca10-2a6c-43a4-a25c-9d2aa7163605 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.108407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905eca10-2a6c-43a4-a25c-9d2aa7163605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.121875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f013-b842-4ff7-916c-27af0f20fa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:02.122504 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f013-b842-4ff7-916c-27af0f20fa69 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.122790 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f013-b842-4ff7-916c-27af0f20fa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.123073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f013-b842-4ff7-916c-27af0f20fa69 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.123762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f013-b842-4ff7-916c-27af0f20fa69 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:02.124073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f013-b842-4ff7-916c-27af0f20fa69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:02.125473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f013-b842-4ff7-916c-27af0f20fa69 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:02.127171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-905eca10-2a6c-43a4-a25c-9d2aa7163605 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:02.128480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-905eca10-2a6c-43a4-a25c-9d2aa7163605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:02.130193 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 403/835] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:21:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:02.131109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f013-b842-4ff7-916c-27af0f20fa69 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:02.224473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 433/836] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:02.243681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905eca10-2a6c-43a4-a25c-9d2aa7163605 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:02.265742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f013-b842-4ff7-916c-27af0f20fa69 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:02.305532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b9486-c912-4a74-8226-90d229f7cca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:02.306493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b9486-c912-4a74-8226-90d229f7cca9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.308156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b9486-c912-4a74-8226-90d229f7cca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.308597 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b9486-c912-4a74-8226-90d229f7cca9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.316383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b9486-c912-4a74-8226-90d229f7cca9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:02.318072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b9486-c912-4a74-8226-90d229f7cca9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-bb2b9486-c912-4a74-8226-90d229f7cca9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:21:02.330862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:02.331829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:02.332758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:21:02.332758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:21:02.332758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:21:02.332758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:21:02.332758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:21:02.332758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:21:02.332758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:02.332758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:02.332758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 404/837] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:02.337877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b9486-c912-4a74-8226-90d229f7cca9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:02.341996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:02.375073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905eca10-2a6c-43a4-a25c-9d2aa7163605 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:02.407386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:02.416112 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7cb43-fed7-44e2-94d1-757f56ace975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:02.416785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7cb43-fed7-44e2-94d1-757f56ace975 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.417144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7cb43-fed7-44e2-94d1-757f56ace975 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.417422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7cb43-fed7-44e2-94d1-757f56ace975 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.427800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7cb43-fed7-44e2-94d1-757f56ace975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-61e7cb43-fed7-44e2-94d1-757f56ace975 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:02.433288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:02.434237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:02.435069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 434/838] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:21:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:02.435759 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3963c-6115-4d05-99d2-3820af7eac2a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.436323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3963c-6115-4d05-99d2-3820af7eac2a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.436323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3963c-6115-4d05-99d2-3820af7eac2a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.437707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 435/839] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:02.441927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3963c-6115-4d05-99d2-3820af7eac2a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:02.461734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b9486-c912-4a74-8226-90d229f7cca9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:02.499433 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0a2a3-42ed-4364-b19f-7950ea5787ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:02.500065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0a2a3-42ed-4364-b19f-7950ea5787ab None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.500352 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0a2a3-42ed-4364-b19f-7950ea5787ab None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.500628 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0a2a3-42ed-4364-b19f-7950ea5787ab None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.501415 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0a2a3-42ed-4364-b19f-7950ea5787ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:02.501726 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0a2a3-42ed-4364-b19f-7950ea5787ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:02.503390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0a2a3-42ed-4364-b19f-7950ea5787ab None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:02.516961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 405/840] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:21:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:02.518190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e04a-d051-4295-8700-568c0330319c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.518485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e04a-d051-4295-8700-568c0330319c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.518759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e04a-d051-4295-8700-568c0330319c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.537296 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0465e04a-d051-4295-8700-568c0330319c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:02.538492 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0465e04a-d051-4295-8700-568c0330319c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:02.553345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3963c-6115-4d05-99d2-3820af7eac2a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:02.589923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7ef88-a7b3-4110-ace8-7fff19b12d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:02.590568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ef88-a7b3-4110-ace8-7fff19b12d8c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.590855 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ef88-a7b3-4110-ace8-7fff19b12d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.591244 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ef88-a7b3-4110-ace8-7fff19b12d8c None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.591965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7ef88-a7b3-4110-ace8-7fff19b12d8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:02.592274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7ef88-a7b3-4110-ace8-7fff19b12d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:02.593672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7ef88-a7b3-4110-ace8-7fff19b12d8c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:02.600878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:02.609634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 436/841] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:21:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:02.611217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7ef88-a7b3-4110-ace8-7fff19b12d8c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:02.621232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 406/842] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:02.621232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465e04a-d051-4295-8700-568c0330319c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:02.671399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:02.721836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465e04a-d051-4295-8700-568c0330319c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:02.723146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7ef88-a7b3-4110-ace8-7fff19b12d8c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:02.756569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b3fa-ae94-40ce-85ff-8848bbcb272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:02.757040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4575b7-a2e7-498e-8213-212fe7a833d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:02.757249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b3fa-ae94-40ce-85ff-8848bbcb272f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.757493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b3fa-ae94-40ce-85ff-8848bbcb272f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.757673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4575b7-a2e7-498e-8213-212fe7a833d7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.757768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384b3fa-ae94-40ce-85ff-8848bbcb272f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.757952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4575b7-a2e7-498e-8213-212fe7a833d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.758223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4575b7-a2e7-498e-8213-212fe7a833d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.758540 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b3fa-ae94-40ce-85ff-8848bbcb272f None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=666f4864832445d5a10d60f677f5cd6c) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:02.758850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b3fa-ae94-40ce-85ff-8848bbcb272f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:02.760259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384b3fa-ae94-40ce-85ff-8848bbcb272f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:02.777119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 437/843] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:21:02 2022] GET /identity/v3/role_assignments?user.id=666f4864832445d5a10d60f677f5cd6c&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:02.777119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b3fa-ae94-40ce-85ff-8848bbcb272f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:02.782208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4575b7-a2e7-498e-8213-212fe7a833d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:02.784850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4575b7-a2e7-498e-8213-212fe7a833d7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ba4575b7-a2e7-498e-8213-212fe7a833d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:02.812762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:02.813945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:02.815056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:02.815056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:02.815056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:02.815056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:02.816581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 407/844] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:02.824655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4575b7-a2e7-498e-8213-212fe7a833d7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:02.880876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:02.946321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384b3fa-ae94-40ce-85ff-8848bbcb272f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:02.948021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4575b7-a2e7-498e-8213-212fe7a833d7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:02.967127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:02.994451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538970f-92b7-417f-b828-983f4fecd790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:02.994451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538970f-92b7-417f-b828-983f4fecd790 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.994742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538970f-92b7-417f-b828-983f4fecd790 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.995490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538970f-92b7-417f-b828-983f4fecd790 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.997675 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccd7fb-8593-40aa-802c-8a2c23803f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:02.998425 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccd7fb-8593-40aa-802c-8a2c23803f00 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.998798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccd7fb-8593-40aa-802c-8a2c23803f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.999166 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccd7fb-8593-40aa-802c-8a2c23803f00 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.999960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccd7fb-8593-40aa-802c-8a2c23803f00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:03.000364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccd7fb-8593-40aa-802c-8a2c23803f00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:03.001753 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccd7fb-8593-40aa-802c-8a2c23803f00 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:03.006316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538970f-92b7-417f-b828-983f4fecd790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c538970f-92b7-417f-b828-983f4fecd790 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:03.012005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:03.013030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:03.014158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:03.014158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:03.014158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:03.014158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:03.014158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:03.014158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:03.014158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:03.014158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:03.014158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:03.014158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:03.014158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:03.014158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:03.014802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 438/845] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:21:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:03.019939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538970f-92b7-417f-b828-983f4fecd790 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:03.021382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 408/846] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:03.028752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccd7fb-8593-40aa-802c-8a2c23803f00 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:03.147369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538970f-92b7-417f-b828-983f4fecd790 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:03.150298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccd7fb-8593-40aa-802c-8a2c23803f00 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:03.153504 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:03.189699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9800661-f246-4f7e-a5d4-55644e16eea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:03.190355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9800661-f246-4f7e-a5d4-55644e16eea9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:03.190686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9800661-f246-4f7e-a5d4-55644e16eea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:03.190973 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9800661-f246-4f7e-a5d4-55644e16eea9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:03.191502 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25c283-7176-4df5-a8eb-b4d0f62533ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:03.193090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25c283-7176-4df5-a8eb-b4d0f62533ac None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:03.194039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25c283-7176-4df5-a8eb-b4d0f62533ac None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:03.194802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25c283-7176-4df5-a8eb-b4d0f62533ac None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:03.196162 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25c283-7176-4df5-a8eb-b4d0f62533ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:03.196673 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25c283-7176-4df5-a8eb-b4d0f62533ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:03.198983 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25c283-7176-4df5-a8eb-b4d0f62533ac None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:03.200576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9800661-f246-4f7e-a5d4-55644e16eea9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:03.202165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9800661-f246-4f7e-a5d4-55644e16eea9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:03.213425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 439/847] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:21:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:03.214705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25c283-7176-4df5-a8eb-b4d0f62533ac None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d9800661-f246-4f7e-a5d4-55644e16eea9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:21:03.214837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:03.215725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:03.216668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:03.216668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:03.216668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:21:03.216668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:21:03.216668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:21:03.216668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:21:03.216668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:21:03.216668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:21:03.216668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:21:03.216668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:03.220722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 409/848] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 6 01:21:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:03.221761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9800661-f246-4f7e-a5d4-55644e16eea9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:03.259225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:03.329101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9800661-f246-4f7e-a5d4-55644e16eea9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:03.330739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25c283-7176-4df5-a8eb-b4d0f62533ac None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:03.371100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551a96d-7cf5-4e2a-a44b-9c56d3b5170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:03.372079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551a96d-7cf5-4e2a-a44b-9c56d3b5170e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:03.372562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551a96d-7cf5-4e2a-a44b-9c56d3b5170e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:03.373072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551a96d-7cf5-4e2a-a44b-9c56d3b5170e None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:03.374104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551a96d-7cf5-4e2a-a44b-9c56d3b5170e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:03.374608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551a96d-7cf5-4e2a-a44b-9c56d3b5170e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:03.374981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15592e4b-8bb5-4c94-b8bf-0f6f5b1af532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:03.375630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15592e4b-8bb5-4c94-b8bf-0f6f5b1af532 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:03.375913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15592e4b-8bb5-4c94-b8bf-0f6f5b1af532 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:03.376190 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15592e4b-8bb5-4c94-b8bf-0f6f5b1af532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:03.377140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551a96d-7cf5-4e2a-a44b-9c56d3b5170e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:03.389331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15592e4b-8bb5-4c94-b8bf-0f6f5b1af532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:03.391797 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15592e4b-8bb5-4c94-b8bf-0f6f5b1af532 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:03.400459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 410/849] 10.222.0.15 () {56 vars in 1149 bytes} [Sat Aug 6 01:21:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:03.406009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551a96d-7cf5-4e2a-a44b-9c56d3b5170e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-15592e4b-8bb5-4c94-b8bf-0f6f5b1af532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:03.411507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:03.412397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:03.413314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:03.413314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:03.413314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:03.413314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:03.418019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 440/850] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:03.418870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15592e4b-8bb5-4c94-b8bf-0f6f5b1af532 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:03.437749 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:03.518147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551a96d-7cf5-4e2a-a44b-9c56d3b5170e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:03.518766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:03.532434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15592e4b-8bb5-4c94-b8bf-0f6f5b1af532 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:03.557751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea6409-c59a-4e27-8703-f525711b8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:03.558692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea6409-c59a-4e27-8703-f525711b8db3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:03.559199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea6409-c59a-4e27-8703-f525711b8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:03.559736 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea6409-c59a-4e27-8703-f525711b8db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:03.567973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d659ed6-a601-4608-9049-e8d1b4d460c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:03.568590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d659ed6-a601-4608-9049-e8d1b4d460c6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:03.568875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d659ed6-a601-4608-9049-e8d1b4d460c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:03.569183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d659ed6-a601-4608-9049-e8d1b4d460c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:03.569878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d659ed6-a601-4608-9049-e8d1b4d460c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:03.570181 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d659ed6-a601-4608-9049-e8d1b4d460c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:03.571631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d659ed6-a601-4608-9049-e8d1b4d460c6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:03.589862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 441/851] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:03.590821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d659ed6-a601-4608-9049-e8d1b4d460c6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:03.636250 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea6409-c59a-4e27-8703-f525711b8db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:03.638206 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea6409-c59a-4e27-8703-f525711b8db3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:03.665636 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:03.700594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d659ed6-a601-4608-9049-e8d1b4d460c6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:03.736896 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0f48-0668-4805-9461-f9b8dbc9d2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:03.737873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0f48-0668-4805-9461-f9b8dbc9d2dd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:03.738423 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0f48-0668-4805-9461-f9b8dbc9d2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:03.738908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c0f48-0668-4805-9461-f9b8dbc9d2dd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:03.747375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c0f48-0668-4805-9461-f9b8dbc9d2dd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:03.749029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c0f48-0668-4805-9461-f9b8dbc9d2dd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:03.754178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 411/852] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 01:21:03.756023 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea6409-c59a-4e27-8703-f525711b8db3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-310c0f48-0668-4805-9461-f9b8dbc9d2dd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:21:03.767588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:03.768582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:03.769573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:03.769573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:03.769573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:21:03.769573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:21:03.769573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:21:03.769573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:21:03.769573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:21:03.769573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:21:03.769573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:21:03.769573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:03.777383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 442/853] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:21:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:03.778772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0f48-0668-4805-9461-f9b8dbc9d2dd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:03.790952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:03.863852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea6409-c59a-4e27-8703-f525711b8db3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:03.889814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:03.892880 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c0f48-0668-4805-9461-f9b8dbc9d2dd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:03.903126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bd265-3b4d-46a5-b816-b3f7baf69434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:03.904101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bd265-3b4d-46a5-b816-b3f7baf69434 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:03.904232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bd265-3b4d-46a5-b816-b3f7baf69434 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:03.904435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bd265-3b4d-46a5-b816-b3f7baf69434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:03.915514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bd265-3b4d-46a5-b816-b3f7baf69434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:03.917225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bd265-3b4d-46a5-b816-b3f7baf69434 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:03.930775 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a411d-6497-49e0-971a-a48904bfeb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:03.931676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a411d-6497-49e0-971a-a48904bfeb6c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:03.932175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a411d-6497-49e0-971a-a48904bfeb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:03.933313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a411d-6497-49e0-971a-a48904bfeb6c None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c65bd265-3b4d-46a5-b816-b3f7baf69434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:03.934158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:03.935041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:03.935939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:03.935939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:03.935939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:03.935939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:03.936771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a411d-6497-49e0-971a-a48904bfeb6c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:03.937318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a411d-6497-49e0-971a-a48904bfeb6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:03.938936 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a411d-6497-49e0-971a-a48904bfeb6c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:03.939963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 412/854] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:03.940837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bd265-3b4d-46a5-b816-b3f7baf69434 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:03.964503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 443/855] 10.222.0.15 () {56 vars in 1135 bytes} [Sat Aug 6 01:21:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:03.965942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a411d-6497-49e0-971a-a48904bfeb6c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:04.042221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:04.056161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bd265-3b4d-46a5-b816-b3f7baf69434 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:04.079908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a411d-6497-49e0-971a-a48904bfeb6c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:04.092780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb26a7c-db5a-4d23-b28d-f4b15254d96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:04.093432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb26a7c-db5a-4d23-b28d-f4b15254d96f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:04.093717 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb26a7c-db5a-4d23-b28d-f4b15254d96f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:04.093989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb26a7c-db5a-4d23-b28d-f4b15254d96f None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:04.094739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb26a7c-db5a-4d23-b28d-f4b15254d96f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:04.095303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb26a7c-db5a-4d23-b28d-f4b15254d96f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:04.096502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb26a7c-db5a-4d23-b28d-f4b15254d96f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:04.114589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 413/856] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:04.115566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb26a7c-db5a-4d23-b28d-f4b15254d96f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:04.121694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be24b57-6ee9-4b2d-9135-68d11321b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:04.122584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be24b57-6ee9-4b2d-9135-68d11321b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:04.123064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be24b57-6ee9-4b2d-9135-68d11321b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:04.123650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be24b57-6ee9-4b2d-9135-68d11321b6f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:04.152976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:04.199942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be24b57-6ee9-4b2d-9135-68d11321b6f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:04.201829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be24b57-6ee9-4b2d-9135-68d11321b6f9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:04.224816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb26a7c-db5a-4d23-b28d-f4b15254d96f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:04.262269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7563208-b8c2-4109-b70f-bad304e0da1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:04.262921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7563208-b8c2-4109-b70f-bad304e0da1a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:04.263210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7563208-b8c2-4109-b70f-bad304e0da1a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:04.263486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7563208-b8c2-4109-b70f-bad304e0da1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:04.271114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7563208-b8c2-4109-b70f-bad304e0da1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:04.272227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:04.274063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7563208-b8c2-4109-b70f-bad304e0da1a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a7563208-b8c2-4109-b70f-bad304e0da1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:21:04.287877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:04.288824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:04.289752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:21:04.289752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:21:04.289752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:21:04.289752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:21:04.289752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:21:04.289752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:21:04.289752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:04.289752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:04.293224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 414/857] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:04.295141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7563208-b8c2-4109-b70f-bad304e0da1a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:04.313650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 444/858] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:21:04.315248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cdc31-bbc2-4f2b-9695-742c054548fc None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:04.315734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cdc31-bbc2-4f2b-9695-742c054548fc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:04.316223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cdc31-bbc2-4f2b-9695-742c054548fc None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:04.317923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 445/859] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:04.323915 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566272da-1a17-4144-a38b-18fc318566ec None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:04.324516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566272da-1a17-4144-a38b-18fc318566ec None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:04.324923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566272da-1a17-4144-a38b-18fc318566ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:04.343772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-566272da-1a17-4144-a38b-18fc318566ec None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:04.344991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-566272da-1a17-4144-a38b-18fc318566ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:04.396000 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:04.403882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7563208-b8c2-4109-b70f-bad304e0da1a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:04.436645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 446/860] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:04.437857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566272da-1a17-4144-a38b-18fc318566ec None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:04.443915 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc483de-09c1-4107-9086-e944598f4164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:04.444534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc483de-09c1-4107-9086-e944598f4164 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:04.444815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc483de-09c1-4107-9086-e944598f4164 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:04.445117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc483de-09c1-4107-9086-e944598f4164 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:04.445875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc483de-09c1-4107-9086-e944598f4164 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:04.446286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc483de-09c1-4107-9086-e944598f4164 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:04.447754 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc483de-09c1-4107-9086-e944598f4164 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:04.460872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 415/861] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:21:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:04.461624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc483de-09c1-4107-9086-e944598f4164 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:04.545311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:04.552619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566272da-1a17-4144-a38b-18fc318566ec None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:04.571572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc483de-09c1-4107-9086-e944598f4164 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:04.594622 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926d48b-58f0-4545-8844-1a67272e8c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:04.595569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926d48b-58f0-4545-8844-1a67272e8c78 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:04.595861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926d48b-58f0-4545-8844-1a67272e8c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:04.596295 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926d48b-58f0-4545-8844-1a67272e8c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:04.607922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926d48b-58f0-4545-8844-1a67272e8c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:04.608249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5252a9c-d1dd-43cc-bae4-fe9e686ce8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:04.608864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5252a9c-d1dd-43cc-bae4-fe9e686ce8f1 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:04.609171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5252a9c-d1dd-43cc-bae4-fe9e686ce8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:04.609413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926d48b-58f0-4545-8844-1a67272e8c78 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:04.609525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5252a9c-d1dd-43cc-bae4-fe9e686ce8f1 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:04.610118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5252a9c-d1dd-43cc-bae4-fe9e686ce8f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:04.611461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5252a9c-d1dd-43cc-bae4-fe9e686ce8f1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9926d48b-58f0-4545-8844-1a67272e8c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:04.625833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:04.626799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:04.634083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:04.634083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:04.634083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:04.634083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:04.634357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 416/862] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:21:04 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:04.634357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5252a9c-d1dd-43cc-bae4-fe9e686ce8f1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:04.634489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 447/863] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:04.634489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926d48b-58f0-4545-8844-1a67272e8c78 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:04.655541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:04.760273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926d48b-58f0-4545-8844-1a67272e8c78 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:04.790001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5252a9c-d1dd-43cc-bae4-fe9e686ce8f1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:04.801561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749697a-ce85-485a-bd33-b21892117f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:04.802352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749697a-ce85-485a-bd33-b21892117f56 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:04.802713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749697a-ce85-485a-bd33-b21892117f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:04.803173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749697a-ce85-485a-bd33-b21892117f56 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:04.803955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749697a-ce85-485a-bd33-b21892117f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:04.804422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749697a-ce85-485a-bd33-b21892117f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:04.805913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749697a-ce85-485a-bd33-b21892117f56 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:04.824992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 448/864] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:04.826852 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749697a-ce85-485a-bd33-b21892117f56 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:04.834532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763956b-94b2-49a2-8780-45d9f0cd406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:04.835156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763956b-94b2-49a2-8780-45d9f0cd406f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:04.835437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763956b-94b2-49a2-8780-45d9f0cd406f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:04.835710 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763956b-94b2-49a2-8780-45d9f0cd406f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:04.836504 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763956b-94b2-49a2-8780-45d9f0cd406f None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=f922f2209fff4986b04e1f0aaeb20fe5) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:04.836812 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763956b-94b2-49a2-8780-45d9f0cd406f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:04.839335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763956b-94b2-49a2-8780-45d9f0cd406f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:04.840587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:04.848788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 417/865] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:21:04 2022] GET /identity/v3/role_assignments?user.id=f922f2209fff4986b04e1f0aaeb20fe5&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:04.924750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa83c78-e3bb-4d1a-8e88-7b8b2596fb8b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:04.925174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa83c78-e3bb-4d1a-8e88-7b8b2596fb8b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:04.925356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa83c78-e3bb-4d1a-8e88-7b8b2596fb8b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:04.926989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 418/866] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:21:04.932640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f88e8-60f2-44d8-a392-17a9e59401b5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:04.932999 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f88e8-60f2-44d8-a392-17a9e59401b5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:04.933290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f88e8-60f2-44d8-a392-17a9e59401b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:04.956724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749697a-ce85-485a-bd33-b21892117f56 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:04.957299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-769f88e8-60f2-44d8-a392-17a9e59401b5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:04.958857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-769f88e8-60f2-44d8-a392-17a9e59401b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:05.003006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa510a-a23e-44ea-b5cd-73dd703c7572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:05.004717 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa510a-a23e-44ea-b5cd-73dd703c7572 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:05.005040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa510a-a23e-44ea-b5cd-73dd703c7572 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:05.005315 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa510a-a23e-44ea-b5cd-73dd703c7572 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:05.015733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa510a-a23e-44ea-b5cd-73dd703c7572 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:05.017429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa510a-a23e-44ea-b5cd-73dd703c7572 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d5aa510a-a23e-44ea-b5cd-73dd703c7572 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:21:05.032881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:05.033854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:05.034973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:21:05.034973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:21:05.034973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:21:05.034973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:21:05.034973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:21:05.034973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:21:05.034973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:05.034973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:05.034973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 449/867] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:05.039681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa510a-a23e-44ea-b5cd-73dd703c7572 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:05.048798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 419/868] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:05.070041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f88e8-60f2-44d8-a392-17a9e59401b5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:05.075957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:05.129186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:05.171606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa510a-a23e-44ea-b5cd-73dd703c7572 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:05.200407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f88e8-60f2-44d8-a392-17a9e59401b5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:05.215830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d7785-13b0-4ac5-a9a9-8705ac599387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:05.216726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d7785-13b0-4ac5-a9a9-8705ac599387 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:05.217256 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d7785-13b0-4ac5-a9a9-8705ac599387 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:05.217606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d7785-13b0-4ac5-a9a9-8705ac599387 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:05.218542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d7785-13b0-4ac5-a9a9-8705ac599387 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:05.218855 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d7785-13b0-4ac5-a9a9-8705ac599387 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:05.220277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d7785-13b0-4ac5-a9a9-8705ac599387 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:05.239204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 450/869] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:21:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:05.241529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710bfad-852b-4f7a-8339-0f054a786664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:05.242176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710bfad-852b-4f7a-8339-0f054a786664 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:05.242456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710bfad-852b-4f7a-8339-0f054a786664 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:05.242728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710bfad-852b-4f7a-8339-0f054a786664 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:05.243359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710bfad-852b-4f7a-8339-0f054a786664 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:05.245186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710bfad-852b-4f7a-8339-0f054a786664 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:05.249890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d7785-13b0-4ac5-a9a9-8705ac599387 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4710bfad-852b-4f7a-8339-0f054a786664 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:05.263025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:05.264322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:21:05.265209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:05.269027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 420/870] 10.222.0.15 () {56 vars in 1132 bytes} [Sat Aug 6 01:21:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:05.271285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710bfad-852b-4f7a-8339-0f054a786664 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:05.364328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:05.372405 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d7785-13b0-4ac5-a9a9-8705ac599387 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:05.405460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:05.411519 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710bfad-852b-4f7a-8339-0f054a786664 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:05.415817 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e06616-11e2-4347-a0af-50364a8c262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:05.416824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e06616-11e2-4347-a0af-50364a8c262c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:05.417387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e06616-11e2-4347-a0af-50364a8c262c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:05.417867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e06616-11e2-4347-a0af-50364a8c262c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:05.419018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e06616-11e2-4347-a0af-50364a8c262c None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=a8d43b9ceeba432db6d141bb52d4bf1e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:05.419537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e06616-11e2-4347-a0af-50364a8c262c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:05.421413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e06616-11e2-4347-a0af-50364a8c262c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:05.430435 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 451/871] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:21:05 2022] GET /identity/v3/role_assignments?user.id=a8d43b9ceeba432db6d141bb52d4bf1e&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:05.459374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593bd55-e6df-4fd2-ae9c-58b2572998f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:05.460415 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593bd55-e6df-4fd2-ae9c-58b2572998f2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:05.460937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593bd55-e6df-4fd2-ae9c-58b2572998f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:05.461424 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593bd55-e6df-4fd2-ae9c-58b2572998f2 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:05.462369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593bd55-e6df-4fd2-ae9c-58b2572998f2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:05.462895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593bd55-e6df-4fd2-ae9c-58b2572998f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:05.465165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593bd55-e6df-4fd2-ae9c-58b2572998f2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:05.471434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 421/872] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 6 01:21:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:05.476724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e06616-11e2-4347-a0af-50364a8c262c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:05.593907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e06616-11e2-4347-a0af-50364a8c262c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:05.631777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d719653-2c97-4a51-9a8d-1aa59826362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:05.632391 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d719653-2c97-4a51-9a8d-1aa59826362a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:05.632653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d719653-2c97-4a51-9a8d-1aa59826362a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:05.632955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d719653-2c97-4a51-9a8d-1aa59826362a None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:05.633640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d719653-2c97-4a51-9a8d-1aa59826362a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:05.633944 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d719653-2c97-4a51-9a8d-1aa59826362a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:05.635300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d719653-2c97-4a51-9a8d-1aa59826362a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:05.641165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 452/873] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 6 01:21:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:06.844745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b313b-353d-452d-b130-02a5e4f33f79 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:06.845314 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b313b-353d-452d-b130-02a5e4f33f79 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:06.845396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b313b-353d-452d-b130-02a5e4f33f79 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:06.847001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 422/874] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:06.852082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3aff9-75a1-43bb-8eda-565e70a5da24 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:06.852549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3aff9-75a1-43bb-8eda-565e70a5da24 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:06.852729 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3aff9-75a1-43bb-8eda-565e70a5da24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:06.871313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-04c3aff9-75a1-43bb-8eda-565e70a5da24 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:06.872500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-04c3aff9-75a1-43bb-8eda-565e70a5da24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:06.924103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:06.949018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 453/875] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:06.965052 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b313b-353d-452d-b130-02a5e4f33f79 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.070308 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b313b-353d-452d-b130-02a5e4f33f79 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:07.088082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d53c-1682-4c92-a4ad-08669c1d6946 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.088422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d53c-1682-4c92-a4ad-08669c1d6946 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.088733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d53c-1682-4c92-a4ad-08669c1d6946 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.090339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 454/876] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:07.095656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaab21-424e-41b2-8cdd-15b7470fbaca None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.095872 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaab21-424e-41b2-8cdd-15b7470fbaca None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.096156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaab21-424e-41b2-8cdd-15b7470fbaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.101148 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:07.108461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a5b77-06f4-43d1-aa01-41d529bd995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:07.109132 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a5b77-06f4-43d1-aa01-41d529bd995a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.109415 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a5b77-06f4-43d1-aa01-41d529bd995a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.109691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a5b77-06f4-43d1-aa01-41d529bd995a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.110321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a5b77-06f4-43d1-aa01-41d529bd995a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:07.111682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a5b77-06f4-43d1-aa01-41d529bd995a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:07.119850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-77eaab21-424e-41b2-8cdd-15b7470fbaca None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:07.121511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-77eaab21-424e-41b2-8cdd-15b7470fbaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-857a5b77-06f4-43d1-aa01-41d529bd995a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:07.121941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:07.122921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:07.123765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 423/877] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:21:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:07.129153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a5b77-06f4-43d1-aa01-41d529bd995a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.203929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 455/878] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:07.227709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eaab21-424e-41b2-8cdd-15b7470fbaca None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.254541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a5b77-06f4-43d1-aa01-41d529bd995a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:07.301336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7fdd9-6e32-4a46-837c-41c2edef0749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:07.302321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7fdd9-6e32-4a46-837c-41c2edef0749 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.302818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7fdd9-6e32-4a46-837c-41c2edef0749 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.303302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7fdd9-6e32-4a46-837c-41c2edef0749 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.304244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7fdd9-6e32-4a46-837c-41c2edef0749 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:07.304757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7fdd9-6e32-4a46-837c-41c2edef0749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:07.306353 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7fdd9-6e32-4a46-837c-41c2edef0749 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:07.312188 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 424/879] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:21:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:07.319552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7fdd9-6e32-4a46-837c-41c2edef0749 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.345595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eaab21-424e-41b2-8cdd-15b7470fbaca None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:07.373238 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:07.395741 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe91302-f266-4fe1-8609-bc59b7057837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:07.396386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe91302-f266-4fe1-8609-bc59b7057837 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.396671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe91302-f266-4fe1-8609-bc59b7057837 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.396986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe91302-f266-4fe1-8609-bc59b7057837 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.408746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe91302-f266-4fe1-8609-bc59b7057837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-efe91302-f266-4fe1-8609-bc59b7057837 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:07.413802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:07.414762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:07.415626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:07.415626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:07.415626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:07.415626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:07.415626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:07.415626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:07.415626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:07.415626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:07.415626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:07.415626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:07.415626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:21:07.415626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:07.419158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:07.420213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 456/880] 10.222.0.15 () {56 vars in 1120 bytes} [Sat Aug 6 01:21:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:07.421814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe91302-f266-4fe1-8609-bc59b7057837 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.467949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7fdd9-6e32-4a46-837c-41c2edef0749 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:07.505393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cafac-4cfa-4210-8dfc-4680f6f4788b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:07.506080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cafac-4cfa-4210-8dfc-4680f6f4788b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.506367 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cafac-4cfa-4210-8dfc-4680f6f4788b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.506649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cafac-4cfa-4210-8dfc-4680f6f4788b None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.507332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cafac-4cfa-4210-8dfc-4680f6f4788b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:07.507641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cafac-4cfa-4210-8dfc-4680f6f4788b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:07.509045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cafac-4cfa-4210-8dfc-4680f6f4788b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:07.515407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 425/881] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:21:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:07.522113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cafac-4cfa-4210-8dfc-4680f6f4788b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.549315 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe91302-f266-4fe1-8609-bc59b7057837 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:07.585470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f0cf4-5ac2-4702-ae78-3d82dba636e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:07.586081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f0cf4-5ac2-4702-ae78-3d82dba636e4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.586361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f0cf4-5ac2-4702-ae78-3d82dba636e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.586727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f0cf4-5ac2-4702-ae78-3d82dba636e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.587347 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f0cf4-5ac2-4702-ae78-3d82dba636e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:07.587652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f0cf4-5ac2-4702-ae78-3d82dba636e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:07.589752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f0cf4-5ac2-4702-ae78-3d82dba636e4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:07.598452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 457/882] 10.222.0.15 () {56 vars in 1115 bytes} [Sat Aug 6 01:21:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:07.599648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55188d4a-4eca-48fc-9402-d556751e8bc1 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.599942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55188d4a-4eca-48fc-9402-d556751e8bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.600341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55188d4a-4eca-48fc-9402-d556751e8bc1 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.605628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 458/883] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:07.605628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55188d4a-4eca-48fc-9402-d556751e8bc1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.639489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cafac-4cfa-4210-8dfc-4680f6f4788b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:07.649512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:07.666022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:07.677797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14fb17-0014-465d-a018-c6e9c2c3f434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:07.678423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14fb17-0014-465d-a018-c6e9c2c3f434 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.678708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14fb17-0014-465d-a018-c6e9c2c3f434 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.678987 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14fb17-0014-465d-a018-c6e9c2c3f434 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.679743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14fb17-0014-465d-a018-c6e9c2c3f434 None admin] RBAC: Adding query filter params (interface=public, service_id=0971d1ca4f1e4729b5cfe495a6f7e0dd, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:07.680055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14fb17-0014-465d-a018-c6e9c2c3f434 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:07.681454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14fb17-0014-465d-a018-c6e9c2c3f434 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:07.689493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 426/884] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 6 01:21:07 2022] GET /identity/v3/endpoints?service_id=0971d1ca4f1e4729b5cfe495a6f7e0dd&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:07.690690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45942d-c2cf-4447-a959-c559e3c4877f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.690979 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45942d-c2cf-4447-a959-c559e3c4877f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.691253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45942d-c2cf-4447-a959-c559e3c4877f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.710313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3a45942d-c2cf-4447-a959-c559e3c4877f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:07.711498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3a45942d-c2cf-4447-a959-c559e3c4877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:07.724310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55188d4a-4eca-48fc-9402-d556751e8bc1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:07.758552 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d100cfc-e447-4e90-b605-4b174f473211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:07.759191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d100cfc-e447-4e90-b605-4b174f473211 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.759473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d100cfc-e447-4e90-b605-4b174f473211 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.759767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d100cfc-e447-4e90-b605-4b174f473211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.771088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d100cfc-e447-4e90-b605-4b174f473211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:07.772521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d100cfc-e447-4e90-b605-4b174f473211 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:07.781104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 427/885] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:07.781946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45942d-c2cf-4447-a959-c559e3c4877f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3d100cfc-e447-4e90-b605-4b174f473211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:07.798477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:07.799476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:07.800420 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:07.800420 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:07.800420 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:07.800420 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:07.800420 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 459/886] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:07.800884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361caf-041a-4e70-a9a6-155ac6d0e39b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.801558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361caf-041a-4e70-a9a6-155ac6d0e39b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.801838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361caf-041a-4e70-a9a6-155ac6d0e39b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.803055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 460/887] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:07.803727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25361caf-041a-4e70-a9a6-155ac6d0e39b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.886585 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45942d-c2cf-4447-a959-c559e3c4877f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:07.895021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:07.905469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:07.906382 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25361caf-041a-4e70-a9a6-155ac6d0e39b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:07.922339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f1f49-3857-47e8-bc4e-7b149cc434fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:07.922953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f1f49-3857-47e8-bc4e-7b149cc434fd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.923230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f1f49-3857-47e8-bc4e-7b149cc434fd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.923510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f1f49-3857-47e8-bc4e-7b149cc434fd None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.924156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f1f49-3857-47e8-bc4e-7b149cc434fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:07.925532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f1f49-3857-47e8-bc4e-7b149cc434fd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:07.930768 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 428/888] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 6 01:21:07 2022] GET /identity/v3/services => generated 1011 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:07.931531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f1f49-3857-47e8-bc4e-7b149cc434fd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.942962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e360c28-09e6-4ecf-80f3-44f241794619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:07.943641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e360c28-09e6-4ecf-80f3-44f241794619 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.944262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e360c28-09e6-4ecf-80f3-44f241794619 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.944543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e360c28-09e6-4ecf-80f3-44f241794619 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.945648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e360c28-09e6-4ecf-80f3-44f241794619 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:07.948718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e360c28-09e6-4ecf-80f3-44f241794619 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-2e360c28-09e6-4ecf-80f3-44f241794619 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:07.958977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:07.960075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:07.961367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 461/889] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 6 01:21:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:07.962219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3ce4c-c46f-4296-85ce-85178918476c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.962219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3ce4c-c46f-4296-85ce-85178918476c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.962219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3ce4c-c46f-4296-85ce-85178918476c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.981404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e9f3ce4c-c46f-4296-85ce-85178918476c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:07.982634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e9f3ce4c-c46f-4296-85ce-85178918476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:08.055770 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f1f49-3857-47e8-bc4e-7b149cc434fd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:08.059604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 462/890] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:08.060091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3ce4c-c46f-4296-85ce-85178918476c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:08.110096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12816d90-493f-44fb-b0a2-c495fb7418e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:08.110726 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12816d90-493f-44fb-b0a2-c495fb7418e1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:08.111012 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12816d90-493f-44fb-b0a2-c495fb7418e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:08.111289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12816d90-493f-44fb-b0a2-c495fb7418e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:08.111984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12816d90-493f-44fb-b0a2-c495fb7418e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:08.112291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12816d90-493f-44fb-b0a2-c495fb7418e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:08.113705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12816d90-493f-44fb-b0a2-c495fb7418e1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:08.126299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 429/891] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:08.126940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12816d90-493f-44fb-b0a2-c495fb7418e1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:08.156751 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:08.174345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3ce4c-c46f-4296-85ce-85178918476c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:08.175545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:08.212516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b81ad7-7622-47ab-91b4-354774a9b38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:08.213172 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b81ad7-7622-47ab-91b4-354774a9b38a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:08.214437 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b81ad7-7622-47ab-91b4-354774a9b38a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:08.214867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b81ad7-7622-47ab-91b4-354774a9b38a None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:08.215764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b81ad7-7622-47ab-91b4-354774a9b38a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:08.216080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b81ad7-7622-47ab-91b4-354774a9b38a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:08.217484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b81ad7-7622-47ab-91b4-354774a9b38a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:08.222170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 463/892] 10.222.0.15 () {56 vars in 1122 bytes} [Sat Aug 6 01:21:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:08.222946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b81ad7-7622-47ab-91b4-354774a9b38a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:08.240045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12816d90-493f-44fb-b0a2-c495fb7418e1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:08.279767 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab42bde-4a67-4dd4-80e5-6a088ed46fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:08.280405 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42bde-4a67-4dd4-80e5-6a088ed46fa4 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:08.280684 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42bde-4a67-4dd4-80e5-6a088ed46fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:08.281210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42bde-4a67-4dd4-80e5-6a088ed46fa4 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:08.282199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab42bde-4a67-4dd4-80e5-6a088ed46fa4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:08.283564 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab42bde-4a67-4dd4-80e5-6a088ed46fa4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:08.308937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 430/893] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:21:08 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:08.308937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab42bde-4a67-4dd4-80e5-6a088ed46fa4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:08.339116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b81ad7-7622-47ab-91b4-354774a9b38a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:08.401413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a4567-ac18-438d-a772-008809ef14d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:08.402086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a4567-ac18-438d-a772-008809ef14d7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:08.402386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a4567-ac18-438d-a772-008809ef14d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:08.402753 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a4567-ac18-438d-a772-008809ef14d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:08.416291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a4567-ac18-438d-a772-008809ef14d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:08.417988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a4567-ac18-438d-a772-008809ef14d7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e94a4567-ac18-438d-a772-008809ef14d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:21:08.431349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:08.433088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:08.434447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:08.434447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:08.434447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:21:08.434447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:21:08.434447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:21:08.434447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:21:08.434447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:21:08.434447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:21:08.434447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:21:08.434447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:08.437453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 464/894] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 6 01:21:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:08.439731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a4567-ac18-438d-a772-008809ef14d7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:08.446682 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:08.467437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab42bde-4a67-4dd4-80e5-6a088ed46fa4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:08.469100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:08.511819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a22069-a45a-4ee9-8a89-7bfc7d33c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:08.512748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a22069-a45a-4ee9-8a89-7bfc7d33c52a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:08.513063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a22069-a45a-4ee9-8a89-7bfc7d33c52a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:08.513339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a22069-a45a-4ee9-8a89-7bfc7d33c52a None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:08.514287 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a22069-a45a-4ee9-8a89-7bfc7d33c52a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:08.514590 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a22069-a45a-4ee9-8a89-7bfc7d33c52a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:08.515952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a22069-a45a-4ee9-8a89-7bfc7d33c52a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:08.524692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 431/895] 10.222.0.15 () {56 vars in 1122 bytes} [Sat Aug 6 01:21:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:08.578177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a4567-ac18-438d-a772-008809ef14d7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:08.617840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a65fa7-1c2d-4169-8c7a-266c00b48947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:08.618480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a65fa7-1c2d-4169-8c7a-266c00b48947 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:08.618774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a65fa7-1c2d-4169-8c7a-266c00b48947 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:08.619053 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a65fa7-1c2d-4169-8c7a-266c00b48947 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:08.620160 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a65fa7-1c2d-4169-8c7a-266c00b48947 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:08.620477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a65fa7-1c2d-4169-8c7a-266c00b48947 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:08.622039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a65fa7-1c2d-4169-8c7a-266c00b48947 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:08.648461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 465/896] 10.222.0.15 () {56 vars in 1149 bytes} [Sat Aug 6 01:21:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:08.649997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a22069-a45a-4ee9-8a89-7bfc7d33c52a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:08.756147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a22069-a45a-4ee9-8a89-7bfc7d33c52a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:08.791197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b55c9-c4a0-4ff4-aff2-399920a24d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:08.792397 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b55c9-c4a0-4ff4-aff2-399920a24d98 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:08.792688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b55c9-c4a0-4ff4-aff2-399920a24d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:08.793112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b55c9-c4a0-4ff4-aff2-399920a24d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:08.831159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:08.870433 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b55c9-c4a0-4ff4-aff2-399920a24d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:08.872242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b55c9-c4a0-4ff4-aff2-399920a24d98 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:08.981616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 432/897] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:08 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:21:08.987165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a65fa7-1c2d-4169-8c7a-266c00b48947 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:09.053990 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:09.103445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a65fa7-1c2d-4169-8c7a-266c00b48947 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:09.140477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37a37d-c1da-4ecf-8678-a618ea41b222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:09.141506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37a37d-c1da-4ecf-8678-a618ea41b222 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:09.142046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37a37d-c1da-4ecf-8678-a618ea41b222 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:09.142522 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37a37d-c1da-4ecf-8678-a618ea41b222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:09.153936 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37a37d-c1da-4ecf-8678-a618ea41b222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:09.155660 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb37a37d-c1da-4ecf-8678-a618ea41b222 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-cb37a37d-c1da-4ecf-8678-a618ea41b222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:09.171068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:09.171973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:09.172873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:09.172873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:09.172873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:09.172873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:09.175078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 466/898] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:09.188936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b55c9-c4a0-4ff4-aff2-399920a24d98 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:09.252870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:09.293650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b55c9-c4a0-4ff4-aff2-399920a24d98 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:09.328642 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007fd8e-5d0c-4868-967b-689e1ca98f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:09.329210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007fd8e-5d0c-4868-967b-689e1ca98f8b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:09.329488 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007fd8e-5d0c-4868-967b-689e1ca98f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:09.329759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007fd8e-5d0c-4868-967b-689e1ca98f8b None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:09.330442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007fd8e-5d0c-4868-967b-689e1ca98f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:09.330743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007fd8e-5d0c-4868-967b-689e1ca98f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:09.332083 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007fd8e-5d0c-4868-967b-689e1ca98f8b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:09.343800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 433/899] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:09.349221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37a37d-c1da-4ecf-8678-a618ea41b222 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:09.458508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37a37d-c1da-4ecf-8678-a618ea41b222 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:09.472136 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:09.497155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88978e1d-eac8-476c-aa62-e67205d112a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:09.497799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88978e1d-eac8-476c-aa62-e67205d112a9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:09.498077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88978e1d-eac8-476c-aa62-e67205d112a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:09.498348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88978e1d-eac8-476c-aa62-e67205d112a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:09.505465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88978e1d-eac8-476c-aa62-e67205d112a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:09.506889 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88978e1d-eac8-476c-aa62-e67205d112a9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-88978e1d-eac8-476c-aa62-e67205d112a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:21:09.519316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:09.520203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:09.521131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:21:09.521131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:21:09.521131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:21:09.521131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:21:09.521131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:21:09.521131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:21:09.521131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:09.521131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:09.521131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 467/900] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:09.526617 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007fd8e-5d0c-4868-967b-689e1ca98f8b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:09.630655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007fd8e-5d0c-4868-967b-689e1ca98f8b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:09.660656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:09.669768 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb18cd-0b91-4d4e-93c9-27205bf1cb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:09.670591 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb18cd-0b91-4d4e-93c9-27205bf1cb48 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:09.670874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb18cd-0b91-4d4e-93c9-27205bf1cb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:09.671149 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb18cd-0b91-4d4e-93c9-27205bf1cb48 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:09.671906 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb18cd-0b91-4d4e-93c9-27205bf1cb48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:09.672212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb18cd-0b91-4d4e-93c9-27205bf1cb48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:09.673658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb18cd-0b91-4d4e-93c9-27205bf1cb48 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:09.687270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 434/901] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:21:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:09.693971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88978e1d-eac8-476c-aa62-e67205d112a9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:09.802427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88978e1d-eac8-476c-aa62-e67205d112a9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:09.837334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cf1b1-ee8a-438d-a97e-c86f0745828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:09.837984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cf1b1-ee8a-438d-a97e-c86f0745828b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:09.838812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cf1b1-ee8a-438d-a97e-c86f0745828b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:09.839099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cf1b1-ee8a-438d-a97e-c86f0745828b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:09.839999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cf1b1-ee8a-438d-a97e-c86f0745828b None admin] RBAC: Adding query filter params (role.id=6adb3bcaecba49c7be505774fe3f5940, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=f922f2209fff4986b04e1f0aaeb20fe5) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:09.840310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cf1b1-ee8a-438d-a97e-c86f0745828b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:09.841752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cf1b1-ee8a-438d-a97e-c86f0745828b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:09.847586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 468/902] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:21:09 2022] GET /identity/v3/role_assignments?user.id=f922f2209fff4986b04e1f0aaeb20fe5&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=6adb3bcaecba49c7be505774fe3f5940 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:10.034789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0146f2-83ac-49cb-a13a-759ef55a6d31 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.035290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0146f2-83ac-49cb-a13a-759ef55a6d31 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.035290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0146f2-83ac-49cb-a13a-759ef55a6d31 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.036620 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 435/903] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:10.042589 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607345a-ccb2-429e-bdf0-052faebadf0c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.043008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607345a-ccb2-429e-bdf0-052faebadf0c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.043224 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607345a-ccb2-429e-bdf0-052faebadf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.061559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5607345a-ccb2-429e-bdf0-052faebadf0c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:10.062735 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5607345a-ccb2-429e-bdf0-052faebadf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:10.093699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:10.134208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 469/904] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:10.158100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0146f2-83ac-49cb-a13a-759ef55a6d31 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:10.268511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0146f2-83ac-49cb-a13a-759ef55a6d31 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:10.304537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b92793-a0af-4b1b-8aa1-677c375f45f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:10.305156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b92793-a0af-4b1b-8aa1-677c375f45f8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.305436 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b92793-a0af-4b1b-8aa1-677c375f45f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.305709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b92793-a0af-4b1b-8aa1-677c375f45f8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.306338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b92793-a0af-4b1b-8aa1-677c375f45f8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:10.308497 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b92793-a0af-4b1b-8aa1-677c375f45f8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-01b92793-a0af-4b1b-8aa1-677c375f45f8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:10.317892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:10.320348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:10.322315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 436/905] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:21:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:10.330055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607345a-ccb2-429e-bdf0-052faebadf0c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:10.434111 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607345a-ccb2-429e-bdf0-052faebadf0c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:10.469038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33088fc-7a79-4141-88c5-2d1f661ca817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:10.469656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33088fc-7a79-4141-88c5-2d1f661ca817 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.469936 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33088fc-7a79-4141-88c5-2d1f661ca817 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.470209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33088fc-7a79-4141-88c5-2d1f661ca817 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.470889 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33088fc-7a79-4141-88c5-2d1f661ca817 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:10.471193 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33088fc-7a79-4141-88c5-2d1f661ca817 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:10.472547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33088fc-7a79-4141-88c5-2d1f661ca817 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:10.477631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 470/906] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:21:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:10.483635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b92793-a0af-4b1b-8aa1-677c375f45f8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:10.536839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:10.548067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031246-584a-4e88-b3d8-5bb02e7dd7a6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.548355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031246-584a-4e88-b3d8-5bb02e7dd7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.548621 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6031246-584a-4e88-b3d8-5bb02e7dd7a6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.550481 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 471/907] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:10.555841 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be3422-51fc-4021-856e-0afd40ef0e82 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.556077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be3422-51fc-4021-856e-0afd40ef0e82 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.556356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be3422-51fc-4021-856e-0afd40ef0e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.574742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-62be3422-51fc-4021-856e-0afd40ef0e82 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:10.575932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-62be3422-51fc-4021-856e-0afd40ef0e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:10.595122 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b92793-a0af-4b1b-8aa1-677c375f45f8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:10.638124 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700bcf3-f36b-432a-9c41-fa97df3da4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:10.639317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700bcf3-f36b-432a-9c41-fa97df3da4af None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.639666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700bcf3-f36b-432a-9c41-fa97df3da4af None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.640319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700bcf3-f36b-432a-9c41-fa97df3da4af None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.641276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:10.641393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700bcf3-f36b-432a-9c41-fa97df3da4af None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:10.641764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700bcf3-f36b-432a-9c41-fa97df3da4af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:10.643579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700bcf3-f36b-432a-9c41-fa97df3da4af None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:10.650503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 437/908] 10.222.0.15 () {56 vars in 1114 bytes} [Sat Aug 6 01:21:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:10.652896 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 472/909] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:10.658050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700bcf3-f36b-432a-9c41-fa97df3da4af None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:10.675188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be3422-51fc-4021-856e-0afd40ef0e82 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:10.764981 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700bcf3-f36b-432a-9c41-fa97df3da4af None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:10.776097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be3422-51fc-4021-856e-0afd40ef0e82 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:10.780551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:10.804402 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8151c2-5463-4c56-be96-e28d81053386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:10.805180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8151c2-5463-4c56-be96-e28d81053386 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.805470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8151c2-5463-4c56-be96-e28d81053386 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.805744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8151c2-5463-4c56-be96-e28d81053386 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.806610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8151c2-5463-4c56-be96-e28d81053386 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:10.808033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8151c2-5463-4c56-be96-e28d81053386 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:10.809774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6a22f-e736-4ebd-bccf-978a36017534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:10.810412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6a22f-e736-4ebd-bccf-978a36017534 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.810691 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6a22f-e736-4ebd-bccf-978a36017534 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.810962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6a22f-e736-4ebd-bccf-978a36017534 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.811585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6a22f-e736-4ebd-bccf-978a36017534 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:10.813232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6a22f-e736-4ebd-bccf-978a36017534 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f9f6a22f-e736-4ebd-bccf-978a36017534 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:10.823144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:10.824137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:21:10.825022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:10.829301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 473/910] 10.222.0.15 () {56 vars in 1132 bytes} [Sat Aug 6 01:21:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:10.830576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466fd1-2a84-4c69-bbee-46b3d36539be None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.830863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466fd1-2a84-4c69-bbee-46b3d36539be None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.831137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466fd1-2a84-4c69-bbee-46b3d36539be None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.832638 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 474/911] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:10.833174 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06466fd1-2a84-4c69-bbee-46b3d36539be None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:10.837517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 438/912] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:10.839457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d0033-4300-458f-8301-0809a6d7b689 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.839764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d0033-4300-458f-8301-0809a6d7b689 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.840104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d0033-4300-458f-8301-0809a6d7b689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.867067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a64d0033-4300-458f-8301-0809a6d7b689 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:10.868845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a64d0033-4300-458f-8301-0809a6d7b689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:10.875472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:10.971932 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 439/913] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:10.983120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06466fd1-2a84-4c69-bbee-46b3d36539be None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:10.998558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d0033-4300-458f-8301-0809a6d7b689 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:11.034323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a9071-170e-451f-bc50-8a5dca30d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:11.034854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9071-170e-451f-bc50-8a5dca30d739 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:11.035137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9071-170e-451f-bc50-8a5dca30d739 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:11.035414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9071-170e-451f-bc50-8a5dca30d739 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:11.036106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a9071-170e-451f-bc50-8a5dca30d739 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:11.036413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a9071-170e-451f-bc50-8a5dca30d739 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:11.037839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a9071-170e-451f-bc50-8a5dca30d739 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:11.045701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 475/914] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 6 01:21:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:11.051198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a9071-170e-451f-bc50-8a5dca30d739 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:11.124441 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:11.130955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d0033-4300-458f-8301-0809a6d7b689 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:11.169667 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f9403-dd42-4f18-b82a-bd0b639ccf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:11.170295 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9403-dd42-4f18-b82a-bd0b639ccf19 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:11.170575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9403-dd42-4f18-b82a-bd0b639ccf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:11.170848 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9403-dd42-4f18-b82a-bd0b639ccf19 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:11.171559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f9403-dd42-4f18-b82a-bd0b639ccf19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:11.172594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:11.172940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f9403-dd42-4f18-b82a-bd0b639ccf19 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:11.184831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a9071-170e-451f-bc50-8a5dca30d739 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:11.189927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 440/915] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:21:10 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:11.243995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edde146-e377-420d-9967-9090d39ceb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:11.244656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edde146-e377-420d-9967-9090d39ceb23 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:11.244962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edde146-e377-420d-9967-9090d39ceb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:11.245237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edde146-e377-420d-9967-9090d39ceb23 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:11.245929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edde146-e377-420d-9967-9090d39ceb23 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:11.246233 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edde146-e377-420d-9967-9090d39ceb23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:11.247631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edde146-e377-420d-9967-9090d39ceb23 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:11.253829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 476/916] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 6 01:21:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:11.259870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f9403-dd42-4f18-b82a-bd0b639ccf19 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:11.381993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f9403-dd42-4f18-b82a-bd0b639ccf19 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:11.420783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72991a-99ed-4042-a55b-8f102e80c44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:11.421480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72991a-99ed-4042-a55b-8f102e80c44b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:11.421762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72991a-99ed-4042-a55b-8f102e80c44b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:11.422040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72991a-99ed-4042-a55b-8f102e80c44b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:11.422831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72991a-99ed-4042-a55b-8f102e80c44b None admin] RBAC: Adding query filter params (interface=public, service_id=60f7c058a32f4a548180baee7706196b, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:11.423143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72991a-99ed-4042-a55b-8f102e80c44b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:11.424512 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72991a-99ed-4042-a55b-8f102e80c44b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:11.430464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 441/917] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 6 01:21:11 2022] GET /identity/v3/endpoints?service_id=60f7c058a32f4a548180baee7706196b&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:11.436340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edde146-e377-420d-9967-9090d39ceb23 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:11.539175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edde146-e377-420d-9967-9090d39ceb23 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:11.578607 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62bfac-9792-4e2d-b0de-4c3622485c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:11.579531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62bfac-9792-4e2d-b0de-4c3622485c16 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:11.580012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62bfac-9792-4e2d-b0de-4c3622485c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:11.580462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62bfac-9792-4e2d-b0de-4c3622485c16 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:11.581320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62bfac-9792-4e2d-b0de-4c3622485c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:11.582849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62bfac-9792-4e2d-b0de-4c3622485c16 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:11.589923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 477/918] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 6 01:21:11 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:11.961104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d632f42-a353-40ee-87bd-0d182fca1dcd None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:11.961509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d632f42-a353-40ee-87bd-0d182fca1dcd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:11.961708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d632f42-a353-40ee-87bd-0d182fca1dcd None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:11.963989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 442/919] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:11.969669 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe3905-64e9-4969-8dec-baee1246fcd0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:11.969961 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe3905-64e9-4969-8dec-baee1246fcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:11.970241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe3905-64e9-4969-8dec-baee1246fcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:11.989152 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-40fe3905-64e9-4969-8dec-baee1246fcd0 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:11.990356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-40fe3905-64e9-4969-8dec-baee1246fcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:12.000631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:12.063530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 478/920] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:12.085527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d632f42-a353-40ee-87bd-0d182fca1dcd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:12.110944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:12.199281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d632f42-a353-40ee-87bd-0d182fca1dcd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:12.235044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a911d-3157-47ce-a0b2-bd8ffc9f8468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:12.235609 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a911d-3157-47ce-a0b2-bd8ffc9f8468 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.235893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a911d-3157-47ce-a0b2-bd8ffc9f8468 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.236174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a911d-3157-47ce-a0b2-bd8ffc9f8468 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.248161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a911d-3157-47ce-a0b2-bd8ffc9f8468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-3b6a911d-3157-47ce-a0b2-bd8ffc9f8468 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:12.253081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:12.254010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:12.255411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 443/921] 10.222.0.15 () {56 vars in 1120 bytes} [Sat Aug 6 01:21:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:12.260281 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe3905-64e9-4969-8dec-baee1246fcd0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:12.377558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe3905-64e9-4969-8dec-baee1246fcd0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:12.413319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37212c4-49e7-400f-9184-71f27202061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:12.414315 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37212c4-49e7-400f-9184-71f27202061e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.414819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37212c4-49e7-400f-9184-71f27202061e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.415316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37212c4-49e7-400f-9184-71f27202061e None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.416878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37212c4-49e7-400f-9184-71f27202061e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:12.417624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37212c4-49e7-400f-9184-71f27202061e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:12.419433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37212c4-49e7-400f-9184-71f27202061e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:12.428998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 479/922] 10.222.0.15 () {56 vars in 1115 bytes} [Sat Aug 6 01:21:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:12.441021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a911d-3157-47ce-a0b2-bd8ffc9f8468 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:12.529574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:12.549597 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a911d-3157-47ce-a0b2-bd8ffc9f8468 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:12.584703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84954a63-1557-466d-b74a-250a1a4842ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:12.585385 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84954a63-1557-466d-b74a-250a1a4842ff None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.585671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84954a63-1557-466d-b74a-250a1a4842ff None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.585950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84954a63-1557-466d-b74a-250a1a4842ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.597683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84954a63-1557-466d-b74a-250a1a4842ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:12.599128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84954a63-1557-466d-b74a-250a1a4842ff None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-84954a63-1557-466d-b74a-250a1a4842ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:12.613923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:12.614800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:12.615866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:12.615866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:12.615866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:12.615866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:12.615866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 444/923] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:12.620857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37212c4-49e7-400f-9184-71f27202061e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:12.630668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:12.735264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37212c4-49e7-400f-9184-71f27202061e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:12.771539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c6bf-c592-4b88-b5a7-7da64fb82c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:12.772155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c6bf-c592-4b88-b5a7-7da64fb82c77 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.772439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c6bf-c592-4b88-b5a7-7da64fb82c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.772718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c6bf-c592-4b88-b5a7-7da64fb82c77 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.773555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4c6bf-c592-4b88-b5a7-7da64fb82c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:12.773866 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4c6bf-c592-4b88-b5a7-7da64fb82c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:12.775229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4c6bf-c592-4b88-b5a7-7da64fb82c77 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:12.789696 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 480/924] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:12.800825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84954a63-1557-466d-b74a-250a1a4842ff None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:12.908977 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84954a63-1557-466d-b74a-250a1a4842ff None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:12.939370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:12.945694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741b1fd-ec08-4421-8158-93f7941e0654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:12.946825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741b1fd-ec08-4421-8158-93f7941e0654 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.947075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741b1fd-ec08-4421-8158-93f7941e0654 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.947349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741b1fd-ec08-4421-8158-93f7941e0654 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.956423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741b1fd-ec08-4421-8158-93f7941e0654 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:12.957920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741b1fd-ec08-4421-8158-93f7941e0654 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4741b1fd-ec08-4421-8158-93f7941e0654 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:21:12.970238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:12.971200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:12.972147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:12.972147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:12.972147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:21:12.972147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:21:12.972147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:21:12.972147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:21:12.972147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:21:12.972147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:21:12.972147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:21:12.972147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:12.972147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 445/925] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 6 01:21:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:12.979717 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c6bf-c592-4b88-b5a7-7da64fb82c77 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.042037 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21888ccb-c4ad-42fb-aa34-5114a6f78e5a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.042349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21888ccb-c4ad-42fb-aa34-5114a6f78e5a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.042627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21888ccb-c4ad-42fb-aa34-5114a6f78e5a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.044327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 446/926] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:21:13.049960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f234c2-01ec-48dd-a26b-6e8e356d52b9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.050246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f234c2-01ec-48dd-a26b-6e8e356d52b9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.050522 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f234c2-01ec-48dd-a26b-6e8e356d52b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.055820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:13.074941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-75f234c2-01ec-48dd-a26b-6e8e356d52b9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:13.076677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-75f234c2-01ec-48dd-a26b-6e8e356d52b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:13.103761 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c6bf-c592-4b88-b5a7-7da64fb82c77 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.144293 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0bef7-51b5-4791-b1eb-56277bb2311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.145422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0bef7-51b5-4791-b1eb-56277bb2311f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.145955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0bef7-51b5-4791-b1eb-56277bb2311f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.146452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0bef7-51b5-4791-b1eb-56277bb2311f None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.147465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0bef7-51b5-4791-b1eb-56277bb2311f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:13.148059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0bef7-51b5-4791-b1eb-56277bb2311f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.149658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 447/927] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:13.149973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0bef7-51b5-4791-b1eb-56277bb2311f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.168856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 481/928] 10.222.0.15 () {56 vars in 1149 bytes} [Sat Aug 6 01:21:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:13.172956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f234c2-01ec-48dd-a26b-6e8e356d52b9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.174135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0bef7-51b5-4791-b1eb-56277bb2311f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.284854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f234c2-01ec-48dd-a26b-6e8e356d52b9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.285805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0bef7-51b5-4791-b1eb-56277bb2311f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.312493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:13.313244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:13.326965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2e6f-ed68-4ee3-858e-8564df3b2c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.327714 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2e6f-ed68-4ee3-858e-8564df3b2c9e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.328000 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2e6f-ed68-4ee3-858e-8564df3b2c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.328279 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e2e6f-ed68-4ee3-858e-8564df3b2c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.328855 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74b1a5-6333-4193-b467-2e9aff9b9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.329793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74b1a5-6333-4193-b467-2e9aff9b9a75 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.330375 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74b1a5-6333-4193-b467-2e9aff9b9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.330865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74b1a5-6333-4193-b467-2e9aff9b9a75 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.331809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74b1a5-6333-4193-b467-2e9aff9b9a75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.333512 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74b1a5-6333-4193-b467-2e9aff9b9a75 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.336432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: WARNING keystone.server.flask.common [None req-2d74b1a5-6333-4193-b467-2e9aff9b9a75 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 06 01:21:13.339602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e2e6f-ed68-4ee3-858e-8564df3b2c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.341386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e2e6f-ed68-4ee3-858e-8564df3b2c9e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-ad7e2e6f-ed68-4ee3-858e-8564df3b2c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:13.360156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:13.361173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:13.362082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:13.362082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:13.362082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:13.362082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:13.363396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.sql.core [None req-2d74b1a5-6333-4193-b467-2e9aff9b9a75 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 01:21:13.363396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 01:21:13.363396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [parameters: {'id': 'aeedbeaabfb249d3a278fb8cf68506bb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 06 01:21:13.363396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80158) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 01:21:13.366020 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 482/929] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:13.370183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2e6f-ed68-4ee3-858e-8564df3b2c9e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2d74b1a5-6333-4193-b467-2e9aff9b9a75 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aeedbeaabfb249d3a278fb8cf68506bb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aeedbeaabfb249d3a278fb8cf68506bb. Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 01:21:13.372615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 06 01:21:13.373496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application yield resource Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise self.value Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application session.commit() Aug 06 01:21:13.374506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.flush() Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application compat.raise_( Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 01:21:13.375444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 01:21:13.376442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 01:21:13.377445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [parameters: {'id': 'aeedbeaabfb249d3a278fb8cf68506bb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:13.378656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:13.380291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:13.381482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:13.381482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 06 01:21:13.381482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 06 01:21:13.381482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:13.381482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:13.381482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 06 01:21:13.381482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 06 01:21:13.381482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aeedbeaabfb249d3a278fb8cf68506bb. Aug 06 01:21:13.381482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:13.383856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 448/930] 10.222.0.15 () {60 vars in 1140 bytes} [Sat Aug 6 01:21:13 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:13.392972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74b1a5-6333-4193-b467-2e9aff9b9a75 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.489192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e2e6f-ed68-4ee3-858e-8564df3b2c9e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.501840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74b1a5-6333-4193-b467-2e9aff9b9a75 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.526711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8537f55-8f11-4fe9-9f13-a26951015f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.527329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8537f55-8f11-4fe9-9f13-a26951015f75 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.527616 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8537f55-8f11-4fe9-9f13-a26951015f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.527894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8537f55-8f11-4fe9-9f13-a26951015f75 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.528592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8537f55-8f11-4fe9-9f13-a26951015f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:13.528922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8537f55-8f11-4fe9-9f13-a26951015f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.530301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8537f55-8f11-4fe9-9f13-a26951015f75 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.538708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dc4a6-d9cd-4180-b663-b509c0f65fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.539575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dc4a6-d9cd-4180-b663-b509c0f65fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.540032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dc4a6-d9cd-4180-b663-b509c0f65fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.540450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dc4a6-d9cd-4180-b663-b509c0f65fa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.542392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 483/931] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:13.548073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588d9bc-67ff-4748-8e99-5688780af3a1 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.548291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dc4a6-d9cd-4180-b663-b509c0f65fa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.548404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588d9bc-67ff-4748-8e99-5688780af3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.548631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588d9bc-67ff-4748-8e99-5688780af3a1 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.550179 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 484/932] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:13.550518 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dc4a6-d9cd-4180-b663-b509c0f65fa4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.550863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588d9bc-67ff-4748-8e99-5688780af3a1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-163dc4a6-d9cd-4180-b663-b509c0f65fa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:21:13.565366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:13.566276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:13.567162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:21:13.567162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:21:13.567162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:21:13.567162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:21:13.567162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:21:13.567162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:21:13.567162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:13.567162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:13.573177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 449/933] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:13.573177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c45c8-e08a-4959-89c1-2170eb0a7f25 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.573177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c45c8-e08a-4959-89c1-2170eb0a7f25 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.573177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c45c8-e08a-4959-89c1-2170eb0a7f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.589245 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-811c45c8-e08a-4959-89c1-2170eb0a7f25 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:13.590773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-811c45c8-e08a-4959-89c1-2170eb0a7f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:13.591745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:13.623481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:13.665662 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588d9bc-67ff-4748-8e99-5688780af3a1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.665899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 450/934] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:13.666593 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c45c8-e08a-4959-89c1-2170eb0a7f25 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.705915 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a106f-2ae5-446c-a52b-a933578cac82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.706558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a106f-2ae5-446c-a52b-a933578cac82 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.706846 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a106f-2ae5-446c-a52b-a933578cac82 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.707125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a106f-2ae5-446c-a52b-a933578cac82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.713881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a106f-2ae5-446c-a52b-a933578cac82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.715380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a106f-2ae5-446c-a52b-a933578cac82 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-fb5a106f-2ae5-446c-a52b-a933578cac82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:21:13.730208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:13.731120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:13.732012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:21:13.732012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:21:13.732012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:21:13.732012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:21:13.732012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:21:13.732012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:21:13.732012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:13.732012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:13.732012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 485/935] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:13.732501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898f0cf-4efa-4de9-ae7b-d0336f1303d9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.733075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898f0cf-4efa-4de9-ae7b-d0336f1303d9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.733075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898f0cf-4efa-4de9-ae7b-d0336f1303d9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.734241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 486/936] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:13.734924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898f0cf-4efa-4de9-ae7b-d0336f1303d9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.775915 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c45c8-e08a-4959-89c1-2170eb0a7f25 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.820997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1666d36-ae5b-4be3-8ca8-821227a47708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.821550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1666d36-ae5b-4be3-8ca8-821227a47708 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.821831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1666d36-ae5b-4be3-8ca8-821227a47708 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.822108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1666d36-ae5b-4be3-8ca8-821227a47708 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.822860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1666d36-ae5b-4be3-8ca8-821227a47708 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:13.823171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1666d36-ae5b-4be3-8ca8-821227a47708 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.824749 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1666d36-ae5b-4be3-8ca8-821227a47708 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.838191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:13.844832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 451/937] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:21:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:13.845374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898f0cf-4efa-4de9-ae7b-d0336f1303d9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.845666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1666d36-ae5b-4be3-8ca8-821227a47708 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.876112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:13.887827 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65909b-06e4-4323-b927-e40408dc10e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.888864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65909b-06e4-4323-b927-e40408dc10e9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.889220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65909b-06e4-4323-b927-e40408dc10e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.889493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65909b-06e4-4323-b927-e40408dc10e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.890130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65909b-06e4-4323-b927-e40408dc10e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.891630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65909b-06e4-4323-b927-e40408dc10e9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-7d65909b-06e4-4323-b927-e40408dc10e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:13.902130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:13.903400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:13.904436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 487/938] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 6 01:21:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:13.906726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a253d-a7a5-4c56-8663-5b95098190d3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.908860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a253d-a7a5-4c56-8663-5b95098190d3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.909195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a253d-a7a5-4c56-8663-5b95098190d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.928806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8a6a253d-a7a5-4c56-8663-5b95098190d3 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:13.930173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8a6a253d-a7a5-4c56-8663-5b95098190d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:13.972991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1666d36-ae5b-4be3-8ca8-821227a47708 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.009261 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 488/939] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:14.010654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a253d-a7a5-4c56-8663-5b95098190d3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.015540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7d5f1-e385-48ba-a5a1-d72488e67811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.016276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7d5f1-e385-48ba-a5a1-d72488e67811 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.016661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7d5f1-e385-48ba-a5a1-d72488e67811 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.017071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7d5f1-e385-48ba-a5a1-d72488e67811 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.017933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7d5f1-e385-48ba-a5a1-d72488e67811 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:14.018343 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7d5f1-e385-48ba-a5a1-d72488e67811 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.020345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7d5f1-e385-48ba-a5a1-d72488e67811 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.039224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 452/940] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:21:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:14.039224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7d5f1-e385-48ba-a5a1-d72488e67811 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.124629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:14.138699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a253d-a7a5-4c56-8663-5b95098190d3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.146434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:14.160685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7d5f1-e385-48ba-a5a1-d72488e67811 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.175489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87060cb6-1a2a-4548-ba3d-f28e4f13bf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.176110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87060cb6-1a2a-4548-ba3d-f28e4f13bf2e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.176399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87060cb6-1a2a-4548-ba3d-f28e4f13bf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.176674 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87060cb6-1a2a-4548-ba3d-f28e4f13bf2e None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.177385 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87060cb6-1a2a-4548-ba3d-f28e4f13bf2e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:14.177689 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87060cb6-1a2a-4548-ba3d-f28e4f13bf2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.179056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87060cb6-1a2a-4548-ba3d-f28e4f13bf2e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.184626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 489/941] 10.222.0.15 () {56 vars in 1122 bytes} [Sat Aug 6 01:21:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:14.185421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87060cb6-1a2a-4548-ba3d-f28e4f13bf2e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.204020 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4844d0-fc82-4fe9-8351-198e18d8385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.205052 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4844d0-fc82-4fe9-8351-198e18d8385e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.205487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4844d0-fc82-4fe9-8351-198e18d8385e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.206013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4844d0-fc82-4fe9-8351-198e18d8385e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.206795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4844d0-fc82-4fe9-8351-198e18d8385e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.208346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4844d0-fc82-4fe9-8351-198e18d8385e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ed4844d0-fc82-4fe9-8351-198e18d8385e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:14.218687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:14.219847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:21:14.220896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:14.223398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 453/942] 10.222.0.15 () {56 vars in 1132 bytes} [Sat Aug 6 01:21:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:14.224398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4844d0-fc82-4fe9-8351-198e18d8385e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.291762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87060cb6-1a2a-4548-ba3d-f28e4f13bf2e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.327476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181de0b-e283-4fd5-ab00-0574e7ef1c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.328073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4844d0-fc82-4fe9-8351-198e18d8385e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.328546 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181de0b-e283-4fd5-ab00-0574e7ef1c78 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.328546 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181de0b-e283-4fd5-ab00-0574e7ef1c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.328754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181de0b-e283-4fd5-ab00-0574e7ef1c78 None admin] PATH_INFO: `/v3/projects/c344ed6bac754173af05207b5f444dca/users/f922f2209fff4986b04e1f0aaeb20fe5/roles/6adb3bcaecba49c7be505774fe3f5940` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.331042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181de0b-e283-4fd5-ab00-0574e7ef1c78 None admin] RBAC: Authorizing `identity:create_grant(project_id=c344ed6bac754173af05207b5f444dca, user_id=f922f2209fff4986b04e1f0aaeb20fe5, role_id=6adb3bcaecba49c7be505774fe3f5940)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.332474 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181de0b-e283-4fd5-ab00-0574e7ef1c78 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.348065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 490/943] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:21:14 2022] PUT /identity/v3/projects/c344ed6bac754173af05207b5f444dca/users/f922f2209fff4986b04e1f0aaeb20fe5/roles/6adb3bcaecba49c7be505774fe3f5940 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:14.348885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181de0b-e283-4fd5-ab00-0574e7ef1c78 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.379038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:14.386371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda7540-c025-417d-a8af-e5f5859e5790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.391991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda7540-c025-417d-a8af-e5f5859e5790 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.391991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda7540-c025-417d-a8af-e5f5859e5790 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.391991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda7540-c025-417d-a8af-e5f5859e5790 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.391991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda7540-c025-417d-a8af-e5f5859e5790 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:14.391991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda7540-c025-417d-a8af-e5f5859e5790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.391991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda7540-c025-417d-a8af-e5f5859e5790 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.399526 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 454/944] 10.222.0.15 () {56 vars in 1122 bytes} [Sat Aug 6 01:21:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:14.406742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda7540-c025-417d-a8af-e5f5859e5790 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.432151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:14.486712 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181de0b-e283-4fd5-ab00-0574e7ef1c78 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.543316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a024-536c-4af0-9ee0-44223325d7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.543943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a024-536c-4af0-9ee0-44223325d7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.544229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a024-536c-4af0-9ee0-44223325d7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.544508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a024-536c-4af0-9ee0-44223325d7c9 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.545229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73a024-536c-4af0-9ee0-44223325d7c9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:14.545541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73a024-536c-4af0-9ee0-44223325d7c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.546920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73a024-536c-4af0-9ee0-44223325d7c9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.552562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 491/945] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 6 01:21:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:14.552845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda7540-c025-417d-a8af-e5f5859e5790 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.558630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a024-536c-4af0-9ee0-44223325d7c9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.598040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a5fca-c0a6-4223-b92f-db5734f2056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.598677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a5fca-c0a6-4223-b92f-db5734f2056f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.599003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a5fca-c0a6-4223-b92f-db5734f2056f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.599290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a5fca-c0a6-4223-b92f-db5734f2056f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.600217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a5fca-c0a6-4223-b92f-db5734f2056f None admin] RBAC: Adding query filter params (interface=public, service_id=97f7695e7a5a464bb8faea98bb5bb750, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:14.600539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a5fca-c0a6-4223-b92f-db5734f2056f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.602586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a5fca-c0a6-4223-b92f-db5734f2056f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.609935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 455/946] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 6 01:21:14 2022] GET /identity/v3/endpoints?service_id=97f7695e7a5a464bb8faea98bb5bb750&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:14.614968 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a5fca-c0a6-4223-b92f-db5734f2056f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.659093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:14.683558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a024-536c-4af0-9ee0-44223325d7c9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.720723 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6a79f-0a8c-45a3-9da5-cdf48d7c39ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.721716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6a79f-0a8c-45a3-9da5-cdf48d7c39ae None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.722246 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6a79f-0a8c-45a3-9da5-cdf48d7c39ae None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.722832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6a79f-0a8c-45a3-9da5-cdf48d7c39ae None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.723717 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6a79f-0a8c-45a3-9da5-cdf48d7c39ae None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:14.724224 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6a79f-0a8c-45a3-9da5-cdf48d7c39ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.725816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6a79f-0a8c-45a3-9da5-cdf48d7c39ae None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.732098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 492/947] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 6 01:21:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:14.737861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6a79f-0a8c-45a3-9da5-cdf48d7c39ae None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.744708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:14.762333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a5fca-c0a6-4223-b92f-db5734f2056f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.806321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659eeda-52c3-4a29-a756-841ed3994833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.807386 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659eeda-52c3-4a29-a756-841ed3994833 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.808019 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659eeda-52c3-4a29-a756-841ed3994833 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.808494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659eeda-52c3-4a29-a756-841ed3994833 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.809441 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659eeda-52c3-4a29-a756-841ed3994833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.811091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659eeda-52c3-4a29-a756-841ed3994833 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.823339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 456/948] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 6 01:21:14 2022] GET /identity/v3/services => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:14.856098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6a79f-0a8c-45a3-9da5-cdf48d7c39ae None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.895593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52ea37-b232-40ac-9639-8599a2cec05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.896229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ea37-b232-40ac-9639-8599a2cec05a None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.896520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ea37-b232-40ac-9639-8599a2cec05a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.896800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ea37-b232-40ac-9639-8599a2cec05a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.897568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52ea37-b232-40ac-9639-8599a2cec05a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.899018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52ea37-b232-40ac-9639-8599a2cec05a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.922637 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:14.929914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 493/949] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:15.962114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744397e3-7286-4e52-b75a-8e4a4d81d143 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.962669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744397e3-7286-4e52-b75a-8e4a4d81d143 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.962669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744397e3-7286-4e52-b75a-8e4a4d81d143 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.965173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 457/950] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:15.970745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9549bb1-1b21-44bb-b337-d5f3f2ca02ab None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.971182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9549bb1-1b21-44bb-b337-d5f3f2ca02ab None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.971278 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9549bb1-1b21-44bb-b337-d5f3f2ca02ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.990841 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b9549bb1-1b21-44bb-b337-d5f3f2ca02ab None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:15.992068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b9549bb1-1b21-44bb-b337-d5f3f2ca02ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:16.076997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 494/951] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:16.095158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744397e3-7286-4e52-b75a-8e4a4d81d143 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.203165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744397e3-7286-4e52-b75a-8e4a4d81d143 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.238161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0780c5-9dac-457d-8fd9-89dc17056223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.238707 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0780c5-9dac-457d-8fd9-89dc17056223 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.238993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0780c5-9dac-457d-8fd9-89dc17056223 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.239271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0780c5-9dac-457d-8fd9-89dc17056223 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.239963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0780c5-9dac-457d-8fd9-89dc17056223 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.241426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0780c5-9dac-457d-8fd9-89dc17056223 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.258474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.sql.core [None req-bf0780c5-9dac-457d-8fd9-89dc17056223 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 01:21:16.258474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 06 01:21:16.258474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [parameters: {'user_id': '1139a6763fed45e1974b95742caab9c6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 06 01:21:16.258474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80158) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-bf0780c5-9dac-457d-8fd9-89dc17056223 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Aug 06 01:21:16.267022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 01:21:16.267921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application yield resource Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise self.value Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application session.commit() Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 01:21:16.268970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.flush() Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application compat.raise_( Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 01:21:16.270035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 01:21:16.270978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 01:21:16.271870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [parameters: {'user_id': '1139a6763fed45e1974b95742caab9c6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:16.272728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 06 01:21:16.275624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 06 01:21:16.277943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 06 01:21:16.277943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 06 01:21:16.277943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 01:21:16.277943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 01:21:16.277943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 06 01:21:16.277943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:16.277943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 458/952] 10.222.0.15 () {60 vars in 1131 bytes} [Sat Aug 6 01:21:16 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:16.278543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9549bb1-1b21-44bb-b337-d5f3f2ca02ab None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.391213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9549bb1-1b21-44bb-b337-d5f3f2ca02ab None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.421276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:16.432756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7105ef-f90b-4c8b-9cc6-05bed7881d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.433443 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7105ef-f90b-4c8b-9cc6-05bed7881d9e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.433732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7105ef-f90b-4c8b-9cc6-05bed7881d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.434070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7105ef-f90b-4c8b-9cc6-05bed7881d9e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.441827 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7105ef-f90b-4c8b-9cc6-05bed7881d9e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.443342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7105ef-f90b-4c8b-9cc6-05bed7881d9e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3a7105ef-f90b-4c8b-9cc6-05bed7881d9e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:21:16.455878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:16.456849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:16.458318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:16.458318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:16.458318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:21:16.458318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:21:16.458318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:21:16.458318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:21:16.458318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:21:16.458318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:21:16.458318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:21:16.458318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:16.458318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 495/953] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:21:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:16.462374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd16f0-fcc9-4a4e-940d-b0e53b8e1d94 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.462666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd16f0-fcc9-4a4e-940d-b0e53b8e1d94 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.463497 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd16f0-fcc9-4a4e-940d-b0e53b8e1d94 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.468098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 459/954] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:16.472677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7105ef-f90b-4c8b-9cc6-05bed7881d9e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.474180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b4438-c8aa-43a6-b38e-8f914ddd196d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.474692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b4438-c8aa-43a6-b38e-8f914ddd196d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.475183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b4438-c8aa-43a6-b38e-8f914ddd196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.490884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:16.495185 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c61b4438-c8aa-43a6-b38e-8f914ddd196d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:16.497006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c61b4438-c8aa-43a6-b38e-8f914ddd196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:16.572554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 460/955] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:16.595821 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b4438-c8aa-43a6-b38e-8f914ddd196d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.599751 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7105ef-f90b-4c8b-9cc6-05bed7881d9e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.636465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f61e2b-92c0-44cb-9adc-ca81c2f0da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.636676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f61e2b-92c0-44cb-9adc-ca81c2f0da82 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.636985 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f61e2b-92c0-44cb-9adc-ca81c2f0da82 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.637250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f61e2b-92c0-44cb-9adc-ca81c2f0da82 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.638036 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f61e2b-92c0-44cb-9adc-ca81c2f0da82 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:16.638602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f61e2b-92c0-44cb-9adc-ca81c2f0da82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.640052 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f61e2b-92c0-44cb-9adc-ca81c2f0da82 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.677652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 496/956] 10.222.0.15 () {56 vars in 1101 bytes} [Sat Aug 6 01:21:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:16.711908 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b4438-c8aa-43a6-b38e-8f914ddd196d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.755784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0b228-874e-4cac-9d3e-77ebd06fb218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.756813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0b228-874e-4cac-9d3e-77ebd06fb218 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.757334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0b228-874e-4cac-9d3e-77ebd06fb218 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.757818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0b228-874e-4cac-9d3e-77ebd06fb218 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.762065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:16.773187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0b228-874e-4cac-9d3e-77ebd06fb218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-39a0b228-874e-4cac-9d3e-77ebd06fb218 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:16.780013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:16.781059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:16.781907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:16.781907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:16.781907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:16.781907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:16.781907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:16.781907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:16.781907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:16.781907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:16.781907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:16.781907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:16.781907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:21:16.781907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:16.784798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 461/957] 10.222.0.15 () {56 vars in 1120 bytes} [Sat Aug 6 01:21:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:16.796776 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f61e2b-92c0-44cb-9adc-ca81c2f0da82 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.841953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:16.904180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f61e2b-92c0-44cb-9adc-ca81c2f0da82 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.942020 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bbbf9-8f84-44fe-a573-e65647d4c0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.942649 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bbbf9-8f84-44fe-a573-e65647d4c0df None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.942936 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bbbf9-8f84-44fe-a573-e65647d4c0df None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.943259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bbbf9-8f84-44fe-a573-e65647d4c0df None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.943997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bbbf9-8f84-44fe-a573-e65647d4c0df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:16.944302 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bbbf9-8f84-44fe-a573-e65647d4c0df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.945711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bbbf9-8f84-44fe-a573-e65647d4c0df None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.956446 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 497/958] 10.222.0.15 () {56 vars in 1115 bytes} [Sat Aug 6 01:21:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:16.962491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0b228-874e-4cac-9d3e-77ebd06fb218 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.005505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d46f10-6d83-4084-97b1-ab0d53eb6ca3 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.006092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d46f10-6d83-4084-97b1-ab0d53eb6ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.006092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d46f10-6d83-4084-97b1-ab0d53eb6ca3 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.007566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 498/959] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:21:17.013145 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fcbe0-801b-45fd-b241-b5a300e38f20 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.013743 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fcbe0-801b-45fd-b241-b5a300e38f20 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.014034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fcbe0-801b-45fd-b241-b5a300e38f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.032342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-dc4fcbe0-801b-45fd-b241-b5a300e38f20 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:17.033610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-dc4fcbe0-801b-45fd-b241-b5a300e38f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:17.072855 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0b228-874e-4cac-9d3e-77ebd06fb218 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.100348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 499/960] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:17.102255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09838879-9549-44e7-bb4b-fa8e1d2e6458 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.102548 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09838879-9549-44e7-bb4b-fa8e1d2e6458 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.102828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09838879-9549-44e7-bb4b-fa8e1d2e6458 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.104825 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 500/961] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:17.110062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfc759-af29-4a95-bc66-de2b15994640 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.110412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfc759-af29-4a95-bc66-de2b15994640 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.110619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfc759-af29-4a95-bc66-de2b15994640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.112059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad95cb-b86e-411c-9e59-f2bf5aee7626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.112753 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad95cb-b86e-411c-9e59-f2bf5aee7626 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.113151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad95cb-b86e-411c-9e59-f2bf5aee7626 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.113417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad95cb-b86e-411c-9e59-f2bf5aee7626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.124217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad95cb-b86e-411c-9e59-f2bf5aee7626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.125927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad95cb-b86e-411c-9e59-f2bf5aee7626 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.129887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e0cfc759-af29-4a95-bc66-de2b15994640 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:17.131062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e0cfc759-af29-4a95-bc66-de2b15994640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-35ad95cb-b86e-411c-9e59-f2bf5aee7626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:17.142038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:17.143184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:17.144275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:17.144275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:17.144275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:17.144275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:17.144275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 462/962] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:17.144275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad95cb-b86e-411c-9e59-f2bf5aee7626 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.160277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:17.197652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:17.201218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 501/963] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:17.202086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfc759-af29-4a95-bc66-de2b15994640 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.250387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad95cb-b86e-411c-9e59-f2bf5aee7626 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.285184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eca8b-8396-439a-bcae-af97a085e5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.285739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eca8b-8396-439a-bcae-af97a085e5ec None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.286025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eca8b-8396-439a-bcae-af97a085e5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.286298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eca8b-8396-439a-bcae-af97a085e5ec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.286942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4eca8b-8396-439a-bcae-af97a085e5ec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.288290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4eca8b-8396-439a-bcae-af97a085e5ec None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ff4eca8b-8396-439a-bcae-af97a085e5ec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:17.297804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:17.299075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:17.300135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 463/964] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:17.301200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eca8b-8396-439a-bcae-af97a085e5ec None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.310066 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfc759-af29-4a95-bc66-de2b15994640 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.344979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f4e58-6b6f-43bc-8cdb-30ac9128ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.345591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f4e58-6b6f-43bc-8cdb-30ac9128ebaf None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.345869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f4e58-6b6f-43bc-8cdb-30ac9128ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.346140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f4e58-6b6f-43bc-8cdb-30ac9128ebaf None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.346824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f4e58-6b6f-43bc-8cdb-30ac9128ebaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:17.347123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f4e58-6b6f-43bc-8cdb-30ac9128ebaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.348487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f4e58-6b6f-43bc-8cdb-30ac9128ebaf None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.365072 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 502/965] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:17.365072 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f4e58-6b6f-43bc-8cdb-30ac9128ebaf None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.386617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:17.405936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eca8b-8396-439a-bcae-af97a085e5ec None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.418600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:17.441778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29f80f-fc4b-436c-9bb5-6ef08a26a0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.442414 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29f80f-fc4b-436c-9bb5-6ef08a26a0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.442697 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29f80f-fc4b-436c-9bb5-6ef08a26a0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.442971 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29f80f-fc4b-436c-9bb5-6ef08a26a0c2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.443599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29f80f-fc4b-436c-9bb5-6ef08a26a0c2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.444985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29f80f-fc4b-436c-9bb5-6ef08a26a0c2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-da29f80f-fc4b-436c-9bb5-6ef08a26a0c2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:17.454565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:17.455748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:17.456747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 464/966] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:17.457780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29f80f-fc4b-436c-9bb5-6ef08a26a0c2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.464435 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f4e58-6b6f-43bc-8cdb-30ac9128ebaf None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.497372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c28930-8392-4e12-8440-27453dfc5b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.497976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c28930-8392-4e12-8440-27453dfc5b9f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.498255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c28930-8392-4e12-8440-27453dfc5b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.498527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c28930-8392-4e12-8440-27453dfc5b9f None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.499195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c28930-8392-4e12-8440-27453dfc5b9f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:17.499495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c28930-8392-4e12-8440-27453dfc5b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.500838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c28930-8392-4e12-8440-27453dfc5b9f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.505408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 503/967] 10.222.0.15 () {56 vars in 1122 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:17.506157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c28930-8392-4e12-8440-27453dfc5b9f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.556997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29f80f-fc4b-436c-9bb5-6ef08a26a0c2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.590398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e988-c33a-4e79-8a17-6bae41159d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.591046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e988-c33a-4e79-8a17-6bae41159d0d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.591328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e988-c33a-4e79-8a17-6bae41159d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.591611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408e988-c33a-4e79-8a17-6bae41159d0d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.594476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:17.599530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408e988-c33a-4e79-8a17-6bae41159d0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.600983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408e988-c33a-4e79-8a17-6bae41159d0d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.607504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c28930-8392-4e12-8440-27453dfc5b9f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8408e988-c33a-4e79-8a17-6bae41159d0d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:21:17.612173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:17.613330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:17.614338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:17.614338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:17.614338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:21:17.614338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:21:17.614338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:21:17.614338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:21:17.614338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:21:17.614338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:21:17.614338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:21:17.614338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:17.614338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 465/968] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:17.614995 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e988-c33a-4e79-8a17-6bae41159d0d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.642632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016cc97-32db-4589-b014-79e53f2534cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.643240 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016cc97-32db-4589-b014-79e53f2534cc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.643518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016cc97-32db-4589-b014-79e53f2534cc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.643789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016cc97-32db-4589-b014-79e53f2534cc None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.644455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016cc97-32db-4589-b014-79e53f2534cc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:17.644754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016cc97-32db-4589-b014-79e53f2534cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.646128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016cc97-32db-4589-b014-79e53f2534cc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.648764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:17.651397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 504/969] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:17.652200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016cc97-32db-4589-b014-79e53f2534cc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.715182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408e988-c33a-4e79-8a17-6bae41159d0d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.748701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e1fa6-1ce8-4e19-b847-ad10bcd71164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.749335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e1fa6-1ce8-4e19-b847-ad10bcd71164 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.749617 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e1fa6-1ce8-4e19-b847-ad10bcd71164 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.749888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e1fa6-1ce8-4e19-b847-ad10bcd71164 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.750315 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016cc97-32db-4589-b014-79e53f2534cc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.750559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e1fa6-1ce8-4e19-b847-ad10bcd71164 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:17.750861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e1fa6-1ce8-4e19-b847-ad10bcd71164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.752276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e1fa6-1ce8-4e19-b847-ad10bcd71164 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.757175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 466/970] 10.222.0.15 () {56 vars in 1122 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:17.757934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e1fa6-1ce8-4e19-b847-ad10bcd71164 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.789556 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c988b-f8ff-4517-8b99-764b5cbeab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.790174 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c988b-f8ff-4517-8b99-764b5cbeab44 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.790464 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c988b-f8ff-4517-8b99-764b5cbeab44 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.790735 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c988b-f8ff-4517-8b99-764b5cbeab44 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.792248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c988b-f8ff-4517-8b99-764b5cbeab44 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:17.792559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c988b-f8ff-4517-8b99-764b5cbeab44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.793984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c988b-f8ff-4517-8b99-764b5cbeab44 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.810631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 505/971] 10.222.0.15 () {56 vars in 1149 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:17.811328 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c988b-f8ff-4517-8b99-764b5cbeab44 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.823650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:17.857478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:17.860423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e1fa6-1ce8-4e19-b847-ad10bcd71164 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.894733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a7267-fd8b-463d-9abe-7d1f9daafdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.895346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a7267-fd8b-463d-9abe-7d1f9daafdde None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.895622 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a7267-fd8b-463d-9abe-7d1f9daafdde None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.895892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a7267-fd8b-463d-9abe-7d1f9daafdde None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.896556 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a7267-fd8b-463d-9abe-7d1f9daafdde None admin] RBAC: Adding query filter params (type=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:17.896860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a7267-fd8b-463d-9abe-7d1f9daafdde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.898237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a7267-fd8b-463d-9abe-7d1f9daafdde None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.903244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 467/972] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:17.904055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a7267-fd8b-463d-9abe-7d1f9daafdde None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.914619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c988b-f8ff-4517-8b99-764b5cbeab44 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.958698 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ccfa-7bd8-42ee-86a8-bd1c83d85462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.959348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ccfa-7bd8-42ee-86a8-bd1c83d85462 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.959631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ccfa-7bd8-42ee-86a8-bd1c83d85462 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.959906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ccfa-7bd8-42ee-86a8-bd1c83d85462 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.960648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2ccfa-7bd8-42ee-86a8-bd1c83d85462 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.962257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2ccfa-7bd8-42ee-86a8-bd1c83d85462 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.993122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 506/973] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:18.033974 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a7267-fd8b-463d-9abe-7d1f9daafdde None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.081943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381350e-ba07-4d6c-8bd7-f73084aa760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.082496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381350e-ba07-4d6c-8bd7-f73084aa760b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.082779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381350e-ba07-4d6c-8bd7-f73084aa760b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.083054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381350e-ba07-4d6c-8bd7-f73084aa760b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.116521 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:18.164461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381350e-ba07-4d6c-8bd7-f73084aa760b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:18.165989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381350e-ba07-4d6c-8bd7-f73084aa760b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:18.268300 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 468/974] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:21:18.274133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ccfa-7bd8-42ee-86a8-bd1c83d85462 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:18.340237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:18.382731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ccfa-7bd8-42ee-86a8-bd1c83d85462 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.418880 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0bf80-4a70-46e1-beef-b5db2793604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.419526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0bf80-4a70-46e1-beef-b5db2793604a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.419804 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0bf80-4a70-46e1-beef-b5db2793604a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.420074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0bf80-4a70-46e1-beef-b5db2793604a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.430881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0bf80-4a70-46e1-beef-b5db2793604a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:18.432421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0bf80-4a70-46e1-beef-b5db2793604a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e5a0bf80-4a70-46e1-beef-b5db2793604a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:18.446719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:18.448706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:18.449699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:18.449699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:18.449699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:18.449699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:18.449699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 507/975] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:18.456155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381350e-ba07-4d6c-8bd7-f73084aa760b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:18.518992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:18.563413 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381350e-ba07-4d6c-8bd7-f73084aa760b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.597809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2aaa4-8810-464d-bfcb-6c21336f2067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.598346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2aaa4-8810-464d-bfcb-6c21336f2067 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.598623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2aaa4-8810-464d-bfcb-6c21336f2067 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.598893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2aaa4-8810-464d-bfcb-6c21336f2067 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.599576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2aaa4-8810-464d-bfcb-6c21336f2067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:18.599878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2aaa4-8810-464d-bfcb-6c21336f2067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:18.601251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2aaa4-8810-464d-bfcb-6c21336f2067 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:18.613421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 469/976] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:18.618796 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0bf80-4a70-46e1-beef-b5db2793604a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:18.719805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0bf80-4a70-46e1-beef-b5db2793604a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.736628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:18.755032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe5008-0b46-4a9a-8dad-a5dd2f5dcf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.755756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe5008-0b46-4a9a-8dad-a5dd2f5dcf77 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.756102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe5008-0b46-4a9a-8dad-a5dd2f5dcf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.756443 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe5008-0b46-4a9a-8dad-a5dd2f5dcf77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.764140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe5008-0b46-4a9a-8dad-a5dd2f5dcf77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:18.765663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe5008-0b46-4a9a-8dad-a5dd2f5dcf77 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-48fe5008-0b46-4a9a-8dad-a5dd2f5dcf77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:21:18.776870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:18.777988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:18.779131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:21:18.779131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:21:18.779131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:21:18.779131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:21:18.779131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:21:18.779131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:21:18.779131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:18.779131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:18.781211 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 508/977] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:18.785204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2aaa4-8810-464d-bfcb-6c21336f2067 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:18.888244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2aaa4-8810-464d-bfcb-6c21336f2067 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.908610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:18.924400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c081bee-4cde-462d-a876-57639f43f660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.925196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c081bee-4cde-462d-a876-57639f43f660 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.925581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c081bee-4cde-462d-a876-57639f43f660 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.925957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c081bee-4cde-462d-a876-57639f43f660 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.926859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c081bee-4cde-462d-a876-57639f43f660 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:18.927266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c081bee-4cde-462d-a876-57639f43f660 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:18.928772 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c081bee-4cde-462d-a876-57639f43f660 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:18.946098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 470/978] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:21:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:18.947664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe5008-0b46-4a9a-8dad-a5dd2f5dcf77 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:19.053695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe5008-0b46-4a9a-8dad-a5dd2f5dcf77 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:19.090359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31d1ce-9592-4da1-8ca5-9128c7edcfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:19.090983 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31d1ce-9592-4da1-8ca5-9128c7edcfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:19.091267 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31d1ce-9592-4da1-8ca5-9128c7edcfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:19.091543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31d1ce-9592-4da1-8ca5-9128c7edcfd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:19.092338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31d1ce-9592-4da1-8ca5-9128c7edcfd2 None admin] RBAC: Adding query filter params (role.id=6adb3bcaecba49c7be505774fe3f5940, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=f922f2209fff4986b04e1f0aaeb20fe5) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:19.092652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31d1ce-9592-4da1-8ca5-9128c7edcfd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:19.094101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31d1ce-9592-4da1-8ca5-9128c7edcfd2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:19.109176 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 509/979] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:21:18 2022] GET /identity/v3/role_assignments?user.id=f922f2209fff4986b04e1f0aaeb20fe5&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=6adb3bcaecba49c7be505774fe3f5940 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:19.987214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761b3dd-8069-4a6c-94fc-8710a406d74d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:19.987737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761b3dd-8069-4a6c-94fc-8710a406d74d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:19.987816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761b3dd-8069-4a6c-94fc-8710a406d74d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:19.989289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 471/980] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:19.994307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7d7f5-76c9-4fc1-abef-b0846a235e30 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:19.994733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7d7f5-76c9-4fc1-abef-b0846a235e30 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:19.994878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7d7f5-76c9-4fc1-abef-b0846a235e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.013863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b5b7d7f5-76c9-4fc1-abef-b0846a235e30 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:20.015071 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b5b7d7f5-76c9-4fc1-abef-b0846a235e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:20.039532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9da57c-83e0-4cf4-9623-eca642d3a535 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.039826 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9da57c-83e0-4cf4-9623-eca642d3a535 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.040438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9da57c-83e0-4cf4-9623-eca642d3a535 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.041976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 472/981] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:21:20.046763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad01a13-af3e-4529-8329-29af4d976e93 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.047089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad01a13-af3e-4529-8329-29af4d976e93 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.047371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad01a13-af3e-4529-8329-29af4d976e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.052840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:20.067064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6ad01a13-af3e-4529-8329-29af4d976e93 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:20.068324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6ad01a13-af3e-4529-8329-29af4d976e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:20.089143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 510/982] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:20.112240 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7d7f5-76c9-4fc1-abef-b0846a235e30 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:20.142666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 473/983] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:20.165066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad01a13-af3e-4529-8329-29af4d976e93 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:20.220677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7d7f5-76c9-4fc1-abef-b0846a235e30 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:20.265970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e61d-f70b-4849-9c80-2d24171e7840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:20.266792 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e61d-f70b-4849-9c80-2d24171e7840 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.267087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e61d-f70b-4849-9c80-2d24171e7840 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.267364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e61d-f70b-4849-9c80-2d24171e7840 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.268320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080e61d-f70b-4849-9c80-2d24171e7840 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:20.270388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080e61d-f70b-4849-9c80-2d24171e7840 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.271447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad01a13-af3e-4529-8329-29af4d976e93 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:20.284613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:20.287374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 511/984] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:21:20 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:20.320718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85f41f-73f4-49c3-bf8d-e21aef22626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:20.321751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85f41f-73f4-49c3-bf8d-e21aef22626c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.322784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85f41f-73f4-49c3-bf8d-e21aef22626c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.323225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85f41f-73f4-49c3-bf8d-e21aef22626c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.324017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85f41f-73f4-49c3-bf8d-e21aef22626c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:20.325652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85f41f-73f4-49c3-bf8d-e21aef22626c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-db85f41f-73f4-49c3-bf8d-e21aef22626c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:20.335616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:20.337042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:20.338016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:20.339140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 474/985] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 6 01:21:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:20.344632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e61d-f70b-4849-9c80-2d24171e7840 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:20.380798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:20.457033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e61d-f70b-4849-9c80-2d24171e7840 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:20.493690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25864f42-dac9-4dd0-9764-5b76d622cfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:20.494472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25864f42-dac9-4dd0-9764-5b76d622cfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.494939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25864f42-dac9-4dd0-9764-5b76d622cfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.495227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25864f42-dac9-4dd0-9764-5b76d622cfd1 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.495922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25864f42-dac9-4dd0-9764-5b76d622cfd1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:20.496235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25864f42-dac9-4dd0-9764-5b76d622cfd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:20.497635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25864f42-dac9-4dd0-9764-5b76d622cfd1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.502720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 512/986] 10.222.0.15 () {56 vars in 1122 bytes} [Sat Aug 6 01:21:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:20.508263 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85f41f-73f4-49c3-bf8d-e21aef22626c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:20.614469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85f41f-73f4-49c3-bf8d-e21aef22626c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:20.648574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85bed8-2f3c-42db-a7c7-842b88674f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:20.649225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85bed8-2f3c-42db-a7c7-842b88674f29 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.649511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85bed8-2f3c-42db-a7c7-842b88674f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.649790 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85bed8-2f3c-42db-a7c7-842b88674f29 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.650501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85bed8-2f3c-42db-a7c7-842b88674f29 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:20.650840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85bed8-2f3c-42db-a7c7-842b88674f29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:20.652175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85bed8-2f3c-42db-a7c7-842b88674f29 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.661847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 475/987] 10.222.0.15 () {56 vars in 1122 bytes} [Sat Aug 6 01:21:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:20.663272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25864f42-dac9-4dd0-9764-5b76d622cfd1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:20.759943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:20.767512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25864f42-dac9-4dd0-9764-5b76d622cfd1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:20.802412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43f4b1-1741-4f19-9787-7b4745638903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:20.803036 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43f4b1-1741-4f19-9787-7b4745638903 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.803321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43f4b1-1741-4f19-9787-7b4745638903 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.803597 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43f4b1-1741-4f19-9787-7b4745638903 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.804358 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43f4b1-1741-4f19-9787-7b4745638903 None admin] RBAC: Adding query filter params (interface=admin, service_id=97f7695e7a5a464bb8faea98bb5bb750, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:20.804675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43f4b1-1741-4f19-9787-7b4745638903 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:20.806073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43f4b1-1741-4f19-9787-7b4745638903 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.816184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 513/988] 10.222.0.15 () {56 vars in 1249 bytes} [Sat Aug 6 01:21:20 2022] GET /identity/v3/endpoints?service_id=97f7695e7a5a464bb8faea98bb5bb750&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:20.817296 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85bed8-2f3c-42db-a7c7-842b88674f29 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:20.853744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:20.922254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85bed8-2f3c-42db-a7c7-842b88674f29 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:20.956922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c4701-d395-49f4-8c3d-02ff6360f175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:20.957575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c4701-d395-49f4-8c3d-02ff6360f175 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.957855 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c4701-d395-49f4-8c3d-02ff6360f175 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.958130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c4701-d395-49f4-8c3d-02ff6360f175 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.958778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c4701-d395-49f4-8c3d-02ff6360f175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:20.960126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c4701-d395-49f4-8c3d-02ff6360f175 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.972985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 476/989] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 6 01:21:20 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:21.138979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b4506-c5e6-4f63-827e-27e60b1c1ad8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.139508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b4506-c5e6-4f63-827e-27e60b1c1ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.139508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b4506-c5e6-4f63-827e-27e60b1c1ad8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.140856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 514/990] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:21.146340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246d51f-aeff-4b68-92f0-72ff4f90c3be None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.146760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246d51f-aeff-4b68-92f0-72ff4f90c3be None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.146899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246d51f-aeff-4b68-92f0-72ff4f90c3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.165524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7246d51f-aeff-4b68-92f0-72ff4f90c3be None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:21.166752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7246d51f-aeff-4b68-92f0-72ff4f90c3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:21.237016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 477/991] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:21.258975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b4506-c5e6-4f63-827e-27e60b1c1ad8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:21.375669 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b4506-c5e6-4f63-827e-27e60b1c1ad8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:21.412161 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8be8eb-a681-4c4f-a78d-0573a2c9cdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:21.413207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8be8eb-a681-4c4f-a78d-0573a2c9cdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.413695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8be8eb-a681-4c4f-a78d-0573a2c9cdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.414168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8be8eb-a681-4c4f-a78d-0573a2c9cdf1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.415006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8be8eb-a681-4c4f-a78d-0573a2c9cdf1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:21.416598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8be8eb-a681-4c4f-a78d-0573a2c9cdf1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-be8be8eb-a681-4c4f-a78d-0573a2c9cdf1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:21.426198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:21.427339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:21:21.428200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:21.429076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 515/992] 10.222.0.15 () {56 vars in 1105 bytes} [Sat Aug 6 01:21:21 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:21.435318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246d51f-aeff-4b68-92f0-72ff4f90c3be None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:21.465338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:21.539136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246d51f-aeff-4b68-92f0-72ff4f90c3be None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:21.572943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e11539-168c-4925-88f4-90c8864958e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:21.573830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e11539-168c-4925-88f4-90c8864958e2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.574331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e11539-168c-4925-88f4-90c8864958e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.574824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e11539-168c-4925-88f4-90c8864958e2 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.575713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e11539-168c-4925-88f4-90c8864958e2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:21.576216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e11539-168c-4925-88f4-90c8864958e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:21.577804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e11539-168c-4925-88f4-90c8864958e2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:21.583065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 478/993] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:21.589201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8be8eb-a681-4c4f-a78d-0573a2c9cdf1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:21.616204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:21.696863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8be8eb-a681-4c4f-a78d-0573a2c9cdf1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:21.735248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89150040-c60c-4616-a090-df1965d24e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:21.735867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89150040-c60c-4616-a090-df1965d24e00 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.736149 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89150040-c60c-4616-a090-df1965d24e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.736425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89150040-c60c-4616-a090-df1965d24e00 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.737134 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89150040-c60c-4616-a090-df1965d24e00 None admin] RBAC: Adding query filter params (type=image) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:21.737444 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89150040-c60c-4616-a090-df1965d24e00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:21.738803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89150040-c60c-4616-a090-df1965d24e00 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:21.743367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 516/994] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:22.338172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a38a8-d936-4985-b922-f2eaadbab955 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:22.338701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a38a8-d936-4985-b922-f2eaadbab955 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:22.338701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a38a8-d936-4985-b922-f2eaadbab955 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:22.340209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 479/995] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:22.345300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc386f4-f6a1-4fef-a111-c21a720e29b7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:22.345707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc386f4-f6a1-4fef-a111-c21a720e29b7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:22.345889 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc386f4-f6a1-4fef-a111-c21a720e29b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:22.366834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0dc386f4-f6a1-4fef-a111-c21a720e29b7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:22.368346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0dc386f4-f6a1-4fef-a111-c21a720e29b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:22.438520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 517/996] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:22.460576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a38a8-d936-4985-b922-f2eaadbab955 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:22.554576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:22.565760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a38a8-d936-4985-b922-f2eaadbab955 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:22.600895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea5447-3953-4fa3-a85f-7677fd64375c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:22.601849 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea5447-3953-4fa3-a85f-7677fd64375c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:22.602312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea5447-3953-4fa3-a85f-7677fd64375c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:22.602775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea5447-3953-4fa3-a85f-7677fd64375c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:22.604356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea5447-3953-4fa3-a85f-7677fd64375c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:22.605934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea5447-3953-4fa3-a85f-7677fd64375c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4fea5447-3953-4fa3-a85f-7677fd64375c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:22.614940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:22.615920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:21:22.616779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:22.623160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 480/997] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:22.624413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc386f4-f6a1-4fef-a111-c21a720e29b7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:22.642889 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:22.725110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc386f4-f6a1-4fef-a111-c21a720e29b7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:22.758828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e024f-65de-4922-8558-792e2fee3e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:22.759557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e024f-65de-4922-8558-792e2fee3e5d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:22.759843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e024f-65de-4922-8558-792e2fee3e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:22.760231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e024f-65de-4922-8558-792e2fee3e5d None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:22.760931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e024f-65de-4922-8558-792e2fee3e5d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:22.761249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e024f-65de-4922-8558-792e2fee3e5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:22.762611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e024f-65de-4922-8558-792e2fee3e5d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:22.772321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 518/998] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:21:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:22.773582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea5447-3953-4fa3-a85f-7677fd64375c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:22.880253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea5447-3953-4fa3-a85f-7677fd64375c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:22.914373 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c9b00-d312-4f97-8849-cf1db324d3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:22.915002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9b00-d312-4f97-8849-cf1db324d3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:22.915266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9b00-d312-4f97-8849-cf1db324d3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:22.916146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c9b00-d312-4f97-8849-cf1db324d3d3 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:22.916831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c9b00-d312-4f97-8849-cf1db324d3d3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:22.917161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c9b00-d312-4f97-8849-cf1db324d3d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:22.918535 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c9b00-d312-4f97-8849-cf1db324d3d3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:22.923824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 481/999] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:21:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:22.929380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e024f-65de-4922-8558-792e2fee3e5d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:23.007561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572fb83-c1a6-4b06-a589-d20f24864839 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:23.008093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572fb83-c1a6-4b06-a589-d20f24864839 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:23.008374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572fb83-c1a6-4b06-a589-d20f24864839 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:23.010347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 482/1000] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:23.011912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:23.016094 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f293-b0fd-459f-930c-d004287a1255 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:23.016377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f293-b0fd-459f-930c-d004287a1255 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:23.016651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f293-b0fd-459f-930c-d004287a1255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:23.034714 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e024f-65de-4922-8558-792e2fee3e5d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:23.036035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c300f293-b0fd-459f-930c-d004287a1255 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:23.037262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c300f293-b0fd-459f-930c-d004287a1255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:23.055869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:23.073556 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144979d-bdae-40a2-b49c-3da17200521d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:23.074370 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144979d-bdae-40a2-b49c-3da17200521d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:23.074650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144979d-bdae-40a2-b49c-3da17200521d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:23.074927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144979d-bdae-40a2-b49c-3da17200521d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:23.075676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144979d-bdae-40a2-b49c-3da17200521d None admin] RBAC: Adding query filter params (interface=public, service_id=4de37afae9c548c4ab1985957f04c939, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:23.075985 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144979d-bdae-40a2-b49c-3da17200521d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:23.077375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144979d-bdae-40a2-b49c-3da17200521d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:23.082536 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 519/1001] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 6 01:21:22 2022] GET /identity/v3/endpoints?service_id=4de37afae9c548c4ab1985957f04c939&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:23.088025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144979d-bdae-40a2-b49c-3da17200521d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:23.120951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 483/1002] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:23.141078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f293-b0fd-459f-930c-d004287a1255 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:23.190928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144979d-bdae-40a2-b49c-3da17200521d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:23.226056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b64f4-3214-4661-9a4c-438865e577f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:23.226941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b64f4-3214-4661-9a4c-438865e577f4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:23.227224 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b64f4-3214-4661-9a4c-438865e577f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:23.227503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b64f4-3214-4661-9a4c-438865e577f4 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:23.228212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b64f4-3214-4661-9a4c-438865e577f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:23.229926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b64f4-3214-4661-9a4c-438865e577f4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:23.236261 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 520/1003] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 6 01:21:23 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:23.248808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f293-b0fd-459f-930c-d004287a1255 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:23.289563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a64b1-f1c9-49d0-b707-ff9aa4a915da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:23.290229 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a64b1-f1c9-49d0-b707-ff9aa4a915da None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:23.290739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a64b1-f1c9-49d0-b707-ff9aa4a915da None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:23.291131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a64b1-f1c9-49d0-b707-ff9aa4a915da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:23.291925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a64b1-f1c9-49d0-b707-ff9aa4a915da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:23.293404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a64b1-f1c9-49d0-b707-ff9aa4a915da None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2c4a64b1-f1c9-49d0-b707-ff9aa4a915da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:23.303481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:23.304580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:23.309926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 484/1004] 10.222.0.15 () {56 vars in 1126 bytes} [Sat Aug 6 01:21:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:23.313883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b64f4-3214-4661-9a4c-438865e577f4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:23.328177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:23.432329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b64f4-3214-4661-9a4c-438865e577f4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:23.468099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d32e9-7208-4a01-bc75-64d7455e4b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:23.468722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d32e9-7208-4a01-bc75-64d7455e4b10 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:23.469032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d32e9-7208-4a01-bc75-64d7455e4b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:23.469310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d32e9-7208-4a01-bc75-64d7455e4b10 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:23.469989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d32e9-7208-4a01-bc75-64d7455e4b10 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:23.470295 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d32e9-7208-4a01-bc75-64d7455e4b10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:23.471646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d32e9-7208-4a01-bc75-64d7455e4b10 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:23.476736 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 521/1005] 10.222.0.15 () {56 vars in 1122 bytes} [Sat Aug 6 01:21:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:23.483091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a64b1-f1c9-49d0-b707-ff9aa4a915da None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:23.499777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:23.588626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a64b1-f1c9-49d0-b707-ff9aa4a915da None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:23.622182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce4bef-06be-452a-8440-600b7f944b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:23.622803 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce4bef-06be-452a-8440-600b7f944b07 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:23.623086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce4bef-06be-452a-8440-600b7f944b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:23.623358 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce4bef-06be-452a-8440-600b7f944b07 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:23.624033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce4bef-06be-452a-8440-600b7f944b07 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:23.624336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce4bef-06be-452a-8440-600b7f944b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:23.625712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce4bef-06be-452a-8440-600b7f944b07 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:23.636122 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 485/1006] 10.222.0.15 () {56 vars in 1122 bytes} [Sat Aug 6 01:21:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:23.637558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d32e9-7208-4a01-bc75-64d7455e4b10 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:23.713116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:23.739568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d32e9-7208-4a01-bc75-64d7455e4b10 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:23.767532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1fc26-6a9b-4dbe-82fb-0a5a2fe34058 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:23.767824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1fc26-6a9b-4dbe-82fb-0a5a2fe34058 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:23.768106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1fc26-6a9b-4dbe-82fb-0a5a2fe34058 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:23.769506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 486/1007] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:21:23.774464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a1d40-24fc-4b51-8ef8-9e4d116913ed None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:23.774754 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a1d40-24fc-4b51-8ef8-9e4d116913ed None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:23.775616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a1d40-24fc-4b51-8ef8-9e4d116913ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:23.779378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bd4c4-83f3-4027-87de-56755c2e6475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:23.780242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd4c4-83f3-4027-87de-56755c2e6475 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:23.780698 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd4c4-83f3-4027-87de-56755c2e6475 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:23.781169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd4c4-83f3-4027-87de-56755c2e6475 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:23.782060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bd4c4-83f3-4027-87de-56755c2e6475 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:23.783582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bd4c4-83f3-4027-87de-56755c2e6475 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:23.794402 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ca0a1d40-24fc-4b51-8ef8-9e4d116913ed None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:23.795590 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ca0a1d40-24fc-4b51-8ef8-9e4d116913ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:23.801477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 522/1008] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:23.876823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 487/1009] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:23.901100 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bd4c4-83f3-4027-87de-56755c2e6475 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:24.009236 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bd4c4-83f3-4027-87de-56755c2e6475 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:24.044125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8fd04-605e-41d3-9022-e13cd9a9a834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:24.044746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8fd04-605e-41d3-9022-e13cd9a9a834 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:24.045055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8fd04-605e-41d3-9022-e13cd9a9a834 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:24.045329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8fd04-605e-41d3-9022-e13cd9a9a834 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:24.046029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8fd04-605e-41d3-9022-e13cd9a9a834 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:24.047377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8fd04-605e-41d3-9022-e13cd9a9a834 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:24.050695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:24.072944 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 523/1010] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:21:23 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:25.300479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e591b-8a41-47af-9a30-6119f3059e29 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:25.301185 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e591b-8a41-47af-9a30-6119f3059e29 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:25.301185 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e591b-8a41-47af-9a30-6119f3059e29 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:25.302604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 488/1011] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:25.307729 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf967974-49d5-4ae9-b247-1854b5fd215e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:25.308155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf967974-49d5-4ae9-b247-1854b5fd215e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:25.308267 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf967974-49d5-4ae9-b247-1854b5fd215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:25.327273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-bf967974-49d5-4ae9-b247-1854b5fd215e None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:25.328444 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bf967974-49d5-4ae9-b247-1854b5fd215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:25.410053 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 524/1012] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:25 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:25.432514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e591b-8a41-47af-9a30-6119f3059e29 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:25.436321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:25.538748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e591b-8a41-47af-9a30-6119f3059e29 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:25.574089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71a5f-7cfc-40c0-a31c-f445a8a434d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:25.574650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71a5f-7cfc-40c0-a31c-f445a8a434d2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:25.574927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71a5f-7cfc-40c0-a31c-f445a8a434d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:25.575198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71a5f-7cfc-40c0-a31c-f445a8a434d2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:25.575825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b71a5f-7cfc-40c0-a31c-f445a8a434d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:25.577195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b71a5f-7cfc-40c0-a31c-f445a8a434d2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-67b71a5f-7cfc-40c0-a31c-f445a8a434d2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:25.586028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:25.587221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:25.589136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 489/1013] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:25.593758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf967974-49d5-4ae9-b247-1854b5fd215e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:25.694835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf967974-49d5-4ae9-b247-1854b5fd215e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:25.715675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:25.732701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131de7ef-fc17-48e1-a8aa-ac5afbe9d225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:25.733359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131de7ef-fc17-48e1-a8aa-ac5afbe9d225 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:25.733637 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131de7ef-fc17-48e1-a8aa-ac5afbe9d225 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:25.733907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131de7ef-fc17-48e1-a8aa-ac5afbe9d225 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:25.734575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131de7ef-fc17-48e1-a8aa-ac5afbe9d225 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:25.734877 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131de7ef-fc17-48e1-a8aa-ac5afbe9d225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:25.736226 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131de7ef-fc17-48e1-a8aa-ac5afbe9d225 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:25.745614 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 525/1014] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:21:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:25.746835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71a5f-7cfc-40c0-a31c-f445a8a434d2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:25.815739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:25.847885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c1d79-6590-41f9-8adc-5b9ab6343bc5 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:25.848187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c1d79-6590-41f9-8adc-5b9ab6343bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:25.848465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c1d79-6590-41f9-8adc-5b9ab6343bc5 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:25.849850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 526/1015] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:25.852128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71a5f-7cfc-40c0-a31c-f445a8a434d2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:25.855525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520351f9-a601-4977-bfca-5f4bd96ae4cf None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:25.855817 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520351f9-a601-4977-bfca-5f4bd96ae4cf None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:25.856096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520351f9-a601-4977-bfca-5f4bd96ae4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:25.874325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-520351f9-a601-4977-bfca-5f4bd96ae4cf None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:25.875512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-520351f9-a601-4977-bfca-5f4bd96ae4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:25.889207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b620c9-e3e9-48c1-9642-92e79ab6e9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:25.889828 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b620c9-e3e9-48c1-9642-92e79ab6e9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:25.890119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b620c9-e3e9-48c1-9642-92e79ab6e9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:25.890398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b620c9-e3e9-48c1-9642-92e79ab6e9a0 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:25.891079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b620c9-e3e9-48c1-9642-92e79ab6e9a0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:25.891393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b620c9-e3e9-48c1-9642-92e79ab6e9a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:25.892749 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b620c9-e3e9-48c1-9642-92e79ab6e9a0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:25.898983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 490/1016] 10.222.0.15 () {56 vars in 1112 bytes} [Sat Aug 6 01:21:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:25.904992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b620c9-e3e9-48c1-9642-92e79ab6e9a0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:25.949268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 527/1017] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:25 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:25.972647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520351f9-a601-4977-bfca-5f4bd96ae4cf None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:26.019446 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b620c9-e3e9-48c1-9642-92e79ab6e9a0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:26.052230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:26.059562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57671dfa-e2f7-40f0-920a-eb0214f28fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:26.060178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57671dfa-e2f7-40f0-920a-eb0214f28fcd None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.060456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57671dfa-e2f7-40f0-920a-eb0214f28fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.060735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57671dfa-e2f7-40f0-920a-eb0214f28fcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.061816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57671dfa-e2f7-40f0-920a-eb0214f28fcd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:26.063487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57671dfa-e2f7-40f0-920a-eb0214f28fcd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:26.096931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 491/1018] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:26.097171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520351f9-a601-4977-bfca-5f4bd96ae4cf None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:26.097281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583a4c5-a8d8-4b09-8663-cb0852e1fe6e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.097281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583a4c5-a8d8-4b09-8663-cb0852e1fe6e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.097281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583a4c5-a8d8-4b09-8663-cb0852e1fe6e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.097281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 492/1019] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:26.097281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070347e-8f02-4c54-ade9-75c2c7cc4084 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.097281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070347e-8f02-4c54-ade9-75c2c7cc4084 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.097677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070347e-8f02-4c54-ade9-75c2c7cc4084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.113406 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:26.114779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9070347e-8f02-4c54-ade9-75c2c7cc4084 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:26.115998 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9070347e-8f02-4c54-ade9-75c2c7cc4084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:26.144651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504d62a-ce41-4044-872f-8b16ef9ad4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:26.145433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504d62a-ce41-4044-872f-8b16ef9ad4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.145831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504d62a-ce41-4044-872f-8b16ef9ad4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.146178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504d62a-ce41-4044-872f-8b16ef9ad4d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.147712 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504d62a-ce41-4044-872f-8b16ef9ad4d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:26.149050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504d62a-ce41-4044-872f-8b16ef9ad4d4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:26.155691 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 528/1020] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:26.157037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504d62a-ce41-4044-872f-8b16ef9ad4d4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:26.195303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 493/1021] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:26.218705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070347e-8f02-4c54-ade9-75c2c7cc4084 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:26.279943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504d62a-ce41-4044-872f-8b16ef9ad4d4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:26.323941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0440e-b27b-46be-9c57-012b149d5127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:26.324577 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0440e-b27b-46be-9c57-012b149d5127 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.324823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0440e-b27b-46be-9c57-012b149d5127 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.325122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0440e-b27b-46be-9c57-012b149d5127 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.326720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0440e-b27b-46be-9c57-012b149d5127 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:26.327212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0440e-b27b-46be-9c57-012b149d5127 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:26.332846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070347e-8f02-4c54-ade9-75c2c7cc4084 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:26.356389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:26.360673 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 529/1022] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:21:26 2022] POST /identity/v3/projects => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:26.382423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec708c62-9ed3-45ec-9d9d-687183a70e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:26.383108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec708c62-9ed3-45ec-9d9d-687183a70e8d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.383393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec708c62-9ed3-45ec-9d9d-687183a70e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.383672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec708c62-9ed3-45ec-9d9d-687183a70e8d None admin] PATH_INFO: `/v3/services/image` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.384983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec708c62-9ed3-45ec-9d9d-687183a70e8d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:26.386582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec708c62-9ed3-45ec-9d9d-687183a70e8d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ec708c62-9ed3-45ec-9d9d-687183a70e8d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:26.396949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:26.398064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:26.401668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 494/1023] 10.222.0.15 () {56 vars in 1105 bytes} [Sat Aug 6 01:21:26 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:26.405724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0440e-b27b-46be-9c57-012b149d5127 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:26.442451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:26.525767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0440e-b27b-46be-9c57-012b149d5127 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:26.561877 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9095f4-6548-47a3-898a-fdc0e0fcd54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:26.562538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9095f4-6548-47a3-898a-fdc0e0fcd54a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.562825 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9095f4-6548-47a3-898a-fdc0e0fcd54a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.563101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9095f4-6548-47a3-898a-fdc0e0fcd54a None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.563799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9095f4-6548-47a3-898a-fdc0e0fcd54a None admin] RBAC: Adding query filter params (name=image) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:26.564106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9095f4-6548-47a3-898a-fdc0e0fcd54a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:26.565511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9095f4-6548-47a3-898a-fdc0e0fcd54a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:26.570686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 530/1024] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:26.577858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec708c62-9ed3-45ec-9d9d-687183a70e8d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:26.685621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec708c62-9ed3-45ec-9d9d-687183a70e8d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:26.721183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf0eec-1032-4caf-9c73-ee0032b8e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:26.721805 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf0eec-1032-4caf-9c73-ee0032b8e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.722092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf0eec-1032-4caf-9c73-ee0032b8e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.722369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf0eec-1032-4caf-9c73-ee0032b8e8c6 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.723055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf0eec-1032-4caf-9c73-ee0032b8e8c6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:26.723364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf0eec-1032-4caf-9c73-ee0032b8e8c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:26.724739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf0eec-1032-4caf-9c73-ee0032b8e8c6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:26.735362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 495/1025] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:26.736984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9095f4-6548-47a3-898a-fdc0e0fcd54a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:26.835399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:26.843394 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9095f4-6548-47a3-898a-fdc0e0fcd54a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:26.878125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93b6f3-53f1-4a61-85c7-1349f529055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:26.878744 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93b6f3-53f1-4a61-85c7-1349f529055a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.879031 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93b6f3-53f1-4a61-85c7-1349f529055a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.879308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93b6f3-53f1-4a61-85c7-1349f529055a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.880059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93b6f3-53f1-4a61-85c7-1349f529055a None admin] RBAC: Adding query filter params (interface=public, service_id=0ebb58cf42a146869dbc98ef7e8a0ce7, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:26.880373 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93b6f3-53f1-4a61-85c7-1349f529055a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:26.881765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93b6f3-53f1-4a61-85c7-1349f529055a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:26.893994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 531/1026] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 6 01:21:26 2022] GET /identity/v3/endpoints?service_id=0ebb58cf42a146869dbc98ef7e8a0ce7&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:26.895593 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf0eec-1032-4caf-9c73-ee0032b8e8c6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:26.945216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:27.001621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf0eec-1032-4caf-9c73-ee0032b8e8c6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:27.034493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813734c-0b74-4202-977d-d1e70072bef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:27.035106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813734c-0b74-4202-977d-d1e70072bef5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:27.035385 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813734c-0b74-4202-977d-d1e70072bef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:27.035655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813734c-0b74-4202-977d-d1e70072bef5 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:27.036299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813734c-0b74-4202-977d-d1e70072bef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:27.037701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813734c-0b74-4202-977d-d1e70072bef5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:27.045105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 496/1027] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 6 01:21:26 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:28.221640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4124c-1177-44cd-84e7-aa6857861318 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.222167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4124c-1177-44cd-84e7-aa6857861318 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.222167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4124c-1177-44cd-84e7-aa6857861318 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.223822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 532/1028] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:28.229566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93a4c0-3868-45cc-a381-cdd8266fe5dd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.230318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93a4c0-3868-45cc-a381-cdd8266fe5dd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.230598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93a4c0-3868-45cc-a381-cdd8266fe5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.248821 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7b93a4c0-3868-45cc-a381-cdd8266fe5dd None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:28.250012 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7b93a4c0-3868-45cc-a381-cdd8266fe5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:28.318523 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 497/1029] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:28.340536 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4124c-1177-44cd-84e7-aa6857861318 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.448894 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb375cf5-5bb3-4ef1-983a-4001ec3f2d5a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.449264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb375cf5-5bb3-4ef1-983a-4001ec3f2d5a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.449478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb375cf5-5bb3-4ef1-983a-4001ec3f2d5a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.450962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 498/1030] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:21:28.451268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4124c-1177-44cd-84e7-aa6857861318 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.455666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb4e22-ec76-46c5-a7f5-8f48c287d972 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.455956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb4e22-ec76-46c5-a7f5-8f48c287d972 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.456236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb4e22-ec76-46c5-a7f5-8f48c287d972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.474694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f8bb4e22-ec76-46c5-a7f5-8f48c287d972 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:28.475804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f8bb4e22-ec76-46c5-a7f5-8f48c287d972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:28.486698 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c75993-5d5f-4d41-8942-f4c03ffcbaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.487335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c75993-5d5f-4d41-8942-f4c03ffcbaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.487612 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c75993-5d5f-4d41-8942-f4c03ffcbaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.487884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c75993-5d5f-4d41-8942-f4c03ffcbaf5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.498929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c75993-5d5f-4d41-8942-f4c03ffcbaf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b5c75993-5d5f-4d41-8942-f4c03ffcbaf5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:28.503799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:28.504760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:28.505670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 533/1031] 10.222.0.15 () {56 vars in 1120 bytes} [Sat Aug 6 01:21:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:28.511385 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c75993-5d5f-4d41-8942-f4c03ffcbaf5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.515082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:28.532948 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:28.551838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 499/1032] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:28.576775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb4e22-ec76-46c5-a7f5-8f48c287d972 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.622246 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c75993-5d5f-4d41-8942-f4c03ffcbaf5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.657995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ee2e-6e88-46c6-b988-56715ad63a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.658604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ee2e-6e88-46c6-b988-56715ad63a3e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.658883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ee2e-6e88-46c6-b988-56715ad63a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.659191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ee2e-6e88-46c6-b988-56715ad63a3e None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.659907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ee2e-6e88-46c6-b988-56715ad63a3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:28.660214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ee2e-6e88-46c6-b988-56715ad63a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.661598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ee2e-6e88-46c6-b988-56715ad63a3e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.673055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 534/1033] 10.222.0.15 () {56 vars in 1115 bytes} [Sat Aug 6 01:21:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:28.677204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ee2e-6e88-46c6-b988-56715ad63a3e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.685676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb4e22-ec76-46c5-a7f5-8f48c287d972 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.730956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebd21f-217d-47b0-9ad2-0478fbdd8abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.731519 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebd21f-217d-47b0-9ad2-0478fbdd8abb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.731801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebd21f-217d-47b0-9ad2-0478fbdd8abb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.732078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebd21f-217d-47b0-9ad2-0478fbdd8abb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.733732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebd21f-217d-47b0-9ad2-0478fbdd8abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.735179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebd21f-217d-47b0-9ad2-0478fbdd8abb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.737008 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 500/1034] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:28.742659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebd21f-217d-47b0-9ad2-0478fbdd8abb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.762798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:28.784297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ee2e-6e88-46c6-b988-56715ad63a3e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.787470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:28.820781 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf412ab-c8b5-4c8f-a34d-a9dcf5df76f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.822297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf412ab-c8b5-4c8f-a34d-a9dcf5df76f9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.822588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf412ab-c8b5-4c8f-a34d-a9dcf5df76f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.822866 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf412ab-c8b5-4c8f-a34d-a9dcf5df76f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.833706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf412ab-c8b5-4c8f-a34d-a9dcf5df76f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.835165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf412ab-c8b5-4c8f-a34d-a9dcf5df76f9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3cf412ab-c8b5-4c8f-a34d-a9dcf5df76f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:28.849694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:28.850608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:28.851521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:28.851521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:28.851521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:28.851521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:28.851521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 535/1035] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:28.857102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf412ab-c8b5-4c8f-a34d-a9dcf5df76f9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.859884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebd21f-217d-47b0-9ad2-0478fbdd8abb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.897041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db641d-f1e2-436c-8ffa-18c8344bd86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.897671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db641d-f1e2-436c-8ffa-18c8344bd86d None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.897954 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db641d-f1e2-436c-8ffa-18c8344bd86d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.898235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db641d-f1e2-436c-8ffa-18c8344bd86d None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.898922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db641d-f1e2-436c-8ffa-18c8344bd86d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.900591 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db641d-f1e2-436c-8ffa-18c8344bd86d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.925717 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 501/1036] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:28.973188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf412ab-c8b5-4c8f-a34d-a9dcf5df76f9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.006716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:29.013799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274db5c-3d91-4792-8da9-11daaf718494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.014441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274db5c-3d91-4792-8da9-11daaf718494 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.014720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274db5c-3d91-4792-8da9-11daaf718494 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.014988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274db5c-3d91-4792-8da9-11daaf718494 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.015694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274db5c-3d91-4792-8da9-11daaf718494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:29.015998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274db5c-3d91-4792-8da9-11daaf718494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.017433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274db5c-3d91-4792-8da9-11daaf718494 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.035332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 536/1037] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:29.037738 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db641d-f1e2-436c-8ffa-18c8344bd86d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.058875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63971013-56ef-4f4d-a3a5-b06fa54545c9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.059213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63971013-56ef-4f4d-a3a5-b06fa54545c9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.059434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63971013-56ef-4f4d-a3a5-b06fa54545c9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.060801 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 537/1038] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:21:29.066321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6254d-f757-4582-9c18-2c16c2f142c7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.066611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6254d-f757-4582-9c18-2c16c2f142c7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.066868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6254d-f757-4582-9c18-2c16c2f142c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.087277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3ba6254d-f757-4582-9c18-2c16c2f142c7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:29.089235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3ba6254d-f757-4582-9c18-2c16c2f142c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:29.158912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:29.163664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db641d-f1e2-436c-8ffa-18c8344bd86d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.172457 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 538/1039] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:29.194928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6254d-f757-4582-9c18-2c16c2f142c7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.202418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4f57e-feff-4ca6-b465-e6055398f628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.203073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4f57e-feff-4ca6-b465-e6055398f628 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.203355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4f57e-feff-4ca6-b465-e6055398f628 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.203910 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4f57e-feff-4ca6-b465-e6055398f628 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.211745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4f57e-feff-4ca6-b465-e6055398f628 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.213460 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4f57e-feff-4ca6-b465-e6055398f628 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-acd4f57e-feff-4ca6-b465-e6055398f628 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:21:29.225167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:29.226327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:29.227489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:29.227489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:29.227489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:21:29.227489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:21:29.227489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:21:29.227489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:21:29.227489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:21:29.227489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:21:29.227489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:21:29.227489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:29.227489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 502/1040] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:29.232264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4f57e-feff-4ca6-b465-e6055398f628 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.307758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6254d-f757-4582-9c18-2c16c2f142c7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.332000 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:29.345170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81573b-03d7-4134-a3e8-ca8c0430bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.345819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81573b-03d7-4134-a3e8-ca8c0430bd64 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.346102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81573b-03d7-4134-a3e8-ca8c0430bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.346376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81573b-03d7-4134-a3e8-ca8c0430bd64 None admin] PATH_INFO: `/v3/services/image` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.346474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4f57e-feff-4ca6-b465-e6055398f628 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.347004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81573b-03d7-4134-a3e8-ca8c0430bd64 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.348368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81573b-03d7-4134-a3e8-ca8c0430bd64 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9a81573b-03d7-4134-a3e8-ca8c0430bd64 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:29.357617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:29.358849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:29.359856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 539/1041] 10.222.0.15 () {56 vars in 1105 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:29.365051 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81573b-03d7-4134-a3e8-ca8c0430bd64 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.390339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408d56c-2d2c-4b34-bd8a-86c5d754961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.391200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d56c-2d2c-4b34-bd8a-86c5d754961c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.391627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d56c-2d2c-4b34-bd8a-86c5d754961c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.392042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d56c-2d2c-4b34-bd8a-86c5d754961c None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.393132 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408d56c-2d2c-4b34-bd8a-86c5d754961c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:29.393584 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408d56c-2d2c-4b34-bd8a-86c5d754961c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.395607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408d56c-2d2c-4b34-bd8a-86c5d754961c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.416477 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 503/1042] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:29.421864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408d56c-2d2c-4b34-bd8a-86c5d754961c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.437103 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:29.481454 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81573b-03d7-4134-a3e8-ca8c0430bd64 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.518372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd81e18-1400-4e5f-a22e-70de7a421bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.519174 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd81e18-1400-4e5f-a22e-70de7a421bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.519467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd81e18-1400-4e5f-a22e-70de7a421bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.519850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd81e18-1400-4e5f-a22e-70de7a421bb5 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.520525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd81e18-1400-4e5f-a22e-70de7a421bb5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:29.520833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd81e18-1400-4e5f-a22e-70de7a421bb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.522341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd81e18-1400-4e5f-a22e-70de7a421bb5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.525673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408d56c-2d2c-4b34-bd8a-86c5d754961c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.528228 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 540/1043] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:29.533750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd81e18-1400-4e5f-a22e-70de7a421bb5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.563466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000de6f-e18f-412f-a040-4b6f227b097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.564009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000de6f-e18f-412f-a040-4b6f227b097e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.564290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000de6f-e18f-412f-a040-4b6f227b097e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.564563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000de6f-e18f-412f-a040-4b6f227b097e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.599427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:29.638559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000de6f-e18f-412f-a040-4b6f227b097e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.640471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000de6f-e18f-412f-a040-4b6f227b097e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.654725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:29.656753 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd81e18-1400-4e5f-a22e-70de7a421bb5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.693584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a914d9-553a-43b8-a465-e348eee6921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.694202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a914d9-553a-43b8-a465-e348eee6921b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.694490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a914d9-553a-43b8-a465-e348eee6921b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.694764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a914d9-553a-43b8-a465-e348eee6921b None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.695442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a914d9-553a-43b8-a465-e348eee6921b None admin] RBAC: Adding query filter params (type=image) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:29.695746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a914d9-553a-43b8-a465-e348eee6921b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.697807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a914d9-553a-43b8-a465-e348eee6921b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.702853 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 541/1044] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:29.708746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a914d9-553a-43b8-a465-e348eee6921b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.749766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 504/1045] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 01:21:29.755238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000de6f-e18f-412f-a040-4b6f227b097e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.824388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a914d9-553a-43b8-a465-e348eee6921b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.839057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:29.862086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f32118-1b58-49a4-a02f-4fdb4ba72c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.862429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000de6f-e18f-412f-a040-4b6f227b097e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.862709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f32118-1b58-49a4-a02f-4fdb4ba72c59 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.862994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f32118-1b58-49a4-a02f-4fdb4ba72c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.863268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f32118-1b58-49a4-a02f-4fdb4ba72c59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.864096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f32118-1b58-49a4-a02f-4fdb4ba72c59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.865609 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f32118-1b58-49a4-a02f-4fdb4ba72c59 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.876159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:29.889941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 542/1046] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:29.917664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cce038-e3c6-4d23-8c87-fc19c99d0a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.918337 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce038-e3c6-4d23-8c87-fc19c99d0a0c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.918797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce038-e3c6-4d23-8c87-fc19c99d0a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.919188 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce038-e3c6-4d23-8c87-fc19c99d0a0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.931694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cce038-e3c6-4d23-8c87-fc19c99d0a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.933378 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cce038-e3c6-4d23-8c87-fc19c99d0a0c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-50cce038-e3c6-4d23-8c87-fc19c99d0a0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:29.950775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:29.951779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:29.958126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:29.958126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:29.958126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:29.958126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:29.958126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 505/1047] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:29.959634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f32118-1b58-49a4-a02f-4fdb4ba72c59 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:30.070200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f32118-1b58-49a4-a02f-4fdb4ba72c59 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:30.105763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dec397-16af-4c9a-a888-7f4fac209bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:30.106412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dec397-16af-4c9a-a888-7f4fac209bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:30.106699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dec397-16af-4c9a-a888-7f4fac209bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:30.106976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dec397-16af-4c9a-a888-7f4fac209bd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:30.107731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dec397-16af-4c9a-a888-7f4fac209bd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:30.108046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dec397-16af-4c9a-a888-7f4fac209bd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:30.109533 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dec397-16af-4c9a-a888-7f4fac209bd3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:30.123536 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 543/1048] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:30.129494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cce038-e3c6-4d23-8c87-fc19c99d0a0c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:30.233613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cce038-e3c6-4d23-8c87-fc19c99d0a0c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:30.268165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be535c1-6d92-45fd-b798-b13b1bc1dd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:30.268819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be535c1-6d92-45fd-b798-b13b1bc1dd3a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:30.269259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be535c1-6d92-45fd-b798-b13b1bc1dd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:30.269417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be535c1-6d92-45fd-b798-b13b1bc1dd3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:30.276438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be535c1-6d92-45fd-b798-b13b1bc1dd3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:30.277906 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be535c1-6d92-45fd-b798-b13b1bc1dd3a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7be535c1-6d92-45fd-b798-b13b1bc1dd3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:21:30.289187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:30.290066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:30.297175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:21:30.297175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:21:30.297175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:21:30.297175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:21:30.297175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:21:30.297175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:21:30.297175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:30.297175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:30.297175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 506/1049] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:30.299142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dec397-16af-4c9a-a888-7f4fac209bd3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:30.330657 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:30.416466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dec397-16af-4c9a-a888-7f4fac209bd3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:30.450861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21337a-6cfa-43dc-b38a-166406723995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:30.451483 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21337a-6cfa-43dc-b38a-166406723995 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:30.451786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21337a-6cfa-43dc-b38a-166406723995 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:30.452064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21337a-6cfa-43dc-b38a-166406723995 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:30.452849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21337a-6cfa-43dc-b38a-166406723995 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:30.453171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21337a-6cfa-43dc-b38a-166406723995 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:30.454596 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21337a-6cfa-43dc-b38a-166406723995 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:30.471000 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 544/1050] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:21:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:30.472820 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be535c1-6d92-45fd-b798-b13b1bc1dd3a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:30.498862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:30.581098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be535c1-6d92-45fd-b798-b13b1bc1dd3a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:30.615464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac0042-3514-4ebc-beff-6abf8768c253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:30.616090 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac0042-3514-4ebc-beff-6abf8768c253 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:30.616375 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac0042-3514-4ebc-beff-6abf8768c253 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:30.616653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac0042-3514-4ebc-beff-6abf8768c253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:30.618005 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac0042-3514-4ebc-beff-6abf8768c253 None admin] RBAC: Adding query filter params (role.id=6adb3bcaecba49c7be505774fe3f5940, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=666f4864832445d5a10d60f677f5cd6c) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:30.618005 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac0042-3514-4ebc-beff-6abf8768c253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:30.620536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac0042-3514-4ebc-beff-6abf8768c253 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:30.626644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 507/1051] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:21:30 2022] GET /identity/v3/role_assignments?user.id=666f4864832445d5a10d60f677f5cd6c&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=6adb3bcaecba49c7be505774fe3f5940 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:30.999603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd8cc9-dd9a-4676-97ee-c163730444c9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:30.999845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd8cc9-dd9a-4676-97ee-c163730444c9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:31.000233 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd8cc9-dd9a-4676-97ee-c163730444c9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:31.001743 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 545/1052] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:31.007025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a661737-ef7a-45ab-a945-0b802abe8b6f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:31.007386 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a661737-ef7a-45ab-a945-0b802abe8b6f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:31.007730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a661737-ef7a-45ab-a945-0b802abe8b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:31.028122 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3a661737-ef7a-45ab-a945-0b802abe8b6f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:31.029331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3a661737-ef7a-45ab-a945-0b802abe8b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:31.104949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 508/1053] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:31.126531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd8cc9-dd9a-4676-97ee-c163730444c9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:31.217817 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:31.230062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd8cc9-dd9a-4676-97ee-c163730444c9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:31.264029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d35f50-e760-4db4-b5c8-f438182c3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:31.264581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d35f50-e760-4db4-b5c8-f438182c3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:31.264864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d35f50-e760-4db4-b5c8-f438182c3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:31.265201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d35f50-e760-4db4-b5c8-f438182c3ee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:31.275311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d35f50-e760-4db4-b5c8-f438182c3ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a9d35f50-e760-4db4-b5c8-f438182c3ee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:31.280182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:31.281361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:31.289678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 546/1054] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:21:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:31.291090 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a661737-ef7a-45ab-a945-0b802abe8b6f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:31.311196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:31.410214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a661737-ef7a-45ab-a945-0b802abe8b6f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:31.444808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8fa79-2d53-4a2f-b0d1-8f56d68c7023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:31.445455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8fa79-2d53-4a2f-b0d1-8f56d68c7023 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:31.445741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8fa79-2d53-4a2f-b0d1-8f56d68c7023 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:31.446040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8fa79-2d53-4a2f-b0d1-8f56d68c7023 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:31.446801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8fa79-2d53-4a2f-b0d1-8f56d68c7023 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:31.447107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8fa79-2d53-4a2f-b0d1-8f56d68c7023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:31.448466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8fa79-2d53-4a2f-b0d1-8f56d68c7023 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:31.461463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 509/1055] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:31.463330 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d35f50-e760-4db4-b5c8-f438182c3ee5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:31.565121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d35f50-e760-4db4-b5c8-f438182c3ee5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:31.598978 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35c7bb-1f4e-42f4-bfa7-06a720dab76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:31.599623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35c7bb-1f4e-42f4-bfa7-06a720dab76f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:31.599903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35c7bb-1f4e-42f4-bfa7-06a720dab76f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:31.600174 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35c7bb-1f4e-42f4-bfa7-06a720dab76f None admin] PATH_INFO: `/v3/users/85c9037a2d6a4abb966dba3640beefcd` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:31.613633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35c7bb-1f4e-42f4-bfa7-06a720dab76f None admin] RBAC: Authorizing `identity:get_user(user_id=85c9037a2d6a4abb966dba3640beefcd)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:31.615135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35c7bb-1f4e-42f4-bfa7-06a720dab76f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:31.620966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 547/1056] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:21:31 2022] GET /identity/v3/users/85c9037a2d6a4abb966dba3640beefcd => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:31.623369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8fa79-2d53-4a2f-b0d1-8f56d68c7023 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:31.706703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:31.731758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8fa79-2d53-4a2f-b0d1-8f56d68c7023 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:31.775340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3d895-9be5-44e7-a31c-0586ece8c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:31.776273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3d895-9be5-44e7-a31c-0586ece8c36d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:31.776860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3d895-9be5-44e7-a31c-0586ece8c36d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:31.777337 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3d895-9be5-44e7-a31c-0586ece8c36d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:31.870798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3d895-9be5-44e7-a31c-0586ece8c36d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:31.872387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3d895-9be5-44e7-a31c-0586ece8c36d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:31.967808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335d90a-5fb7-4b37-8cb8-f717b2358f28 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:31.968089 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335d90a-5fb7-4b37-8cb8-f717b2358f28 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:31.968405 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335d90a-5fb7-4b37-8cb8-f717b2358f28 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:31.969134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:31.970074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 548/1057] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:21:31.975521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4b82-f835-4b3c-89d2-9a42daf68d55 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:31.975849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4b82-f835-4b3c-89d2-9a42daf68d55 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:31.976129 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4b82-f835-4b3c-89d2-9a42daf68d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:31.994811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-587b4b82-f835-4b3c-89d2-9a42daf68d55 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:31.996017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-587b4b82-f835-4b3c-89d2-9a42daf68d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:31.998178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:32.002683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 510/1058] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 01:21:32.010856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3d895-9be5-44e7-a31c-0586ece8c36d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:32.089923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 549/1059] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:32.116508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b4b82-f835-4b3c-89d2-9a42daf68d55 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:32.131014 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3d895-9be5-44e7-a31c-0586ece8c36d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:32.177881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b7af8-56cf-4f02-9ef1-9345e8e2d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:32.178873 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b7af8-56cf-4f02-9ef1-9345e8e2d1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:32.179355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b7af8-56cf-4f02-9ef1-9345e8e2d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:32.179640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b7af8-56cf-4f02-9ef1-9345e8e2d1a8 None admin] PATH_INFO: `/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:32.180819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b7af8-56cf-4f02-9ef1-9345e8e2d1a8 None admin] RBAC: Authorizing `identity:get_project(project_id=d9fc4c5ca9b347a18f48c6c1679e1000)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:32.182268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b7af8-56cf-4f02-9ef1-9345e8e2d1a8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:32.183941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 511/1060] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:21:32 2022] GET /identity/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:32.189864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b7af8-56cf-4f02-9ef1-9345e8e2d1a8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:32.243641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b4b82-f835-4b3c-89d2-9a42daf68d55 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:32.250017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:32.288636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c97ba-c98f-4be6-867c-273957662042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:32.289293 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c97ba-c98f-4be6-867c-273957662042 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:32.289580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c97ba-c98f-4be6-867c-273957662042 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:32.289856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c97ba-c98f-4be6-867c-273957662042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:32.299921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:32.323981 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b7af8-56cf-4f02-9ef1-9345e8e2d1a8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:32.375757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6268b-9058-40fb-aa34-08cb09188a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:32.375757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6268b-9058-40fb-aa34-08cb09188a7e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:32.375757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6268b-9058-40fb-aa34-08cb09188a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:32.375757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6268b-9058-40fb-aa34-08cb09188a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:32.376892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6268b-9058-40fb-aa34-08cb09188a7e None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=d9fc4c5ca9b347a18f48c6c1679e1000, user.id=85c9037a2d6a4abb966dba3640beefcd) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:32.376892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6268b-9058-40fb-aa34-08cb09188a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:32.376892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6268b-9058-40fb-aa34-08cb09188a7e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:32.389390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 512/1061] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:21:32 2022] GET /identity/v3/role_assignments?user.id=85c9037a2d6a4abb966dba3640beefcd&scope.project.id=d9fc4c5ca9b347a18f48c6c1679e1000&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:32.389682 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c97ba-c98f-4be6-867c-273957662042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:32.391773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c97ba-c98f-4be6-867c-273957662042 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:32.524958 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 550/1062] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 01:21:32.534469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6268b-9058-40fb-aa34-08cb09188a7e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:32.643178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6268b-9058-40fb-aa34-08cb09188a7e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:32.652688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:32.679301 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7470a-0f6a-43d7-96e2-ef09055bb93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:32.679953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7470a-0f6a-43d7-96e2-ef09055bb93b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:32.680237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7470a-0f6a-43d7-96e2-ef09055bb93b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:32.680513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7470a-0f6a-43d7-96e2-ef09055bb93b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:32.685080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39154d0-5329-48ba-9d45-708dacedb9a5 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:32.685377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39154d0-5329-48ba-9d45-708dacedb9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:32.685659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39154d0-5329-48ba-9d45-708dacedb9a5 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:32.687131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 551/1063] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:32.692034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f097d-22c1-4d53-b75c-4358f35eea51 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:32.692327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f097d-22c1-4d53-b75c-4358f35eea51 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:32.692428 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7470a-0f6a-43d7-96e2-ef09055bb93b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:32.692770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f097d-22c1-4d53-b75c-4358f35eea51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:32.693825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7470a-0f6a-43d7-96e2-ef09055bb93b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7ae7470a-0f6a-43d7-96e2-ef09055bb93b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:32.708970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:32.709919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:32.710841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:32.710841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:32.710841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:32.710841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:32.710841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 513/1064] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:32.713019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-046f097d-22c1-4d53-b75c-4358f35eea51 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:32.714303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-046f097d-22c1-4d53-b75c-4358f35eea51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:32.715990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7470a-0f6a-43d7-96e2-ef09055bb93b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:32.750344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:32.796962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 552/1065] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:32.817691 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f097d-22c1-4d53-b75c-4358f35eea51 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:32.823581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7470a-0f6a-43d7-96e2-ef09055bb93b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:32.861864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11d1be-2646-40ef-8aa5-43c4ef15718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:32.862858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11d1be-2646-40ef-8aa5-43c4ef15718d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:32.863147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11d1be-2646-40ef-8aa5-43c4ef15718d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:32.863426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11d1be-2646-40ef-8aa5-43c4ef15718d None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:32.864449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11d1be-2646-40ef-8aa5-43c4ef15718d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:32.864761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11d1be-2646-40ef-8aa5-43c4ef15718d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:32.866166 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11d1be-2646-40ef-8aa5-43c4ef15718d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:32.880092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 514/1066] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:32.937757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f097d-22c1-4d53-b75c-4358f35eea51 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:32.976024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d00b0-653d-4bc2-8600-e36c994e9763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:32.977019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d00b0-653d-4bc2-8600-e36c994e9763 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:32.977511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d00b0-653d-4bc2-8600-e36c994e9763 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:32.978135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d00b0-653d-4bc2-8600-e36c994e9763 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:32.989492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d00b0-653d-4bc2-8600-e36c994e9763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0a8d00b0-653d-4bc2-8600-e36c994e9763 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:32.995342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:32.996362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:32.997300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:32.997300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:32.997300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:32.997300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:32.997300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:32.997300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:32.997300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:32.997300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:32.997300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:32.997300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:32.997300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:21:32.997300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:33.002668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 553/1067] 10.222.0.15 () {56 vars in 1120 bytes} [Sat Aug 6 01:21:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:33.004016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11d1be-2646-40ef-8aa5-43c4ef15718d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.029991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:33.118761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11d1be-2646-40ef-8aa5-43c4ef15718d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.157153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85f90-f458-441e-a821-3d3447fee916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.158151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85f90-f458-441e-a821-3d3447fee916 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.158430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85f90-f458-441e-a821-3d3447fee916 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.158704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85f90-f458-441e-a821-3d3447fee916 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.159417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de85f90-f458-441e-a821-3d3447fee916 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:33.159721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de85f90-f458-441e-a821-3d3447fee916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.161090 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de85f90-f458-441e-a821-3d3447fee916 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.169826 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 515/1068] 10.222.0.15 () {56 vars in 1115 bytes} [Sat Aug 6 01:21:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:33.175702 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d00b0-653d-4bc2-8600-e36c994e9763 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.205572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:33.275053 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d00b0-653d-4bc2-8600-e36c994e9763 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.309460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188f203-25dd-41a2-9a4e-4c5995b3982d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.310096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188f203-25dd-41a2-9a4e-4c5995b3982d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.310378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188f203-25dd-41a2-9a4e-4c5995b3982d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.310655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188f203-25dd-41a2-9a4e-4c5995b3982d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.320408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188f203-25dd-41a2-9a4e-4c5995b3982d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.322545 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188f203-25dd-41a2-9a4e-4c5995b3982d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-2188f203-25dd-41a2-9a4e-4c5995b3982d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:33.336862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:33.338285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:33.339218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:33.339218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:33.339218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:33.339218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:33.339218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 554/1069] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:33.344623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85f90-f458-441e-a821-3d3447fee916 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.427875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:33.447281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85f90-f458-441e-a821-3d3447fee916 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.481106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9905ec-51cf-4dff-9311-fc92a3ad3e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.481659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9905ec-51cf-4dff-9311-fc92a3ad3e58 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.481940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9905ec-51cf-4dff-9311-fc92a3ad3e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.482213 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9905ec-51cf-4dff-9311-fc92a3ad3e58 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.482908 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9905ec-51cf-4dff-9311-fc92a3ad3e58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:33.483217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9905ec-51cf-4dff-9311-fc92a3ad3e58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.484568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9905ec-51cf-4dff-9311-fc92a3ad3e58 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.496598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 516/1070] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:33.502265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188f203-25dd-41a2-9a4e-4c5995b3982d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.586376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:33.606701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188f203-25dd-41a2-9a4e-4c5995b3982d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.640172 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a80c8c-2e9b-48c1-8d62-f2b1eb101fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.640807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a80c8c-2e9b-48c1-8d62-f2b1eb101fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.641120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a80c8c-2e9b-48c1-8d62-f2b1eb101fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.641399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a80c8c-2e9b-48c1-8d62-f2b1eb101fe6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.648675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a80c8c-2e9b-48c1-8d62-f2b1eb101fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.650496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a80c8c-2e9b-48c1-8d62-f2b1eb101fe6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-73a80c8c-2e9b-48c1-8d62-f2b1eb101fe6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:21:33.661547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:33.662656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:33.663613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:33.663613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:33.663613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:21:33.663613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:21:33.663613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:21:33.663613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:21:33.663613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:21:33.663613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:21:33.663613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:21:33.663613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:33.663613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 555/1071] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 6 01:21:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:33.668863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9905ec-51cf-4dff-9311-fc92a3ad3e58 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.766605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9905ec-51cf-4dff-9311-fc92a3ad3e58 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.799091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192135af-8df6-4c12-bf07-16a5c0560592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.799699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192135af-8df6-4c12-bf07-16a5c0560592 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.799979 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192135af-8df6-4c12-bf07-16a5c0560592 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.800251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192135af-8df6-4c12-bf07-16a5c0560592 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.801065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192135af-8df6-4c12-bf07-16a5c0560592 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:33.801371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192135af-8df6-4c12-bf07-16a5c0560592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.802773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192135af-8df6-4c12-bf07-16a5c0560592 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.816530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:33.820227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 517/1072] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 6 01:21:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:33.826458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a80c8c-2e9b-48c1-8d62-f2b1eb101fe6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.924688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a80c8c-2e9b-48c1-8d62-f2b1eb101fe6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.964694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df06de-8728-447f-b662-a4203efcec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.965364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df06de-8728-447f-b662-a4203efcec6b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.965650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df06de-8728-447f-b662-a4203efcec6b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.965929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df06de-8728-447f-b662-a4203efcec6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.974470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:33.976718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df06de-8728-447f-b662-a4203efcec6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.979404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df06de-8728-447f-b662-a4203efcec6b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-34df06de-8728-447f-b662-a4203efcec6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:33.993600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:33.994566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:33.995858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:33.995858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:33.995858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:33.995858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:33.995858 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 556/1073] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:34.000425 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192135af-8df6-4c12-bf07-16a5c0560592 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.098933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192135af-8df6-4c12-bf07-16a5c0560592 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.134333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1b5c-d734-45eb-8962-5bcef24dd142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.134919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1b5c-d734-45eb-8962-5bcef24dd142 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.135205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1b5c-d734-45eb-8962-5bcef24dd142 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.135482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1b5c-d734-45eb-8962-5bcef24dd142 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.136176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1b5c-d734-45eb-8962-5bcef24dd142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:34.136496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1b5c-d734-45eb-8962-5bcef24dd142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.138212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1b5c-d734-45eb-8962-5bcef24dd142 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.154117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 518/1074] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:34.155334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df06de-8728-447f-b662-a4203efcec6b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.253243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df06de-8728-447f-b662-a4203efcec6b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.286532 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7bcca-1960-4678-b58f-455278e17ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.287198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7bcca-1960-4678-b58f-455278e17ccc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.287450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7bcca-1960-4678-b58f-455278e17ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.287715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7bcca-1960-4678-b58f-455278e17ccc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.294921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7bcca-1960-4678-b58f-455278e17ccc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.296341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7bcca-1960-4678-b58f-455278e17ccc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a5d7bcca-1960-4678-b58f-455278e17ccc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:21:34.307947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:34.309044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:34.309996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:21:34.309996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:21:34.309996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:21:34.309996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:21:34.309996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:21:34.309996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:21:34.309996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:34.309996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:34.309996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 557/1075] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:34.314955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1b5c-d734-45eb-8962-5bcef24dd142 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.379117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:34.421336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1b5c-d734-45eb-8962-5bcef24dd142 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.431252 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210d133-e352-4bd1-a873-9efd0d42f153 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.431544 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210d133-e352-4bd1-a873-9efd0d42f153 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.431823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210d133-e352-4bd1-a873-9efd0d42f153 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.433274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 558/1076] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:21:34.438368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94f75-7ae4-45db-b9d6-7ca053e08bfe None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.438658 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94f75-7ae4-45db-b9d6-7ca053e08bfe None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.438944 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f94f75-7ae4-45db-b9d6-7ca053e08bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.454917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b6535-d57b-4eb8-b544-18b4d7ddebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.455535 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b6535-d57b-4eb8-b544-18b4d7ddebe1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.456100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b6535-d57b-4eb8-b544-18b4d7ddebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.456381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b6535-d57b-4eb8-b544-18b4d7ddebe1 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.456930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-44f94f75-7ae4-45db-b9d6-7ca053e08bfe None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:34.457164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b6535-d57b-4eb8-b544-18b4d7ddebe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:34.457475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b6535-d57b-4eb8-b544-18b4d7ddebe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.458126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-44f94f75-7ae4-45db-b9d6-7ca053e08bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:34.458889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b6535-d57b-4eb8-b544-18b4d7ddebe1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.471261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 519/1077] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:21:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:34.477294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b6535-d57b-4eb8-b544-18b4d7ddebe1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.505421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:34.526126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 559/1078] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:34.548688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f94f75-7ae4-45db-b9d6-7ca053e08bfe None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.578614 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b6535-d57b-4eb8-b544-18b4d7ddebe1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.598996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:34.623704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892f068-ad0b-4e8b-bfe4-c899456f6617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.624298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f068-ad0b-4e8b-bfe4-c899456f6617 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.624576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f068-ad0b-4e8b-bfe4-c899456f6617 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.624852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f068-ad0b-4e8b-bfe4-c899456f6617 None admin] PATH_INFO: `/v3/projects/c344ed6bac754173af05207b5f444dca/users/666f4864832445d5a10d60f677f5cd6c/roles/6adb3bcaecba49c7be505774fe3f5940` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.627077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892f068-ad0b-4e8b-bfe4-c899456f6617 None admin] RBAC: Authorizing `identity:create_grant(project_id=c344ed6bac754173af05207b5f444dca, user_id=666f4864832445d5a10d60f677f5cd6c, role_id=6adb3bcaecba49c7be505774fe3f5940)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.628502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892f068-ad0b-4e8b-bfe4-c899456f6617 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.642571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 520/1079] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:21:34 2022] PUT /identity/v3/projects/c344ed6bac754173af05207b5f444dca/users/666f4864832445d5a10d60f677f5cd6c/roles/6adb3bcaecba49c7be505774fe3f5940 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:34.650532 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f94f75-7ae4-45db-b9d6-7ca053e08bfe None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.686913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a071bef-71b4-4918-b689-8a19038ceab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.687576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071bef-71b4-4918-b689-8a19038ceab8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.687863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071bef-71b4-4918-b689-8a19038ceab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.688142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a071bef-71b4-4918-b689-8a19038ceab8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.700170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a071bef-71b4-4918-b689-8a19038ceab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3a071bef-71b4-4918-b689-8a19038ceab8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:34.705349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:34.706395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:34.707264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 560/1080] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:21:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:34.713159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892f068-ad0b-4e8b-bfe4-c899456f6617 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.819644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892f068-ad0b-4e8b-bfe4-c899456f6617 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.853746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1daa70-7051-4418-9181-401b400a2066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.854368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1daa70-7051-4418-9181-401b400a2066 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.854649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1daa70-7051-4418-9181-401b400a2066 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.854925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1daa70-7051-4418-9181-401b400a2066 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.855642 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1daa70-7051-4418-9181-401b400a2066 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:34.855952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1daa70-7051-4418-9181-401b400a2066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.857349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1daa70-7051-4418-9181-401b400a2066 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.865755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 521/1081] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:21:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:34.871757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a071bef-71b4-4918-b689-8a19038ceab8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.915933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:34.974083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a071bef-71b4-4918-b689-8a19038ceab8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:35.007353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1c889-c2b2-4c87-8174-dfb7f090150d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:35.007991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1c889-c2b2-4c87-8174-dfb7f090150d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:35.008272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1c889-c2b2-4c87-8174-dfb7f090150d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:35.008549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1c889-c2b2-4c87-8174-dfb7f090150d None admin] PATH_INFO: `/v3/users/85c9037a2d6a4abb966dba3640beefcd` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:35.010274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1c889-c2b2-4c87-8174-dfb7f090150d None admin] RBAC: Authorizing `identity:get_user(user_id=85c9037a2d6a4abb966dba3640beefcd)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:35.011703 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1c889-c2b2-4c87-8174-dfb7f090150d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:35.013596 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 561/1082] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:21:34 2022] GET /identity/v3/users/85c9037a2d6a4abb966dba3640beefcd => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:35.019325 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1daa70-7051-4418-9181-401b400a2066 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:35.064512 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:35.121776 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1daa70-7051-4418-9181-401b400a2066 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:35.155649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c2c1e-9e08-4218-ba57-245a17e4d2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:35.156295 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2c1e-9e08-4218-ba57-245a17e4d2fe None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:35.156580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2c1e-9e08-4218-ba57-245a17e4d2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:35.156859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c2c1e-9e08-4218-ba57-245a17e4d2fe None admin] PATH_INFO: `/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:35.158041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c2c1e-9e08-4218-ba57-245a17e4d2fe None admin] RBAC: Authorizing `identity:get_project(project_id=d9fc4c5ca9b347a18f48c6c1679e1000)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:35.159468 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c2c1e-9e08-4218-ba57-245a17e4d2fe None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:35.161339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 522/1083] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:21:35 2022] GET /identity/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:35.169606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1c889-c2b2-4c87-8174-dfb7f090150d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:35.268516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1c889-c2b2-4c87-8174-dfb7f090150d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:35.279668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:35.304201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9aca0-fd1b-4ad4-9ccd-4f3ac4d8779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:35.304860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9aca0-fd1b-4ad4-9ccd-4f3ac4d8779f None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:35.305167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9aca0-fd1b-4ad4-9ccd-4f3ac4d8779f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:35.305438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9aca0-fd1b-4ad4-9ccd-4f3ac4d8779f None admin] PATH_INFO: `/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000/users/85c9037a2d6a4abb966dba3640beefcd/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:35.307545 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9aca0-fd1b-4ad4-9ccd-4f3ac4d8779f None admin] RBAC: Authorizing `identity:create_grant(project_id=d9fc4c5ca9b347a18f48c6c1679e1000, user_id=85c9037a2d6a4abb966dba3640beefcd, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:35.308998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9aca0-fd1b-4ad4-9ccd-4f3ac4d8779f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:35.321337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 562/1084] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:21:35 2022] PUT /identity/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000/users/85c9037a2d6a4abb966dba3640beefcd/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:36.686592 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801e1fb-dc67-4714-b9f3-459ba582d373 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.687100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801e1fb-dc67-4714-b9f3-459ba582d373 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.687100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801e1fb-dc67-4714-b9f3-459ba582d373 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.688410 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 523/1085] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:36.693623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a31bd-77ac-49ff-8ae3-0c034967daa0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.694038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a31bd-77ac-49ff-8ae3-0c034967daa0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.694178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a31bd-77ac-49ff-8ae3-0c034967daa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.713480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e42a31bd-77ac-49ff-8ae3-0c034967daa0 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:36.714645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e42a31bd-77ac-49ff-8ae3-0c034967daa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:36.782065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 563/1086] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:36.806057 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801e1fb-dc67-4714-b9f3-459ba582d373 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:36.906409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801e1fb-dc67-4714-b9f3-459ba582d373 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:36.916831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:36.941200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d783895-5705-4950-9351-41e3d5234f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:36.941764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d783895-5705-4950-9351-41e3d5234f04 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.942043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d783895-5705-4950-9351-41e3d5234f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.942314 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d783895-5705-4950-9351-41e3d5234f04 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.953962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d783895-5705-4950-9351-41e3d5234f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2d783895-5705-4950-9351-41e3d5234f04 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:36.958840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:36.960001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:36.960850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 524/1087] 10.222.0.15 () {56 vars in 1120 bytes} [Sat Aug 6 01:21:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:36.966093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a31bd-77ac-49ff-8ae3-0c034967daa0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.060451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:37.063414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a31bd-77ac-49ff-8ae3-0c034967daa0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.097487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de04525-9eb7-48f7-8ef8-e0a38c18053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.098096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de04525-9eb7-48f7-8ef8-e0a38c18053c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.098375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de04525-9eb7-48f7-8ef8-e0a38c18053c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.098643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de04525-9eb7-48f7-8ef8-e0a38c18053c None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.099354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de04525-9eb7-48f7-8ef8-e0a38c18053c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:37.099657 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de04525-9eb7-48f7-8ef8-e0a38c18053c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.101037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de04525-9eb7-48f7-8ef8-e0a38c18053c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.109301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 564/1088] 10.222.0.15 () {56 vars in 1115 bytes} [Sat Aug 6 01:21:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:37.114856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d783895-5705-4950-9351-41e3d5234f04 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.213369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d783895-5705-4950-9351-41e3d5234f04 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.245227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235efd7-9fd8-4b38-8963-dc05182c4673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.245858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235efd7-9fd8-4b38-8963-dc05182c4673 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.246137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235efd7-9fd8-4b38-8963-dc05182c4673 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.246410 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235efd7-9fd8-4b38-8963-dc05182c4673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.256558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235efd7-9fd8-4b38-8963-dc05182c4673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.258011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235efd7-9fd8-4b38-8963-dc05182c4673 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5235efd7-9fd8-4b38-8963-dc05182c4673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:37.272815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:37.273759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:37.275307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:37.275307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:37.275307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:37.275307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:37.277081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 525/1089] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:37.280235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de04525-9eb7-48f7-8ef8-e0a38c18053c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.310472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37a381-f7b4-4f4e-acd6-7f3b290e1dcd None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.310761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37a381-f7b4-4f4e-acd6-7f3b290e1dcd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.311041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37a381-f7b4-4f4e-acd6-7f3b290e1dcd None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.312393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 526/1090] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:21:37.317252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821dc7e-f06c-452f-9efd-37d64e23540a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.317572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821dc7e-f06c-452f-9efd-37d64e23540a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.317822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821dc7e-f06c-452f-9efd-37d64e23540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.336317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5821dc7e-f06c-452f-9efd-37d64e23540a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:37.338230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5821dc7e-f06c-452f-9efd-37d64e23540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:37.355647 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:37.385450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de04525-9eb7-48f7-8ef8-e0a38c18053c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.410297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 527/1091] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:37.419232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd4e2a-f173-4e74-9abb-c8bf5095a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.419847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd4e2a-f173-4e74-9abb-c8bf5095a68a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.420129 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd4e2a-f173-4e74-9abb-c8bf5095a68a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.420403 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd4e2a-f173-4e74-9abb-c8bf5095a68a None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.421123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd4e2a-f173-4e74-9abb-c8bf5095a68a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:37.421433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd4e2a-f173-4e74-9abb-c8bf5095a68a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.422780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd4e2a-f173-4e74-9abb-c8bf5095a68a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.434444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821dc7e-f06c-452f-9efd-37d64e23540a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.434934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 565/1092] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:37.440416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd4e2a-f173-4e74-9abb-c8bf5095a68a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.464684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:37.535068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821dc7e-f06c-452f-9efd-37d64e23540a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.538927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd4e2a-f173-4e74-9abb-c8bf5095a68a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.570387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093fdd-2a41-4e76-a1db-9619e28730f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.571696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093fdd-2a41-4e76-a1db-9619e28730f3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.571989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093fdd-2a41-4e76-a1db-9619e28730f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.572270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093fdd-2a41-4e76-a1db-9619e28730f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.573568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda2760-2169-4171-a6fa-f8df9b1982a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.574446 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2760-2169-4171-a6fa-f8df9b1982a1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.574728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2760-2169-4171-a6fa-f8df9b1982a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.575004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2760-2169-4171-a6fa-f8df9b1982a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.581876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda2760-2169-4171-a6fa-f8df9b1982a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.582551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01093fdd-2a41-4e76-a1db-9619e28730f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:37.583294 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda2760-2169-4171-a6fa-f8df9b1982a1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-01093fdd-2a41-4e76-a1db-9619e28730f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:37.588071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:37.589146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:37.590563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 528/1093] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:21:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:37.595218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093fdd-2a41-4e76-a1db-9619e28730f3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-ccda2760-2169-4171-a6fa-f8df9b1982a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:21:37.595885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:37.596800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:37.598675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:37.598675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:37.598675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:21:37.598675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:21:37.598675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:21:37.598675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:21:37.598675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:21:37.598675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:21:37.598675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:21:37.598675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:37.598675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 566/1094] 10.222.0.15 () {56 vars in 1093 bytes} [Sat Aug 6 01:21:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:37.603109 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda2760-2169-4171-a6fa-f8df9b1982a1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.610889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:37.686282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:37.699494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093fdd-2a41-4e76-a1db-9619e28730f3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.705956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda2760-2169-4171-a6fa-f8df9b1982a1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.732827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782839d-ed8e-4cb0-9d09-bd9bacb6e9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.733400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782839d-ed8e-4cb0-9d09-bd9bacb6e9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.733706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782839d-ed8e-4cb0-9d09-bd9bacb6e9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.733976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782839d-ed8e-4cb0-9d09-bd9bacb6e9f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.734680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782839d-ed8e-4cb0-9d09-bd9bacb6e9f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:37.734982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782839d-ed8e-4cb0-9d09-bd9bacb6e9f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.736329 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782839d-ed8e-4cb0-9d09-bd9bacb6e9f8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.738939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dce99f-03ad-4d4c-b27b-aa1bd1157f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.739542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dce99f-03ad-4d4c-b27b-aa1bd1157f05 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.739823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dce99f-03ad-4d4c-b27b-aa1bd1157f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.740095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dce99f-03ad-4d4c-b27b-aa1bd1157f05 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.740881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dce99f-03ad-4d4c-b27b-aa1bd1157f05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:37.741222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dce99f-03ad-4d4c-b27b-aa1bd1157f05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.742615 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dce99f-03ad-4d4c-b27b-aa1bd1157f05 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.744977 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 529/1095] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:21:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:37.750664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782839d-ed8e-4cb0-9d09-bd9bacb6e9f8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.761857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 567/1096] 10.222.0.15 () {56 vars in 1133 bytes} [Sat Aug 6 01:21:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:37.767664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dce99f-03ad-4d4c-b27b-aa1bd1157f05 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.825742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:37.850441 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782839d-ed8e-4cb0-9d09-bd9bacb6e9f8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.863551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dce99f-03ad-4d4c-b27b-aa1bd1157f05 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.885180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07b7a6-2d9a-4594-8240-eb4bc5c36f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.885845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07b7a6-2d9a-4594-8240-eb4bc5c36f5c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.886128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07b7a6-2d9a-4594-8240-eb4bc5c36f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.886403 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07b7a6-2d9a-4594-8240-eb4bc5c36f5c None admin] PATH_INFO: `/v3/users/85c9037a2d6a4abb966dba3640beefcd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.887570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07b7a6-2d9a-4594-8240-eb4bc5c36f5c None admin] RBAC: Authorizing `identity:get_user(user_id=85c9037a2d6a4abb966dba3640beefcd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.889277 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07b7a6-2d9a-4594-8240-eb4bc5c36f5c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.890876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 530/1097] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:21:37 2022] GET /identity/v3/users/85c9037a2d6a4abb966dba3640beefcd => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:37.896488 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07b7a6-2d9a-4594-8240-eb4bc5c36f5c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.898061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1484f-65ae-496b-b1d9-9a1d29ce9e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.898668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1484f-65ae-496b-b1d9-9a1d29ce9e8f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.898946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1484f-65ae-496b-b1d9-9a1d29ce9e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.899376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1484f-65ae-496b-b1d9-9a1d29ce9e8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.909763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:37.968196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1484f-65ae-496b-b1d9-9a1d29ce9e8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.969777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1484f-65ae-496b-b1d9-9a1d29ce9e8f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.999889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07b7a6-2d9a-4594-8240-eb4bc5c36f5c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.032412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718e147-7327-4889-ad6e-e19d600ee5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.033144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718e147-7327-4889-ad6e-e19d600ee5fc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.033429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718e147-7327-4889-ad6e-e19d600ee5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.033705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718e147-7327-4889-ad6e-e19d600ee5fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.045983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:38.067684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 568/1098] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 01:21:38.073696 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1484f-65ae-496b-b1d9-9a1d29ce9e8f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.102915 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718e147-7327-4889-ad6e-e19d600ee5fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.104586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718e147-7327-4889-ad6e-e19d600ee5fc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.114298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:38.172653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1484f-65ae-496b-b1d9-9a1d29ce9e8f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.202310 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 531/1099] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 01:21:38.206191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4017e-c9eb-4998-9c8f-1ae087c9d158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.206826 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4017e-c9eb-4998-9c8f-1ae087c9d158 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.207141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4017e-c9eb-4998-9c8f-1ae087c9d158 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.207416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4017e-c9eb-4998-9c8f-1ae087c9d158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.208127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718e147-7327-4889-ad6e-e19d600ee5fc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.218216 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4017e-c9eb-4998-9c8f-1ae087c9d158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.219661 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4017e-c9eb-4998-9c8f-1ae087c9d158 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-7ee4017e-c9eb-4998-9c8f-1ae087c9d158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:21:38.234908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:38.235831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:38.236770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:21:38.236770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:21:38.236770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:21:38.236770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:38.236770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 569/1100] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:38.241579 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4017e-c9eb-4998-9c8f-1ae087c9d158 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.253799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:38.310218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718e147-7327-4889-ad6e-e19d600ee5fc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.332127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:38.341718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4017e-c9eb-4998-9c8f-1ae087c9d158 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.344588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d12aa-2134-4a05-90af-f3c05424340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.345253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d12aa-2134-4a05-90af-f3c05424340e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.345538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d12aa-2134-4a05-90af-f3c05424340e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.345815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d12aa-2134-4a05-90af-f3c05424340e None admin] PATH_INFO: `/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.346958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d12aa-2134-4a05-90af-f3c05424340e None admin] RBAC: Authorizing `identity:get_project(project_id=d9fc4c5ca9b347a18f48c6c1679e1000)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.348384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d12aa-2134-4a05-90af-f3c05424340e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.350092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 532/1101] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:21:38 2022] GET /identity/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:38.356752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d12aa-2134-4a05-90af-f3c05424340e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.377579 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f182ebd-4b1b-4340-8c8d-611a75d6899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.378201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f182ebd-4b1b-4340-8c8d-611a75d6899e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.378481 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f182ebd-4b1b-4340-8c8d-611a75d6899e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.378752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f182ebd-4b1b-4340-8c8d-611a75d6899e None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.379439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f182ebd-4b1b-4340-8c8d-611a75d6899e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:38.379744 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f182ebd-4b1b-4340-8c8d-611a75d6899e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.381126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f182ebd-4b1b-4340-8c8d-611a75d6899e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.393479 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 570/1102] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:38.399004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f182ebd-4b1b-4340-8c8d-611a75d6899e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.458561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d12aa-2134-4a05-90af-f3c05424340e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.470432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:38.494897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55524374-c605-49ac-a917-cd7ba6e6b659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.495511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55524374-c605-49ac-a917-cd7ba6e6b659 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.496072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55524374-c605-49ac-a917-cd7ba6e6b659 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.496624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55524374-c605-49ac-a917-cd7ba6e6b659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.497442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55524374-c605-49ac-a917-cd7ba6e6b659 None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=d9fc4c5ca9b347a18f48c6c1679e1000, user.id=85c9037a2d6a4abb966dba3640beefcd) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:38.497645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f182ebd-4b1b-4340-8c8d-611a75d6899e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.497742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55524374-c605-49ac-a917-cd7ba6e6b659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.499171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55524374-c605-49ac-a917-cd7ba6e6b659 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.504889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 533/1103] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:21:38 2022] GET /identity/v3/role_assignments?user.id=85c9037a2d6a4abb966dba3640beefcd&scope.project.id=d9fc4c5ca9b347a18f48c6c1679e1000&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:38.532977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80453720-9daf-40c9-b414-466e2877f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.533647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80453720-9daf-40c9-b414-466e2877f33c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.533932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80453720-9daf-40c9-b414-466e2877f33c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.534209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80453720-9daf-40c9-b414-466e2877f33c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.542448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80453720-9daf-40c9-b414-466e2877f33c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.543912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80453720-9daf-40c9-b414-466e2877f33c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-80453720-9daf-40c9-b414-466e2877f33c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:21:38.556611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:38.557633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:38.558711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:21:38.558711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:21:38.558711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:21:38.558711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:21:38.558711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:21:38.558711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:21:38.558711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:21:38.558711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:21:38.558711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 571/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:21:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:21:38.564001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55524374-c605-49ac-a917-cd7ba6e6b659 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.670141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55524374-c605-49ac-a917-cd7ba6e6b659 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.706712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46d2d6-ae54-4125-b6f9-0212b0694f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.707332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46d2d6-ae54-4125-b6f9-0212b0694f39 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.707592 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46d2d6-ae54-4125-b6f9-0212b0694f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.707887 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46d2d6-ae54-4125-b6f9-0212b0694f39 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.708632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46d2d6-ae54-4125-b6f9-0212b0694f39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:38.708986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46d2d6-ae54-4125-b6f9-0212b0694f39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.710394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46d2d6-ae54-4125-b6f9-0212b0694f39 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.723046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 534/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:21:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:38.729635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80453720-9daf-40c9-b414-466e2877f33c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.744850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:38.829566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80453720-9daf-40c9-b414-466e2877f33c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.862456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af036-6137-441a-b1e1-1cce6da55449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.863071 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af036-6137-441a-b1e1-1cce6da55449 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.863355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af036-6137-441a-b1e1-1cce6da55449 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.863632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af036-6137-441a-b1e1-1cce6da55449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.864419 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af036-6137-441a-b1e1-1cce6da55449 None admin] RBAC: Adding query filter params (role.id=6adb3bcaecba49c7be505774fe3f5940, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=666f4864832445d5a10d60f677f5cd6c) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:38.864730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af036-6137-441a-b1e1-1cce6da55449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.866179 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af036-6137-441a-b1e1-1cce6da55449 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.872520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 572/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:21:38 2022] GET /identity/v3/role_assignments?user.id=666f4864832445d5a10d60f677f5cd6c&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=6adb3bcaecba49c7be505774fe3f5940 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:40.547525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdb75b-46f8-4aef-a148-9bbb8693b4d7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:40.548070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdb75b-46f8-4aef-a148-9bbb8693b4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:40.548070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdb75b-46f8-4aef-a148-9bbb8693b4d7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:40.549465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 535/1107] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:40.554630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a587d9-e000-4a68-877d-a2e6a5f287b8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:40.555003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a587d9-e000-4a68-877d-a2e6a5f287b8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:40.555713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a587d9-e000-4a68-877d-a2e6a5f287b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:40.574161 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d2a587d9-e000-4a68-877d-a2e6a5f287b8 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:40.575346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d2a587d9-e000-4a68-877d-a2e6a5f287b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:40.639992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 573/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:40.664274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdb75b-46f8-4aef-a148-9bbb8693b4d7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:40.699282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:40.765071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdb75b-46f8-4aef-a148-9bbb8693b4d7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:40.797960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2a926-3110-428b-859d-25fa806e7c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:40.798586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2a926-3110-428b-859d-25fa806e7c37 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:40.798867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2a926-3110-428b-859d-25fa806e7c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:40.799141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2a926-3110-428b-859d-25fa806e7c37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:40.800268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2a926-3110-428b-859d-25fa806e7c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:40.801711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2a926-3110-428b-859d-25fa806e7c37 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:40.803283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 536/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:40.809348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a587d9-e000-4a68-877d-a2e6a5f287b8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:40.817399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:40.907019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a587d9-e000-4a68-877d-a2e6a5f287b8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:40.939518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fdd2a-6207-40ab-b0c0-47a7e6ec2a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:40.940107 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fdd2a-6207-40ab-b0c0-47a7e6ec2a8a None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:40.940391 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fdd2a-6207-40ab-b0c0-47a7e6ec2a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:40.940667 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fdd2a-6207-40ab-b0c0-47a7e6ec2a8a None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:40.941377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fdd2a-6207-40ab-b0c0-47a7e6ec2a8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:40.942797 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fdd2a-6207-40ab-b0c0-47a7e6ec2a8a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:40.964090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 574/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:21:40 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:43.021790 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31ded-80a7-4e9e-886f-719b9a11e0a1 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.022320 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31ded-80a7-4e9e-886f-719b9a11e0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.022320 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31ded-80a7-4e9e-886f-719b9a11e0a1 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.023672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 537/1111] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:43.029164 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8e9bd-af24-4bde-988e-ce9cc635519a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.029565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8e9bd-af24-4bde-988e-ce9cc635519a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.029731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8e9bd-af24-4bde-988e-ce9cc635519a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.047967 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6fb8e9bd-af24-4bde-988e-ce9cc635519a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:43.049188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6fb8e9bd-af24-4bde-988e-ce9cc635519a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:43.104293 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:43.115493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 575/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:43.139248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31ded-80a7-4e9e-886f-719b9a11e0a1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.237019 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31ded-80a7-4e9e-886f-719b9a11e0a1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.238471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:43.271751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bf055-e0db-4e56-9ad5-8600caa4946c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.272418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bf055-e0db-4e56-9ad5-8600caa4946c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.272650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bf055-e0db-4e56-9ad5-8600caa4946c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.272944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bf055-e0db-4e56-9ad5-8600caa4946c None admin] PATH_INFO: `/v3/roles/30697c5bde894ea6b08f513a33e8b9ac` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.274539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bf055-e0db-4e56-9ad5-8600caa4946c None admin] RBAC: Authorizing `identity:get_role(role_id=30697c5bde894ea6b08f513a33e8b9ac)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.275884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bf055-e0db-4e56-9ad5-8600caa4946c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.277227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 538/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:21:43 2022] GET /identity/v3/roles/30697c5bde894ea6b08f513a33e8b9ac => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:43.283138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8e9bd-af24-4bde-988e-ce9cc635519a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.380611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8e9bd-af24-4bde-988e-ce9cc635519a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.415447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd570f-150c-49aa-8baa-7d51a7e077e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.416068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd570f-150c-49aa-8baa-7d51a7e077e7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.416355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd570f-150c-49aa-8baa-7d51a7e077e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.416628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd570f-150c-49aa-8baa-7d51a7e077e7 None admin] PATH_INFO: `/v3/users/351e2e54699e421e939e177f15bb8a9d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.429231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd570f-150c-49aa-8baa-7d51a7e077e7 None admin] RBAC: Authorizing `identity:get_user(user_id=351e2e54699e421e939e177f15bb8a9d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.430746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd570f-150c-49aa-8baa-7d51a7e077e7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.432323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 576/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:21:43 2022] GET /identity/v3/users/351e2e54699e421e939e177f15bb8a9d => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:43.438185 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bf055-e0db-4e56-9ad5-8600caa4946c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.533776 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bf055-e0db-4e56-9ad5-8600caa4946c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.566914 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e63c4-1ee5-41d1-917a-b7d5e75c231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.567516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e63c4-1ee5-41d1-917a-b7d5e75c231b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.567803 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e63c4-1ee5-41d1-917a-b7d5e75c231b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.568078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e63c4-1ee5-41d1-917a-b7d5e75c231b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.605949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:43.634551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e63c4-1ee5-41d1-917a-b7d5e75c231b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.635982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e63c4-1ee5-41d1-917a-b7d5e75c231b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.729724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 539/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:21:43.735523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd570f-150c-49aa-8baa-7d51a7e077e7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.786755 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:43.841774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd570f-150c-49aa-8baa-7d51a7e077e7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.876488 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cd2a6-b9c3-445e-a3fd-014e20ca8369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.877138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cd2a6-b9c3-445e-a3fd-014e20ca8369 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.877420 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cd2a6-b9c3-445e-a3fd-014e20ca8369 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.877690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cd2a6-b9c3-445e-a3fd-014e20ca8369 None admin] PATH_INFO: `/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.878827 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cd2a6-b9c3-445e-a3fd-014e20ca8369 None admin] RBAC: Authorizing `identity:get_project(project_id=d9fc4c5ca9b347a18f48c6c1679e1000)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.880236 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cd2a6-b9c3-445e-a3fd-014e20ca8369 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.881875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 577/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:21:43 2022] GET /identity/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:43.888426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e63c4-1ee5-41d1-917a-b7d5e75c231b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.956942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:43.988561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e63c4-1ee5-41d1-917a-b7d5e75c231b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:44.021680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3336a4c-bdb8-4b29-a371-69b0e205655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:44.022286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3336a4c-bdb8-4b29-a371-69b0e205655b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:44.022827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3336a4c-bdb8-4b29-a371-69b0e205655b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:44.022827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3336a4c-bdb8-4b29-a371-69b0e205655b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:44.023588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3336a4c-bdb8-4b29-a371-69b0e205655b None admin] RBAC: Adding query filter params (role.id=30697c5bde894ea6b08f513a33e8b9ac, scope.project.id=d9fc4c5ca9b347a18f48c6c1679e1000, user.id=351e2e54699e421e939e177f15bb8a9d) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:44.023955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3336a4c-bdb8-4b29-a371-69b0e205655b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:44.025488 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3336a4c-bdb8-4b29-a371-69b0e205655b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:44.030770 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 540/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:21:43 2022] GET /identity/v3/role_assignments?user.id=351e2e54699e421e939e177f15bb8a9d&scope.project.id=d9fc4c5ca9b347a18f48c6c1679e1000&role.id=30697c5bde894ea6b08f513a33e8b9ac => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:45.971572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40586f50-2f67-49d7-a9f8-bbb4233d2157 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.973520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40586f50-2f67-49d7-a9f8-bbb4233d2157 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.973520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40586f50-2f67-49d7-a9f8-bbb4233d2157 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.973520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 578/1118] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:45.980466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb6d25-2808-49c0-b524-8ef84e2a3326 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.980944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb6d25-2808-49c0-b524-8ef84e2a3326 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.981042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb6d25-2808-49c0-b524-8ef84e2a3326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.999085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6feb6d25-2808-49c0-b524-8ef84e2a3326 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:46.000253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6feb6d25-2808-49c0-b524-8ef84e2a3326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:46.064782 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 541/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:46.086953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40586f50-2f67-49d7-a9f8-bbb4233d2157 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:46.185947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40586f50-2f67-49d7-a9f8-bbb4233d2157 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:46.202126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:46.218304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf8951-22b8-42b6-a899-d4fab701c210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:46.218926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf8951-22b8-42b6-a899-d4fab701c210 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.219243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf8951-22b8-42b6-a899-d4fab701c210 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.219466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf8951-22b8-42b6-a899-d4fab701c210 None admin] PATH_INFO: `/v3/roles/30697c5bde894ea6b08f513a33e8b9ac` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.220873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf8951-22b8-42b6-a899-d4fab701c210 None admin] RBAC: Authorizing `identity:get_role(role_id=30697c5bde894ea6b08f513a33e8b9ac)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:46.222293 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf8951-22b8-42b6-a899-d4fab701c210 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:46.223537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 579/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:21:46 2022] GET /identity/v3/roles/30697c5bde894ea6b08f513a33e8b9ac => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:46.230055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb6d25-2808-49c0-b524-8ef84e2a3326 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:46.289659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:46.326540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb6d25-2808-49c0-b524-8ef84e2a3326 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:46.358845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd55fa-3973-4bbd-ba6e-da102399a385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:46.359500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd55fa-3973-4bbd-ba6e-da102399a385 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.359780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd55fa-3973-4bbd-ba6e-da102399a385 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.360050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd55fa-3973-4bbd-ba6e-da102399a385 None admin] PATH_INFO: `/v3/users/351e2e54699e421e939e177f15bb8a9d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.361286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd55fa-3973-4bbd-ba6e-da102399a385 None admin] RBAC: Authorizing `identity:get_user(user_id=351e2e54699e421e939e177f15bb8a9d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:46.362698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd55fa-3973-4bbd-ba6e-da102399a385 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:46.364275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 542/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:21:46 2022] GET /identity/v3/users/351e2e54699e421e939e177f15bb8a9d => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:46.370171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf8951-22b8-42b6-a899-d4fab701c210 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:46.468145 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf8951-22b8-42b6-a899-d4fab701c210 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:46.501140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f6330-18ba-45c8-b6ac-58eeb8e963dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:46.501704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6330-18ba-45c8-b6ac-58eeb8e963dd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.501994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6330-18ba-45c8-b6ac-58eeb8e963dd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.502272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6330-18ba-45c8-b6ac-58eeb8e963dd None admin] PATH_INFO: `/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.503414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f6330-18ba-45c8-b6ac-58eeb8e963dd None admin] RBAC: Authorizing `identity:get_project(project_id=d9fc4c5ca9b347a18f48c6c1679e1000)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:46.504831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f6330-18ba-45c8-b6ac-58eeb8e963dd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:46.506470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 580/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:21:46 2022] GET /identity/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:46.513472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd55fa-3973-4bbd-ba6e-da102399a385 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:46.609686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd55fa-3973-4bbd-ba6e-da102399a385 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:46.638874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:46.643879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f9842-2a26-4d99-9bf9-3c4d5a3419ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:46.644531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f9842-2a26-4d99-9bf9-3c4d5a3419ff None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.644813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f9842-2a26-4d99-9bf9-3c4d5a3419ff None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.645119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f9842-2a26-4d99-9bf9-3c4d5a3419ff None admin] PATH_INFO: `/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000/users/351e2e54699e421e939e177f15bb8a9d/roles/30697c5bde894ea6b08f513a33e8b9ac` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.647267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f9842-2a26-4d99-9bf9-3c4d5a3419ff None admin] RBAC: Authorizing `identity:create_grant(project_id=d9fc4c5ca9b347a18f48c6c1679e1000, user_id=351e2e54699e421e939e177f15bb8a9d, role_id=30697c5bde894ea6b08f513a33e8b9ac)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:46.649533 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f9842-2a26-4d99-9bf9-3c4d5a3419ff None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:46.661733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 543/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:21:46 2022] PUT /identity/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000/users/351e2e54699e421e939e177f15bb8a9d/roles/30697c5bde894ea6b08f513a33e8b9ac => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:48.626849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053da4f-3003-4657-aeef-a8db580b4210 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:48.627376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053da4f-3003-4657-aeef-a8db580b4210 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:48.627376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053da4f-3003-4657-aeef-a8db580b4210 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:48.628630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 581/1124] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:48.633688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea473d6-5e7e-4833-a553-b59d7232b544 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:48.634112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea473d6-5e7e-4833-a553-b59d7232b544 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:48.634235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea473d6-5e7e-4833-a553-b59d7232b544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:48.653731 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bea473d6-5e7e-4833-a553-b59d7232b544 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:48.654922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bea473d6-5e7e-4833-a553-b59d7232b544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:48.719141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 544/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:21:48.743090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053da4f-3003-4657-aeef-a8db580b4210 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:48.799512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:48.843683 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053da4f-3003-4657-aeef-a8db580b4210 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:48.876191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64343ae7-493b-4be8-912a-4d188d744958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:48.876827 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64343ae7-493b-4be8-912a-4d188d744958 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:48.877188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64343ae7-493b-4be8-912a-4d188d744958 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:48.877414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64343ae7-493b-4be8-912a-4d188d744958 None admin] PATH_INFO: `/v3/roles/30697c5bde894ea6b08f513a33e8b9ac` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:48.878838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64343ae7-493b-4be8-912a-4d188d744958 None admin] RBAC: Authorizing `identity:get_role(role_id=30697c5bde894ea6b08f513a33e8b9ac)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:48.880186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64343ae7-493b-4be8-912a-4d188d744958 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:48.881522 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 582/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:21:48 2022] GET /identity/v3/roles/30697c5bde894ea6b08f513a33e8b9ac => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:48.887326 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea473d6-5e7e-4833-a553-b59d7232b544 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:48.985567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea473d6-5e7e-4833-a553-b59d7232b544 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:49.007332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:49.020242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68318092-4c41-437f-a513-cde00dd6e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:49.020874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68318092-4c41-437f-a513-cde00dd6e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.021186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68318092-4c41-437f-a513-cde00dd6e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.021463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68318092-4c41-437f-a513-cde00dd6e2c0 None admin] PATH_INFO: `/v3/users/351e2e54699e421e939e177f15bb8a9d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.022613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68318092-4c41-437f-a513-cde00dd6e2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=351e2e54699e421e939e177f15bb8a9d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:49.024890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68318092-4c41-437f-a513-cde00dd6e2c0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:49.026494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 545/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:21:48 2022] GET /identity/v3/users/351e2e54699e421e939e177f15bb8a9d => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:49.032201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64343ae7-493b-4be8-912a-4d188d744958 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:49.129195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64343ae7-493b-4be8-912a-4d188d744958 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:49.152154 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:49.163640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ded5d-3968-4f67-ad0e-c5b590fd44aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:49.164823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ded5d-3968-4f67-ad0e-c5b590fd44aa None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.165160 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ded5d-3968-4f67-ad0e-c5b590fd44aa None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.165432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ded5d-3968-4f67-ad0e-c5b590fd44aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.231443 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ded5d-3968-4f67-ad0e-c5b590fd44aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:49.232867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ded5d-3968-4f67-ad0e-c5b590fd44aa None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:49.328083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 583/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:21:49.333949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68318092-4c41-437f-a513-cde00dd6e2c0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:49.434466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68318092-4c41-437f-a513-cde00dd6e2c0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:49.466685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f35ad5-32e5-447c-93b8-5270f9dbd5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:49.467312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f35ad5-32e5-447c-93b8-5270f9dbd5ae None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.467590 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f35ad5-32e5-447c-93b8-5270f9dbd5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.467862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f35ad5-32e5-447c-93b8-5270f9dbd5ae None admin] PATH_INFO: `/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.469015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f35ad5-32e5-447c-93b8-5270f9dbd5ae None admin] RBAC: Authorizing `identity:get_project(project_id=d9fc4c5ca9b347a18f48c6c1679e1000)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:49.470426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f35ad5-32e5-447c-93b8-5270f9dbd5ae None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:49.472059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 546/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:21:49 2022] GET /identity/v3/projects/d9fc4c5ca9b347a18f48c6c1679e1000 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:49.478159 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ded5d-3968-4f67-ad0e-c5b590fd44aa None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:49.501502 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:49.577591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ded5d-3968-4f67-ad0e-c5b590fd44aa None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:49.610021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5f726-024f-436a-9e5a-eb3890611c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:49.610625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5f726-024f-436a-9e5a-eb3890611c81 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.610907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5f726-024f-436a-9e5a-eb3890611c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.611181 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5f726-024f-436a-9e5a-eb3890611c81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.611963 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5f726-024f-436a-9e5a-eb3890611c81 None admin] RBAC: Adding query filter params (role.id=30697c5bde894ea6b08f513a33e8b9ac, scope.project.id=d9fc4c5ca9b347a18f48c6c1679e1000, user.id=351e2e54699e421e939e177f15bb8a9d) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:49.612275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5f726-024f-436a-9e5a-eb3890611c81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:49.613725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5f726-024f-436a-9e5a-eb3890611c81 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:49.620259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 584/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:21:49 2022] GET /identity/v3/role_assignments?user.id=351e2e54699e421e939e177f15bb8a9d&scope.project.id=d9fc4c5ca9b347a18f48c6c1679e1000&role.id=30697c5bde894ea6b08f513a33e8b9ac => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:51.613943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dd664-7c32-4a2b-8714-0f4032f89dda None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:51.614465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dd664-7c32-4a2b-8714-0f4032f89dda None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:51.614554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dd664-7c32-4a2b-8714-0f4032f89dda None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:51.615826 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 547/1131] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:51.621871 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0471f-c5a6-4028-8bd8-859b60bbb7ac None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:51.622274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0471f-c5a6-4028-8bd8-859b60bbb7ac None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:51.622364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0471f-c5a6-4028-8bd8-859b60bbb7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:51.640238 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-76c0471f-c5a6-4028-8bd8-859b60bbb7ac None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:51.641455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-76c0471f-c5a6-4028-8bd8-859b60bbb7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:51.705772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 585/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:51.730362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dd664-7c32-4a2b-8714-0f4032f89dda None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:51.787090 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:51.827453 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dd664-7c32-4a2b-8714-0f4032f89dda None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:51.859636 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5f3b5-cbde-4af7-bbb9-4608316f9acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:51.860254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f3b5-cbde-4af7-bbb9-4608316f9acc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:51.860532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f3b5-cbde-4af7-bbb9-4608316f9acc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:51.860802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f3b5-cbde-4af7-bbb9-4608316f9acc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:51.861951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5f3b5-cbde-4af7-bbb9-4608316f9acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:51.863361 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5f3b5-cbde-4af7-bbb9-4608316f9acc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:51.864922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 548/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:51.871255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0471f-c5a6-4028-8bd8-859b60bbb7ac None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:51.888977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:51.973109 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0471f-c5a6-4028-8bd8-859b60bbb7ac None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:52.006409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632eb57d-5b9e-4198-91c9-e2a501c07a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:52.007019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb57d-5b9e-4198-91c9-e2a501c07a2f None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:52.007303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb57d-5b9e-4198-91c9-e2a501c07a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:52.008083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb57d-5b9e-4198-91c9-e2a501c07a2f None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:52.008786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632eb57d-5b9e-4198-91c9-e2a501c07a2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:52.010243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632eb57d-5b9e-4198-91c9-e2a501c07a2f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:52.036490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 586/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:21:51 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:54.047835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b695da-fcbc-466c-8192-282ecb27d41f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:54.048361 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b695da-fcbc-466c-8192-282ecb27d41f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:54.048455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b695da-fcbc-466c-8192-282ecb27d41f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:54.049764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 549/1135] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:54.055246 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c905f-697c-4c5c-b128-b2fe651e7f24 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:54.055637 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c905f-697c-4c5c-b128-b2fe651e7f24 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:54.055802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c905f-697c-4c5c-b128-b2fe651e7f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:54.073550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-860c905f-697c-4c5c-b128-b2fe651e7f24 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:54.074715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-860c905f-697c-4c5c-b128-b2fe651e7f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:54.133234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:54.139257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 587/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:54.163108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b695da-fcbc-466c-8192-282ecb27d41f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:54.262933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b695da-fcbc-466c-8192-282ecb27d41f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:54.286998 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:54.296115 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b11453-330b-4487-85b8-63cc8428667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:54.296742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b11453-330b-4487-85b8-63cc8428667a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:54.297055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b11453-330b-4487-85b8-63cc8428667a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:54.297331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b11453-330b-4487-85b8-63cc8428667a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:54.298515 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b11453-330b-4487-85b8-63cc8428667a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:54.299873 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b11453-330b-4487-85b8-63cc8428667a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:54.301455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 550/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:21:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:54.307865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c905f-697c-4c5c-b128-b2fe651e7f24 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:54.402220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c905f-697c-4c5c-b128-b2fe651e7f24 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:54.436029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb45f1-8d51-48b7-a8fe-91a4b97df95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:54.436634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb45f1-8d51-48b7-a8fe-91a4b97df95b None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:54.436938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb45f1-8d51-48b7-a8fe-91a4b97df95b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:54.437219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb45f1-8d51-48b7-a8fe-91a4b97df95b None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:54.437901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb45f1-8d51-48b7-a8fe-91a4b97df95b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:54.439321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb45f1-8d51-48b7-a8fe-91a4b97df95b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:54.460350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 588/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:21:54 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:56.471178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151187-3021-419a-9659-8bb49fba1890 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:56.471684 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151187-3021-419a-9659-8bb49fba1890 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:56.471797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151187-3021-419a-9659-8bb49fba1890 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:56.473086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 551/1139] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:56.478140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf215f-a145-47a5-bc28-b2dcd67a9ba5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:56.478571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf215f-a145-47a5-bc28-b2dcd67a9ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:56.478702 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf215f-a145-47a5-bc28-b2dcd67a9ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:56.496802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5caf215f-a145-47a5-bc28-b2dcd67a9ba5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:56.498010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5caf215f-a145-47a5-bc28-b2dcd67a9ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:56.546403 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:56.564363 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 589/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:56.586517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6151187-3021-419a-9659-8bb49fba1890 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:56.684560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6151187-3021-419a-9659-8bb49fba1890 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:56.716261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b4b15-f91e-47ff-8533-42c0dbfcec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:56.716878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b4b15-f91e-47ff-8533-42c0dbfcec37 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:56.717186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b4b15-f91e-47ff-8533-42c0dbfcec37 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:56.717463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b4b15-f91e-47ff-8533-42c0dbfcec37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:56.727833 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b4b15-f91e-47ff-8533-42c0dbfcec37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c35b4b15-f91e-47ff-8533-42c0dbfcec37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:56.732638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:56.733822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:56.734737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 552/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:21:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:56.739602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf215f-a145-47a5-bc28-b2dcd67a9ba5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:56.835699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf215f-a145-47a5-bc28-b2dcd67a9ba5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:56.868923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334fe6f-bf97-4218-bc6e-6904e6920253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:56.869542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334fe6f-bf97-4218-bc6e-6904e6920253 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:56.869822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334fe6f-bf97-4218-bc6e-6904e6920253 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:56.870098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334fe6f-bf97-4218-bc6e-6904e6920253 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:56.870802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334fe6f-bf97-4218-bc6e-6904e6920253 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:56.871102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334fe6f-bf97-4218-bc6e-6904e6920253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:56.872445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334fe6f-bf97-4218-bc6e-6904e6920253 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:56.880121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 590/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:21:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:56.885860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b4b15-f91e-47ff-8533-42c0dbfcec37 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:56.941172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:56.986223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b4b15-f91e-47ff-8533-42c0dbfcec37 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:57.018073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56038b8-d38f-4f2f-8775-0c1d31974799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:57.018702 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56038b8-d38f-4f2f-8775-0c1d31974799 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:57.018985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56038b8-d38f-4f2f-8775-0c1d31974799 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:57.019259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56038b8-d38f-4f2f-8775-0c1d31974799 None admin] PATH_INFO: `/v3/users/eb9f4425b2164615aaf59e797ae58663` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:57.032425 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56038b8-d38f-4f2f-8775-0c1d31974799 None admin] RBAC: Authorizing `identity:get_user(user_id=eb9f4425b2164615aaf59e797ae58663)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:57.033881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56038b8-d38f-4f2f-8775-0c1d31974799 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:57.035483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 553/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:21:56 2022] GET /identity/v3/users/eb9f4425b2164615aaf59e797ae58663 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:57.041940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334fe6f-bf97-4218-bc6e-6904e6920253 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:57.087198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:57.138849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334fe6f-bf97-4218-bc6e-6904e6920253 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:57.171171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e1457-c21e-44c4-9cf8-d85841020af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:57.171770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e1457-c21e-44c4-9cf8-d85841020af9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:57.172050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e1457-c21e-44c4-9cf8-d85841020af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:57.172320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e1457-c21e-44c4-9cf8-d85841020af9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:57.235947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e1457-c21e-44c4-9cf8-d85841020af9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:57.237344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e1457-c21e-44c4-9cf8-d85841020af9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:57.279436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:57.331465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 591/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:21:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:21:57.337960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56038b8-d38f-4f2f-8775-0c1d31974799 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:57.437199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56038b8-d38f-4f2f-8775-0c1d31974799 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:57.450740 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:57.472031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be7e93-8e6c-44c0-a4ae-e6f40a6e3302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:57.472664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be7e93-8e6c-44c0-a4ae-e6f40a6e3302 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:57.472975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be7e93-8e6c-44c0-a4ae-e6f40a6e3302 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:57.473255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be7e93-8e6c-44c0-a4ae-e6f40a6e3302 None admin] PATH_INFO: `/v3/projects/aacfb4f6ab9e437c93c827214c62015f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:57.474389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be7e93-8e6c-44c0-a4ae-e6f40a6e3302 None admin] RBAC: Authorizing `identity:get_project(project_id=aacfb4f6ab9e437c93c827214c62015f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:57.475805 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be7e93-8e6c-44c0-a4ae-e6f40a6e3302 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:57.478476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 554/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:21:57 2022] GET /identity/v3/projects/aacfb4f6ab9e437c93c827214c62015f => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:57.484519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e1457-c21e-44c4-9cf8-d85841020af9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:57.580830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e1457-c21e-44c4-9cf8-d85841020af9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:57.613411 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed8cc0-5130-4856-b04a-a4b4789a356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:57.614005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8cc0-5130-4856-b04a-a4b4789a356f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:57.614283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8cc0-5130-4856-b04a-a4b4789a356f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:57.614555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed8cc0-5130-4856-b04a-a4b4789a356f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:57.615325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed8cc0-5130-4856-b04a-a4b4789a356f None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=aacfb4f6ab9e437c93c827214c62015f, user.id=eb9f4425b2164615aaf59e797ae58663) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:57.615629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed8cc0-5130-4856-b04a-a4b4789a356f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:57.617280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed8cc0-5130-4856-b04a-a4b4789a356f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:57.622432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 592/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:21:57 2022] GET /identity/v3/role_assignments?user.id=eb9f4425b2164615aaf59e797ae58663&scope.project.id=aacfb4f6ab9e437c93c827214c62015f&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:59.568721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda67418-33f9-48a9-91d7-6049c287f6c6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:59.569317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda67418-33f9-48a9-91d7-6049c287f6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:59.569317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda67418-33f9-48a9-91d7-6049c287f6c6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:59.571231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 555/1147] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:59.576229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e0b2e-694c-4587-926a-4e4f87ba871a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:59.576655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e0b2e-694c-4587-926a-4e4f87ba871a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:59.576770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e0b2e-694c-4587-926a-4e4f87ba871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:59.595806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2a6e0b2e-694c-4587-926a-4e4f87ba871a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:59.597012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2a6e0b2e-694c-4587-926a-4e4f87ba871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:59.599656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:59.661533 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 593/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:21:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:21:59.683652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda67418-33f9-48a9-91d7-6049c287f6c6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:59.781792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda67418-33f9-48a9-91d7-6049c287f6c6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:59.814009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5a67-352e-469b-a177-ca42a8671346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:59.814631 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5a67-352e-469b-a177-ca42a8671346 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:59.814910 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5a67-352e-469b-a177-ca42a8671346 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:59.815180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5a67-352e-469b-a177-ca42a8671346 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:59.825792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c5a67-352e-469b-a177-ca42a8671346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-305c5a67-352e-469b-a177-ca42a8671346 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:21:59.830633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:21:59.831711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:21:59.832596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 556/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:21:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:21:59.838385 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e0b2e-694c-4587-926a-4e4f87ba871a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:59.931792 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e0b2e-694c-4587-926a-4e4f87ba871a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:59.964794 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da45665-ebcc-48c7-94b0-db63803af410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:59.965429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da45665-ebcc-48c7-94b0-db63803af410 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:59.965710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da45665-ebcc-48c7-94b0-db63803af410 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:59.965979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da45665-ebcc-48c7-94b0-db63803af410 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:59.966687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da45665-ebcc-48c7-94b0-db63803af410 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:59.966994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da45665-ebcc-48c7-94b0-db63803af410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:59.968338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da45665-ebcc-48c7-94b0-db63803af410 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:59.976794 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 594/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:21:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:59.982702 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5a67-352e-469b-a177-ca42a8671346 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:00.026547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:00.083712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5a67-352e-469b-a177-ca42a8671346 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:00.118576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195b305-c75e-4260-8251-01bad47d1060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:00.119200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195b305-c75e-4260-8251-01bad47d1060 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:00.119483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195b305-c75e-4260-8251-01bad47d1060 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:00.119759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195b305-c75e-4260-8251-01bad47d1060 None admin] PATH_INFO: `/v3/users/eb9f4425b2164615aaf59e797ae58663` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:00.120931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195b305-c75e-4260-8251-01bad47d1060 None admin] RBAC: Authorizing `identity:get_user(user_id=eb9f4425b2164615aaf59e797ae58663)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:00.122350 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195b305-c75e-4260-8251-01bad47d1060 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:00.123922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 557/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:21:59 2022] GET /identity/v3/users/eb9f4425b2164615aaf59e797ae58663 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:00.129626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da45665-ebcc-48c7-94b0-db63803af410 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:00.132980 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:00.229238 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da45665-ebcc-48c7-94b0-db63803af410 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:00.261927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461bdb7-ce67-4ed7-8357-27b41ea4ddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:00.262801 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461bdb7-ce67-4ed7-8357-27b41ea4ddbb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:00.263084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461bdb7-ce67-4ed7-8357-27b41ea4ddbb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:00.263356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461bdb7-ce67-4ed7-8357-27b41ea4ddbb None admin] PATH_INFO: `/v3/projects/aacfb4f6ab9e437c93c827214c62015f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:00.264497 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461bdb7-ce67-4ed7-8357-27b41ea4ddbb None admin] RBAC: Authorizing `identity:get_project(project_id=aacfb4f6ab9e437c93c827214c62015f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:00.265924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461bdb7-ce67-4ed7-8357-27b41ea4ddbb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:00.267541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 595/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:22:00 2022] GET /identity/v3/projects/aacfb4f6ab9e437c93c827214c62015f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:00.273584 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195b305-c75e-4260-8251-01bad47d1060 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:00.371900 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195b305-c75e-4260-8251-01bad47d1060 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:00.381135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:00.406856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d941bc-372a-43e6-8bd8-f42fe122b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:00.407514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d941bc-372a-43e6-8bd8-f42fe122b9b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:00.407797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d941bc-372a-43e6-8bd8-f42fe122b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:00.408075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d941bc-372a-43e6-8bd8-f42fe122b9b1 None admin] PATH_INFO: `/v3/projects/aacfb4f6ab9e437c93c827214c62015f/users/eb9f4425b2164615aaf59e797ae58663/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:00.410009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d941bc-372a-43e6-8bd8-f42fe122b9b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=aacfb4f6ab9e437c93c827214c62015f, user_id=eb9f4425b2164615aaf59e797ae58663, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:00.411430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d941bc-372a-43e6-8bd8-f42fe122b9b1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:00.423664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 558/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:22:00 2022] PUT /identity/v3/projects/aacfb4f6ab9e437c93c827214c62015f/users/eb9f4425b2164615aaf59e797ae58663/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:02.386869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d629ca-1227-4008-b62b-b5e98a2f70ec None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:02.387303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d629ca-1227-4008-b62b-b5e98a2f70ec None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:02.387685 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d629ca-1227-4008-b62b-b5e98a2f70ec None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:02.389048 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 596/1154] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:22:02.394116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c8f24-bb0f-4ad7-bb09-e97ebefb1be4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:02.394531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c8f24-bb0f-4ad7-bb09-e97ebefb1be4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:02.394671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c8f24-bb0f-4ad7-bb09-e97ebefb1be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:02.412958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-539c8f24-bb0f-4ad7-bb09-e97ebefb1be4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:02.414145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-539c8f24-bb0f-4ad7-bb09-e97ebefb1be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:02.478396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 559/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:22:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:22:02.501391 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d629ca-1227-4008-b62b-b5e98a2f70ec None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:02.569651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:02.601629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d629ca-1227-4008-b62b-b5e98a2f70ec None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:02.634386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409d20d-5ccd-433d-81c4-d03869cdd82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:02.635061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409d20d-5ccd-433d-81c4-d03869cdd82b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:02.635348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409d20d-5ccd-433d-81c4-d03869cdd82b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:02.635626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409d20d-5ccd-433d-81c4-d03869cdd82b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:02.645668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409d20d-5ccd-433d-81c4-d03869cdd82b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0409d20d-5ccd-433d-81c4-d03869cdd82b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:22:02.650722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:22:02.651632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:22:02.652864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 597/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:22:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:22:02.657841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c8f24-bb0f-4ad7-bb09-e97ebefb1be4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:02.750374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:02.753951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c8f24-bb0f-4ad7-bb09-e97ebefb1be4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:02.788038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8532dbc-694c-40d1-bb23-13f2566a80df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:02.789215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8532dbc-694c-40d1-bb23-13f2566a80df None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:02.789497 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8532dbc-694c-40d1-bb23-13f2566a80df None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:02.789769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8532dbc-694c-40d1-bb23-13f2566a80df None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:02.790470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8532dbc-694c-40d1-bb23-13f2566a80df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:02.790773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8532dbc-694c-40d1-bb23-13f2566a80df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:02.792121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8532dbc-694c-40d1-bb23-13f2566a80df None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:02.799839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 560/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:22:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:02.806116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409d20d-5ccd-433d-81c4-d03869cdd82b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:02.904758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409d20d-5ccd-433d-81c4-d03869cdd82b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:02.932510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:02.938524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0206b8-445b-44f9-a6dc-67be4c17a58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:02.939154 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0206b8-445b-44f9-a6dc-67be4c17a58a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:02.939436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0206b8-445b-44f9-a6dc-67be4c17a58a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:02.939711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0206b8-445b-44f9-a6dc-67be4c17a58a None admin] PATH_INFO: `/v3/users/eb9f4425b2164615aaf59e797ae58663` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:02.940886 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0206b8-445b-44f9-a6dc-67be4c17a58a None admin] RBAC: Authorizing `identity:get_user(user_id=eb9f4425b2164615aaf59e797ae58663)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:02.942350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0206b8-445b-44f9-a6dc-67be4c17a58a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:02.943921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 598/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:22:02 2022] GET /identity/v3/users/eb9f4425b2164615aaf59e797ae58663 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:02.949967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8532dbc-694c-40d1-bb23-13f2566a80df None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:03.048700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8532dbc-694c-40d1-bb23-13f2566a80df None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:03.080744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4422d-4c66-4ee2-9aa0-a8944aad3903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:03.081378 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4422d-4c66-4ee2-9aa0-a8944aad3903 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:03.081665 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4422d-4c66-4ee2-9aa0-a8944aad3903 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:03.081945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4422d-4c66-4ee2-9aa0-a8944aad3903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:03.109231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:03.148275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4422d-4c66-4ee2-9aa0-a8944aad3903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:03.149839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4422d-4c66-4ee2-9aa0-a8944aad3903 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:03.245694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 561/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:22:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:22:03.251486 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0206b8-445b-44f9-a6dc-67be4c17a58a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:03.349245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0206b8-445b-44f9-a6dc-67be4c17a58a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:03.383376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd3a7b-34fc-4e86-ad20-fd9b2b94622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:03.384008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd3a7b-34fc-4e86-ad20-fd9b2b94622d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:03.384284 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd3a7b-34fc-4e86-ad20-fd9b2b94622d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:03.384552 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd3a7b-34fc-4e86-ad20-fd9b2b94622d None admin] PATH_INFO: `/v3/projects/aacfb4f6ab9e437c93c827214c62015f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:03.385723 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd3a7b-34fc-4e86-ad20-fd9b2b94622d None admin] RBAC: Authorizing `identity:get_project(project_id=aacfb4f6ab9e437c93c827214c62015f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:03.387124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd3a7b-34fc-4e86-ad20-fd9b2b94622d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:03.389024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 599/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:22:03 2022] GET /identity/v3/projects/aacfb4f6ab9e437c93c827214c62015f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:03.395383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4422d-4c66-4ee2-9aa0-a8944aad3903 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:03.454291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:03.494146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4422d-4c66-4ee2-9aa0-a8944aad3903 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:03.527531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6c9c5-4ee2-4624-8d33-dd41b19ac279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:03.528067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6c9c5-4ee2-4624-8d33-dd41b19ac279 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:03.528350 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6c9c5-4ee2-4624-8d33-dd41b19ac279 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:03.528626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6c9c5-4ee2-4624-8d33-dd41b19ac279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:03.529438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6c9c5-4ee2-4624-8d33-dd41b19ac279 None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=aacfb4f6ab9e437c93c827214c62015f, user.id=eb9f4425b2164615aaf59e797ae58663) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:03.529752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6c9c5-4ee2-4624-8d33-dd41b19ac279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:03.531167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6c9c5-4ee2-4624-8d33-dd41b19ac279 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:03.536835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 562/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:22:03 2022] GET /identity/v3/role_assignments?user.id=eb9f4425b2164615aaf59e797ae58663&scope.project.id=aacfb4f6ab9e437c93c827214c62015f&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:05.543005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a87e-5ee3-4b88-bc61-810cdd3f4b72 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:05.543563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a87e-5ee3-4b88-bc61-810cdd3f4b72 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:05.543563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a87e-5ee3-4b88-bc61-810cdd3f4b72 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:05.544860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 600/1162] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:22:05.549944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad91ad-9764-4e7d-abda-35f53f9d2759 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:05.550321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad91ad-9764-4e7d-abda-35f53f9d2759 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:05.550505 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad91ad-9764-4e7d-abda-35f53f9d2759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:05.568744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c6ad91ad-9764-4e7d-abda-35f53f9d2759 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:05.570231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c6ad91ad-9764-4e7d-abda-35f53f9d2759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:05.636022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 563/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:22:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:22:05.658051 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0a87e-5ee3-4b88-bc61-810cdd3f4b72 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:05.722330 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:05.758418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0a87e-5ee3-4b88-bc61-810cdd3f4b72 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:05.791541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22c161-a7a8-4314-9bdc-d5b3c7810110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:05.792138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22c161-a7a8-4314-9bdc-d5b3c7810110 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:05.792419 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22c161-a7a8-4314-9bdc-d5b3c7810110 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:05.792690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22c161-a7a8-4314-9bdc-d5b3c7810110 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:05.857329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22c161-a7a8-4314-9bdc-d5b3c7810110 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:05.858750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22c161-a7a8-4314-9bdc-d5b3c7810110 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:05.918580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:05.952796 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 601/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:22:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:22:05.958739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad91ad-9764-4e7d-abda-35f53f9d2759 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:06.011901 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:06.054899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad91ad-9764-4e7d-abda-35f53f9d2759 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:06.087970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5370d-5042-4fee-ae25-513f2cf68ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:06.088593 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5370d-5042-4fee-ae25-513f2cf68ffc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:06.088874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5370d-5042-4fee-ae25-513f2cf68ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:06.089178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5370d-5042-4fee-ae25-513f2cf68ffc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:06.095637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5370d-5042-4fee-ae25-513f2cf68ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:06.097087 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5370d-5042-4fee-ae25-513f2cf68ffc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a9f5370d-5042-4fee-ae25-513f2cf68ffc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:22:06.108861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:22:06.110141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:22:06.111187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 564/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 6 01:22:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:22:06.115856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22c161-a7a8-4314-9bdc-d5b3c7810110 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:06.211096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22c161-a7a8-4314-9bdc-d5b3c7810110 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:06.244425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb0d4b-5725-46dd-ba49-ab451be3ef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:06.245042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb0d4b-5725-46dd-ba49-ab451be3ef3e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:06.245324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb0d4b-5725-46dd-ba49-ab451be3ef3e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:06.245596 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb0d4b-5725-46dd-ba49-ab451be3ef3e None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:06.246274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb0d4b-5725-46dd-ba49-ab451be3ef3e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:06.246576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb0d4b-5725-46dd-ba49-ab451be3ef3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:06.247922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb0d4b-5725-46dd-ba49-ab451be3ef3e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:06.254704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 602/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Sat Aug 6 01:22:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:08.224283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38e4d-be04-455f-8dfb-89c41c1e4c9c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:08.224845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38e4d-be04-455f-8dfb-89c41c1e4c9c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:08.224845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb38e4d-be04-455f-8dfb-89c41c1e4c9c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:08.226866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 565/1167] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:22:08.231879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae3716-0113-4565-b17d-2537ae7216a2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:08.232254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae3716-0113-4565-b17d-2537ae7216a2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:08.232434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae3716-0113-4565-b17d-2537ae7216a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:08.250059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3aae3716-0113-4565-b17d-2537ae7216a2 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:08.251224 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3aae3716-0113-4565-b17d-2537ae7216a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:08.274503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:08.316487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 603/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:22:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:22:08.339405 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38e4d-be04-455f-8dfb-89c41c1e4c9c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:08.437293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb38e4d-be04-455f-8dfb-89c41c1e4c9c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:08.450699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:08.470473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8f407-4a5a-407a-bd30-280a41c5a569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:08.471077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8f407-4a5a-407a-bd30-280a41c5a569 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:08.471356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8f407-4a5a-407a-bd30-280a41c5a569 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:08.471630 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8f407-4a5a-407a-bd30-280a41c5a569 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:08.472325 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8f407-4a5a-407a-bd30-280a41c5a569 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:08.473784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8f407-4a5a-407a-bd30-280a41c5a569 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:08.489824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 566/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Sat Aug 6 01:22:08 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:10.503225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddae5d-e0fe-4ff7-8d95-f70b2bc30a58 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:10.503732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddae5d-e0fe-4ff7-8d95-f70b2bc30a58 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:10.503842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddae5d-e0fe-4ff7-8d95-f70b2bc30a58 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:10.505153 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 604/1170] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:22:10.510520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25edce7-2718-442c-8f54-c9b1de12c871 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:10.510893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25edce7-2718-442c-8f54-c9b1de12c871 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:10.511080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25edce7-2718-442c-8f54-c9b1de12c871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:10.529484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e25edce7-2718-442c-8f54-c9b1de12c871 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:10.530666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e25edce7-2718-442c-8f54-c9b1de12c871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:10.594568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 567/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:22:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:22:10.617731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddae5d-e0fe-4ff7-8d95-f70b2bc30a58 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:10.717914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddae5d-e0fe-4ff7-8d95-f70b2bc30a58 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:10.751331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a4796-e62d-47e6-a80d-74045d40b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:10.751953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4796-e62d-47e6-a80d-74045d40b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:10.752235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4796-e62d-47e6-a80d-74045d40b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:10.752508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4796-e62d-47e6-a80d-74045d40b8c4 None admin] PATH_INFO: `/v3/domains/419ace093b024da09dacc3f5e090a8d2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:10.763090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a4796-e62d-47e6-a80d-74045d40b8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=419ace093b024da09dacc3f5e090a8d2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:10.764521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a4796-e62d-47e6-a80d-74045d40b8c4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:10.766103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 605/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Sat Aug 6 01:22:10 2022] GET /identity/v3/domains/419ace093b024da09dacc3f5e090a8d2 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:10.771919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25edce7-2718-442c-8f54-c9b1de12c871 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:10.867908 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25edce7-2718-442c-8f54-c9b1de12c871 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:10.870152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:10.901944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbe4f2-ead0-48a2-b87c-17f6646134c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:10.902543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbe4f2-ead0-48a2-b87c-17f6646134c0 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:10.902823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbe4f2-ead0-48a2-b87c-17f6646134c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:10.903096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbe4f2-ead0-48a2-b87c-17f6646134c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:10.903763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbe4f2-ead0-48a2-b87c-17f6646134c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:10.905199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbe4f2-ead0-48a2-b87c-17f6646134c0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:10.929941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 568/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:22:10 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:12.935002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fece0e3-a68a-4885-acc1-816009e2816c None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:12.935528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fece0e3-a68a-4885-acc1-816009e2816c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:12.935528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fece0e3-a68a-4885-acc1-816009e2816c None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:12.936926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 606/1174] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:22:12.941935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ef5fd-fac3-4848-8e7a-d47fcd02886e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:12.942356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ef5fd-fac3-4848-8e7a-d47fcd02886e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:12.942539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ef5fd-fac3-4848-8e7a-d47fcd02886e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:12.961489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c75ef5fd-fac3-4848-8e7a-d47fcd02886e None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:12.962683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c75ef5fd-fac3-4848-8e7a-d47fcd02886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:13.027314 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 569/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:22:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:22:13.051314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fece0e3-a68a-4885-acc1-816009e2816c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:13.073665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:13.150251 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fece0e3-a68a-4885-acc1-816009e2816c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:13.182296 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02048a-1384-48e1-a02e-1ba2b2335536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:13.182920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02048a-1384-48e1-a02e-1ba2b2335536 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:13.183197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02048a-1384-48e1-a02e-1ba2b2335536 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:13.183466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02048a-1384-48e1-a02e-1ba2b2335536 None admin] PATH_INFO: `/v3/domains/419ace093b024da09dacc3f5e090a8d2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:13.184587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02048a-1384-48e1-a02e-1ba2b2335536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=419ace093b024da09dacc3f5e090a8d2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:13.186066 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02048a-1384-48e1-a02e-1ba2b2335536 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:13.187537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 607/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Sat Aug 6 01:22:13 2022] GET /identity/v3/domains/419ace093b024da09dacc3f5e090a8d2 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:13.193249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ef5fd-fac3-4848-8e7a-d47fcd02886e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:13.275983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:13.292181 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ef5fd-fac3-4848-8e7a-d47fcd02886e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:13.325309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a203e9-e72b-4b2b-bf66-d21af6a2ef4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:13.325905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a203e9-e72b-4b2b-bf66-d21af6a2ef4e None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:13.326183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a203e9-e72b-4b2b-bf66-d21af6a2ef4e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:13.326454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a203e9-e72b-4b2b-bf66-d21af6a2ef4e None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:13.327135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a203e9-e72b-4b2b-bf66-d21af6a2ef4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:13.328547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a203e9-e72b-4b2b-bf66-d21af6a2ef4e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:13.349080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 570/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:22:13 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:22:15.356246 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042afcd-7273-463a-8041-b72e21e55952 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:15.356777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042afcd-7273-463a-8041-b72e21e55952 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:15.356777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042afcd-7273-463a-8041-b72e21e55952 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:15.358154 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 608/1178] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:22:15.363162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0c09a-bdf9-4962-82eb-c85272471885 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:15.363596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0c09a-bdf9-4962-82eb-c85272471885 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:15.363721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0c09a-bdf9-4962-82eb-c85272471885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:15.382227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3ee0c09a-bdf9-4962-82eb-c85272471885 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:15.383572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3ee0c09a-bdf9-4962-82eb-c85272471885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:15.447843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 571/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:22:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:22:15.470537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042afcd-7273-463a-8041-b72e21e55952 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:15.559118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:15.576141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042afcd-7273-463a-8041-b72e21e55952 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:15.610357 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a711ed4-0926-4789-a3c2-ce3d153bb64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:15.610923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711ed4-0926-4789-a3c2-ce3d153bb64f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:15.611205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711ed4-0926-4789-a3c2-ce3d153bb64f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:15.611481 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711ed4-0926-4789-a3c2-ce3d153bb64f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:15.622291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a711ed4-0926-4789-a3c2-ce3d153bb64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4a711ed4-0926-4789-a3c2-ce3d153bb64f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:22:15.627141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:22:15.628234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:22:15.629310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 609/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:22:15.635248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0c09a-bdf9-4962-82eb-c85272471885 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:15.703706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:15.732634 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0c09a-bdf9-4962-82eb-c85272471885 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:15.766604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c8268-f64a-47e9-bb21-e9992ff649b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:15.767213 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c8268-f64a-47e9-bb21-e9992ff649b3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:15.767495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c8268-f64a-47e9-bb21-e9992ff649b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:15.767770 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c8268-f64a-47e9-bb21-e9992ff649b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:15.768484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c8268-f64a-47e9-bb21-e9992ff649b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:15.768788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c8268-f64a-47e9-bb21-e9992ff649b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:15.770177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c8268-f64a-47e9-bb21-e9992ff649b3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:15.778613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 572/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:22:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:15.784277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a711ed4-0926-4789-a3c2-ce3d153bb64f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:15.882088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a711ed4-0926-4789-a3c2-ce3d153bb64f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:15.915727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45138b90-2a5f-4f62-9e24-6601ee2ff25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:15.916337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138b90-2a5f-4f62-9e24-6601ee2ff25c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:15.916618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138b90-2a5f-4f62-9e24-6601ee2ff25c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:15.916890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138b90-2a5f-4f62-9e24-6601ee2ff25c None admin] PATH_INFO: `/v3/users/d475c3935ea44ef3930efebc0830d061` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:15.929832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45138b90-2a5f-4f62-9e24-6601ee2ff25c None admin] RBAC: Authorizing `identity:get_user(user_id=d475c3935ea44ef3930efebc0830d061)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:15.931261 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45138b90-2a5f-4f62-9e24-6601ee2ff25c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:15.932830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 610/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:22:15 2022] GET /identity/v3/users/d475c3935ea44ef3930efebc0830d061 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:15.938376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c8268-f64a-47e9-bb21-e9992ff649b3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:16.036813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c8268-f64a-47e9-bb21-e9992ff649b3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:16.069262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60186773-9992-4acc-90b1-c93a3ff1ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:16.069874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60186773-9992-4acc-90b1-c93a3ff1ac03 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:16.070152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60186773-9992-4acc-90b1-c93a3ff1ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:16.070425 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60186773-9992-4acc-90b1-c93a3ff1ac03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:16.072963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:16.135597 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60186773-9992-4acc-90b1-c93a3ff1ac03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:16.137255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60186773-9992-4acc-90b1-c93a3ff1ac03 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:16.230964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 573/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:22:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:22:16.236807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45138b90-2a5f-4f62-9e24-6601ee2ff25c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:16.246158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:16.332802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45138b90-2a5f-4f62-9e24-6601ee2ff25c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:16.366921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aad61-ee19-415a-8d08-beb06d9b372c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:16.367627 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aad61-ee19-415a-8d08-beb06d9b372c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:16.367822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aad61-ee19-415a-8d08-beb06d9b372c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:16.368091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aad61-ee19-415a-8d08-beb06d9b372c None admin] PATH_INFO: `/v3/projects/ac6affed84b2420b98730d33e021ab74` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:16.369272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aad61-ee19-415a-8d08-beb06d9b372c None admin] RBAC: Authorizing `identity:get_project(project_id=ac6affed84b2420b98730d33e021ab74)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:16.371057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aad61-ee19-415a-8d08-beb06d9b372c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:16.372306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 611/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:22:16 2022] GET /identity/v3/projects/ac6affed84b2420b98730d33e021ab74 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:16.378319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60186773-9992-4acc-90b1-c93a3ff1ac03 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:16.410978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:16.476783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60186773-9992-4acc-90b1-c93a3ff1ac03 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:16.510022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac351c-26db-49e5-87c5-623127cd6401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:16.510629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac351c-26db-49e5-87c5-623127cd6401 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:16.510911 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac351c-26db-49e5-87c5-623127cd6401 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:16.511185 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac351c-26db-49e5-87c5-623127cd6401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:16.511966 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac351c-26db-49e5-87c5-623127cd6401 None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=ac6affed84b2420b98730d33e021ab74, user.id=d475c3935ea44ef3930efebc0830d061) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:16.512530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac351c-26db-49e5-87c5-623127cd6401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:16.513975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac351c-26db-49e5-87c5-623127cd6401 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:16.519248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 574/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:22:16 2022] GET /identity/v3/role_assignments?user.id=d475c3935ea44ef3930efebc0830d061&scope.project.id=ac6affed84b2420b98730d33e021ab74&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:18.489292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7835-60a9-4a9e-b0b0-3fda7baea2d2 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:18.489824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7835-60a9-4a9e-b0b0-3fda7baea2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:18.489824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d7835-60a9-4a9e-b0b0-3fda7baea2d2 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:18.491175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 612/1186] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:22:18.496362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae3836-f502-4282-b6cc-6594a88ea111 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:18.496792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae3836-f502-4282-b6cc-6594a88ea111 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:18.496892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae3836-f502-4282-b6cc-6594a88ea111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:18.515397 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cbae3836-f502-4282-b6cc-6594a88ea111 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:18.516583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cbae3836-f502-4282-b6cc-6594a88ea111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:18.581474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 575/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:22:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:22:18.603976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d7835-60a9-4a9e-b0b0-3fda7baea2d2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:18.677733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:18.703435 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d7835-60a9-4a9e-b0b0-3fda7baea2d2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:18.735027 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35fb24-5a7c-4aef-8e8a-534069d98170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:18.735645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35fb24-5a7c-4aef-8e8a-534069d98170 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:18.735923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35fb24-5a7c-4aef-8e8a-534069d98170 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:18.736191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35fb24-5a7c-4aef-8e8a-534069d98170 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:18.746498 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35fb24-5a7c-4aef-8e8a-534069d98170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-cc35fb24-5a7c-4aef-8e8a-534069d98170 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:22:18.751275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:22:18.752430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:22:18.753803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 613/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:22:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:22:18.759234 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae3836-f502-4282-b6cc-6594a88ea111 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:18.785897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:18.855422 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae3836-f502-4282-b6cc-6594a88ea111 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:18.888443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8555550-7e90-4b22-afe0-b6fac3b686c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:18.889071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8555550-7e90-4b22-afe0-b6fac3b686c5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:18.889351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8555550-7e90-4b22-afe0-b6fac3b686c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:18.889621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8555550-7e90-4b22-afe0-b6fac3b686c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:18.890323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8555550-7e90-4b22-afe0-b6fac3b686c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:18.890625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8555550-7e90-4b22-afe0-b6fac3b686c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:18.891970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8555550-7e90-4b22-afe0-b6fac3b686c5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:18.900246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 576/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:22:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:18.906061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35fb24-5a7c-4aef-8e8a-534069d98170 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:19.003707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35fb24-5a7c-4aef-8e8a-534069d98170 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:19.036758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76856f9f-b309-4d38-b68c-1853ae9ef742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:19.037986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856f9f-b309-4d38-b68c-1853ae9ef742 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:19.038301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856f9f-b309-4d38-b68c-1853ae9ef742 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:19.038568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856f9f-b309-4d38-b68c-1853ae9ef742 None admin] PATH_INFO: `/v3/users/d475c3935ea44ef3930efebc0830d061` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:19.039707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76856f9f-b309-4d38-b68c-1853ae9ef742 None admin] RBAC: Authorizing `identity:get_user(user_id=d475c3935ea44ef3930efebc0830d061)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:19.041144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76856f9f-b309-4d38-b68c-1853ae9ef742 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:19.042681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 614/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:22:18 2022] GET /identity/v3/users/d475c3935ea44ef3930efebc0830d061 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:19.048217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8555550-7e90-4b22-afe0-b6fac3b686c5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:19.136386 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:19.146637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8555550-7e90-4b22-afe0-b6fac3b686c5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:19.179416 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f119f02-c24e-4ae5-a347-d71c01d09946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:19.180049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f119f02-c24e-4ae5-a347-d71c01d09946 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:19.180335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f119f02-c24e-4ae5-a347-d71c01d09946 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:19.180610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f119f02-c24e-4ae5-a347-d71c01d09946 None admin] PATH_INFO: `/v3/projects/ac6affed84b2420b98730d33e021ab74` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:19.181808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f119f02-c24e-4ae5-a347-d71c01d09946 None admin] RBAC: Authorizing `identity:get_project(project_id=ac6affed84b2420b98730d33e021ab74)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:19.183227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f119f02-c24e-4ae5-a347-d71c01d09946 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:19.184868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 577/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:22:19 2022] GET /identity/v3/projects/ac6affed84b2420b98730d33e021ab74 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:19.190675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76856f9f-b309-4d38-b68c-1853ae9ef742 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:19.194070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:19.287641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76856f9f-b309-4d38-b68c-1853ae9ef742 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:19.319887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79fe21-53ed-4d61-a583-999231ea7a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:19.320530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79fe21-53ed-4d61-a583-999231ea7a14 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:19.320814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79fe21-53ed-4d61-a583-999231ea7a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:19.321108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79fe21-53ed-4d61-a583-999231ea7a14 None admin] PATH_INFO: `/v3/projects/ac6affed84b2420b98730d33e021ab74/users/d475c3935ea44ef3930efebc0830d061/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:19.322994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79fe21-53ed-4d61-a583-999231ea7a14 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac6affed84b2420b98730d33e021ab74, user_id=d475c3935ea44ef3930efebc0830d061, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:19.324400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79fe21-53ed-4d61-a583-999231ea7a14 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:19.336895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 615/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:22:19 2022] PUT /identity/v3/projects/ac6affed84b2420b98730d33e021ab74/users/d475c3935ea44ef3930efebc0830d061/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:21.320551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c50f5-5eec-40e0-a9eb-9eb94743f97c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.321110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c50f5-5eec-40e0-a9eb-9eb94743f97c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.321235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c50f5-5eec-40e0-a9eb-9eb94743f97c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.322464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 578/1193] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:22:21.327643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146567-16d1-4702-a748-d215205782c9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.328061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146567-16d1-4702-a748-d215205782c9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.328170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d146567-16d1-4702-a748-d215205782c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.346601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3d146567-16d1-4702-a748-d215205782c9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:21.347768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3d146567-16d1-4702-a748-d215205782c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:21.404254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:21.415728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 616/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:22:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:22:21.438956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c50f5-5eec-40e0-a9eb-9eb94743f97c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:21.541164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c50f5-5eec-40e0-a9eb-9eb94743f97c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:21.574637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b96b2b-1aa2-4d25-b1cc-fe090891e746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:21.575212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b96b2b-1aa2-4d25-b1cc-fe090891e746 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.575495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b96b2b-1aa2-4d25-b1cc-fe090891e746 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.575769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b96b2b-1aa2-4d25-b1cc-fe090891e746 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.586542 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b96b2b-1aa2-4d25-b1cc-fe090891e746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-93b96b2b-1aa2-4d25-b1cc-fe090891e746 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:22:21.591395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:22:21.592486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:22:21.593574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 579/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:22:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:22:21.598608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146567-16d1-4702-a748-d215205782c9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:21.695681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d146567-16d1-4702-a748-d215205782c9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:21.728454 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f756dd-c530-4093-922d-e01a2ae7ce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:21.729089 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f756dd-c530-4093-922d-e01a2ae7ce87 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.729374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f756dd-c530-4093-922d-e01a2ae7ce87 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.729653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f756dd-c530-4093-922d-e01a2ae7ce87 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.730368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f756dd-c530-4093-922d-e01a2ae7ce87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:21.730675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f756dd-c530-4093-922d-e01a2ae7ce87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:21.732038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f756dd-c530-4093-922d-e01a2ae7ce87 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:21.739781 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 617/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:22:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:21.746177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b96b2b-1aa2-4d25-b1cc-fe090891e746 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:21.766291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:21.845644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b96b2b-1aa2-4d25-b1cc-fe090891e746 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:21.877959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227881c-5cec-4b31-82b4-594f33d054ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:21.878583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227881c-5cec-4b31-82b4-594f33d054ba None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.878868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227881c-5cec-4b31-82b4-594f33d054ba None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.879145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227881c-5cec-4b31-82b4-594f33d054ba None admin] PATH_INFO: `/v3/users/d475c3935ea44ef3930efebc0830d061` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.880293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227881c-5cec-4b31-82b4-594f33d054ba None admin] RBAC: Authorizing `identity:get_user(user_id=d475c3935ea44ef3930efebc0830d061)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:21.882331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227881c-5cec-4b31-82b4-594f33d054ba None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:21.883923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 580/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Sat Aug 6 01:22:21 2022] GET /identity/v3/users/d475c3935ea44ef3930efebc0830d061 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:21.889862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f756dd-c530-4093-922d-e01a2ae7ce87 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:21.943938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:21.987407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f756dd-c530-4093-922d-e01a2ae7ce87 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.020083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b1df3-fa93-4a19-a79d-7094dc56f3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:22.020689 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b1df3-fa93-4a19-a79d-7094dc56f3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.021006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b1df3-fa93-4a19-a79d-7094dc56f3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.021286 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b1df3-fa93-4a19-a79d-7094dc56f3c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.086951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b1df3-fa93-4a19-a79d-7094dc56f3c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:22.088389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b1df3-fa93-4a19-a79d-7094dc56f3c3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:22.139733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:22.184137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 618/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:22:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:22:22.189970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227881c-5cec-4b31-82b4-594f33d054ba None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:22.274123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:22.290120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227881c-5cec-4b31-82b4-594f33d054ba None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.322802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489bce-af67-45fb-92be-3bd20847118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:22.323428 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489bce-af67-45fb-92be-3bd20847118a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.323711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489bce-af67-45fb-92be-3bd20847118a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.323989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489bce-af67-45fb-92be-3bd20847118a None admin] PATH_INFO: `/v3/projects/ac6affed84b2420b98730d33e021ab74` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.325159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50489bce-af67-45fb-92be-3bd20847118a None admin] RBAC: Authorizing `identity:get_project(project_id=ac6affed84b2420b98730d33e021ab74)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:22.326585 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50489bce-af67-45fb-92be-3bd20847118a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:22.328220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 581/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Sat Aug 6 01:22:22 2022] GET /identity/v3/projects/ac6affed84b2420b98730d33e021ab74 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:22.334410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b1df3-fa93-4a19-a79d-7094dc56f3c3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:22.432112 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b1df3-fa93-4a19-a79d-7094dc56f3c3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.465308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cb53a-3545-487f-bb4c-bf01466ab8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:22.465909 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cb53a-3545-487f-bb4c-bf01466ab8ed None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.466191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cb53a-3545-487f-bb4c-bf01466ab8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.466465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cb53a-3545-487f-bb4c-bf01466ab8ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.467249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cb53a-3545-487f-bb4c-bf01466ab8ed None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=ac6affed84b2420b98730d33e021ab74, user.id=d475c3935ea44ef3930efebc0830d061) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:22.467556 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cb53a-3545-487f-bb4c-bf01466ab8ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:22.468987 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cb53a-3545-487f-bb4c-bf01466ab8ed None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:22.475146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 619/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:22:22 2022] GET /identity/v3/role_assignments?user.id=d475c3935ea44ef3930efebc0830d061&scope.project.id=ac6affed84b2420b98730d33e021ab74&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:32.318782 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=23 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:32.472012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:17.448851 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c3368-dcf1-4f1d-b53c-a9889c356eed None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:17.449542 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c3368-dcf1-4f1d-b53c-a9889c356eed None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:17.449542 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c3368-dcf1-4f1d-b53c-a9889c356eed None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:17.450773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 582/1201] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:17.457935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90263dc1-315e-41d8-9422-207aaa8c19f8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:17.458414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90263dc1-315e-41d8-9422-207aaa8c19f8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:17.458549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90263dc1-315e-41d8-9422-207aaa8c19f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:17.480337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-90263dc1-315e-41d8-9422-207aaa8c19f8 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:17.483830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-90263dc1-315e-41d8-9422-207aaa8c19f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:17.574928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 620/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:23:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:23:17.602662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c3368-dcf1-4f1d-b53c-a9889c356eed None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:17.724160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c3368-dcf1-4f1d-b53c-a9889c356eed None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:17.778783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd03da7-a360-42f2-b9c8-b901b7aa1003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:17.779444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd03da7-a360-42f2-b9c8-b901b7aa1003 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:17.779861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd03da7-a360-42f2-b9c8-b901b7aa1003 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:17.780224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd03da7-a360-42f2-b9c8-b901b7aa1003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:17.796683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd03da7-a360-42f2-b9c8-b901b7aa1003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:17.798367 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd03da7-a360-42f2-b9c8-b901b7aa1003 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2bd03da7-a360-42f2-b9c8-b901b7aa1003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:17.815679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:17.817143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:17.821596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:17.821596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:17.821596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:17.821596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:17.821596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 583/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:23:17.826184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90263dc1-315e-41d8-9422-207aaa8c19f8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:17.964055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90263dc1-315e-41d8-9422-207aaa8c19f8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:18.010980 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:18.017482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f3099-df48-48d4-b13f-2163e08f6e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:18.018229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f3099-df48-48d4-b13f-2163e08f6e00 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:18.018521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f3099-df48-48d4-b13f-2163e08f6e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:18.018819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f3099-df48-48d4-b13f-2163e08f6e00 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:18.019616 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f3099-df48-48d4-b13f-2163e08f6e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:18.019991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f3099-df48-48d4-b13f-2163e08f6e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:18.021736 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f3099-df48-48d4-b13f-2163e08f6e00 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:18.042807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 621/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:23:18.049206 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd03da7-a360-42f2-b9c8-b901b7aa1003 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:18.118929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:18.180800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd03da7-a360-42f2-b9c8-b901b7aa1003 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:18.240082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485793bd-73b4-41ec-b0c5-204da33c48ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:18.240710 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485793bd-73b4-41ec-b0c5-204da33c48ca None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:18.241024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485793bd-73b4-41ec-b0c5-204da33c48ca None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:18.241302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485793bd-73b4-41ec-b0c5-204da33c48ca None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:18.242003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485793bd-73b4-41ec-b0c5-204da33c48ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:18.243444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485793bd-73b4-41ec-b0c5-204da33c48ca None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:18.269632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 584/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Sat Aug 6 01:23:18 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:23:20.555655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb53c4d-a304-4a71-8526-c4600fca5ddb None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:20.556210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb53c4d-a304-4a71-8526-c4600fca5ddb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:20.556210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb53c4d-a304-4a71-8526-c4600fca5ddb None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:20.557610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 622/1206] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:20.563156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18311-f3a7-4c29-8c65-1218fbb7b963 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:20.563605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18311-f3a7-4c29-8c65-1218fbb7b963 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:20.563705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18311-f3a7-4c29-8c65-1218fbb7b963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:20.583370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-09a18311-f3a7-4c29-8c65-1218fbb7b963 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:20.584551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-09a18311-f3a7-4c29-8c65-1218fbb7b963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:20.665437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 585/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:23:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:23:20.687891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb53c4d-a304-4a71-8526-c4600fca5ddb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:20.811430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb53c4d-a304-4a71-8526-c4600fca5ddb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:20.850412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f2606-cbc4-4d1c-97c0-f1a49241559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:20.851093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f2606-cbc4-4d1c-97c0-f1a49241559a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:20.851448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f2606-cbc4-4d1c-97c0-f1a49241559a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:20.851730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f2606-cbc4-4d1c-97c0-f1a49241559a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:20.863864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f2606-cbc4-4d1c-97c0-f1a49241559a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a04f2606-cbc4-4d1c-97c0-f1a49241559a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:23:20.868785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:20.869894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:20.871377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 623/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:23:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:20.876154 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a18311-f3a7-4c29-8c65-1218fbb7b963 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:20.922410 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:20.992773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a18311-f3a7-4c29-8c65-1218fbb7b963 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:21.038883 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125ffa0-dd95-4d08-b52f-36a955d51a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:21.039516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125ffa0-dd95-4d08-b52f-36a955d51a1e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:21.039805 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125ffa0-dd95-4d08-b52f-36a955d51a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:21.040080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125ffa0-dd95-4d08-b52f-36a955d51a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:21.040805 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125ffa0-dd95-4d08-b52f-36a955d51a1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:21.041139 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125ffa0-dd95-4d08-b52f-36a955d51a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:21.042506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125ffa0-dd95-4d08-b52f-36a955d51a1e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:21.052455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 586/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:23:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:21.058289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f2606-cbc4-4d1c-97c0-f1a49241559a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:21.119699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:21.177448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f2606-cbc4-4d1c-97c0-f1a49241559a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:21.216244 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43f064-6ab7-43d1-83d6-99960e6520e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:21.216915 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f064-6ab7-43d1-83d6-99960e6520e3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:21.217249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f064-6ab7-43d1-83d6-99960e6520e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:21.217529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f064-6ab7-43d1-83d6-99960e6520e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:21.229392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43f064-6ab7-43d1-83d6-99960e6520e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:21.230844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43f064-6ab7-43d1-83d6-99960e6520e3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-7f43f064-6ab7-43d1-83d6-99960e6520e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:21.248094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:21.249343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:21.250469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:21.250469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:21.250469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:21.250469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:21.250469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 624/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:21.257543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125ffa0-dd95-4d08-b52f-36a955d51a1e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:21.366275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:21.369717 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125ffa0-dd95-4d08-b52f-36a955d51a1e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:21.412980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb25b9-2b4b-4fc1-8a91-33a7fa0fba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:21.413662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb25b9-2b4b-4fc1-8a91-33a7fa0fba19 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:21.413959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb25b9-2b4b-4fc1-8a91-33a7fa0fba19 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:21.414226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb25b9-2b4b-4fc1-8a91-33a7fa0fba19 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:21.414926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb25b9-2b4b-4fc1-8a91-33a7fa0fba19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:21.415237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb25b9-2b4b-4fc1-8a91-33a7fa0fba19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:21.416617 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb25b9-2b4b-4fc1-8a91-33a7fa0fba19 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:21.435696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 587/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:21.442465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43f064-6ab7-43d1-83d6-99960e6520e3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:21.569732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43f064-6ab7-43d1-83d6-99960e6520e3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:21.571341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:21.607915 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8c59a-8c03-4ead-8372-45239ac9b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:21.608626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c59a-8c03-4ead-8372-45239ac9b9ad None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:21.608745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c59a-8c03-4ead-8372-45239ac9b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:21.609045 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c59a-8c03-4ead-8372-45239ac9b9ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:21.618965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8c59a-8c03-4ead-8372-45239ac9b9ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:21.620445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8c59a-8c03-4ead-8372-45239ac9b9ad None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-38f8c59a-8c03-4ead-8372-45239ac9b9ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:23:21.633590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:21.634791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:21.636242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:21.636242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:21.636242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:23:21.636242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:23:21.636242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:23:21.636242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:23:21.636242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:23:21.636242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:23:21.636242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:23:21.636242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:21.639754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 625/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:21.641058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb25b9-2b4b-4fc1-8a91-33a7fa0fba19 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:21.753243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb25b9-2b4b-4fc1-8a91-33a7fa0fba19 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:21.795018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8b4e7-12a5-4a93-ab18-a3c41e48e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:21.795635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8b4e7-12a5-4a93-ab18-a3c41e48e922 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:21.795935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8b4e7-12a5-4a93-ab18-a3c41e48e922 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:21.796186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8b4e7-12a5-4a93-ab18-a3c41e48e922 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:21.797054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8b4e7-12a5-4a93-ab18-a3c41e48e922 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:21.797362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8b4e7-12a5-4a93-ab18-a3c41e48e922 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:21.798778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8b4e7-12a5-4a93-ab18-a3c41e48e922 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:21.825293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 588/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Sat Aug 6 01:23:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:21.826736 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8c59a-8c03-4ead-8372-45239ac9b9ad None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:21.936632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8c59a-8c03-4ead-8372-45239ac9b9ad None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:21.974825 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce9132-5213-4f76-938b-a679d9f6cd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:21.975851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce9132-5213-4f76-938b-a679d9f6cd1a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:21.976176 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce9132-5213-4f76-938b-a679d9f6cd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:21.976513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce9132-5213-4f76-938b-a679d9f6cd1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:22.013810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:22.066563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce9132-5213-4f76-938b-a679d9f6cd1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:22.068620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce9132-5213-4f76-938b-a679d9f6cd1a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:22.191313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 626/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:23:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:23:22.196987 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8b4e7-12a5-4a93-ab18-a3c41e48e922 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:22.217051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:22.314379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8b4e7-12a5-4a93-ab18-a3c41e48e922 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:22.357443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694b844-1724-4feb-851d-0d921dc8eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:22.358246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694b844-1724-4feb-851d-0d921dc8eada None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:22.358499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694b844-1724-4feb-851d-0d921dc8eada None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:22.358905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694b844-1724-4feb-851d-0d921dc8eada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:22.372895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694b844-1724-4feb-851d-0d921dc8eada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:22.374710 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694b844-1724-4feb-851d-0d921dc8eada None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b694b844-1724-4feb-851d-0d921dc8eada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:22.392944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:22.395017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:22.396131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:22.396131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:22.396131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:22.396131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:22.399734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 589/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:22.400829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce9132-5213-4f76-938b-a679d9f6cd1a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:22.477708 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:22.526309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce9132-5213-4f76-938b-a679d9f6cd1a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:22.566898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e86f5a-f0ed-4624-8393-f715d30c1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:22.567460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86f5a-f0ed-4624-8393-f715d30c1748 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:22.567749 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86f5a-f0ed-4624-8393-f715d30c1748 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:22.568076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86f5a-f0ed-4624-8393-f715d30c1748 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:22.569030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e86f5a-f0ed-4624-8393-f715d30c1748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:22.569342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e86f5a-f0ed-4624-8393-f715d30c1748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:22.571738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e86f5a-f0ed-4624-8393-f715d30c1748 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:22.583718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 627/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:22.589734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694b844-1724-4feb-851d-0d921dc8eada None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:22.667406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:22.702692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694b844-1724-4feb-851d-0d921dc8eada None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:22.739572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a7a3c-e461-4d36-9e4d-40b461f0cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:22.740264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a7a3c-e461-4d36-9e4d-40b461f0cb53 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:22.740547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a7a3c-e461-4d36-9e4d-40b461f0cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:22.740823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a7a3c-e461-4d36-9e4d-40b461f0cb53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:22.747857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a7a3c-e461-4d36-9e4d-40b461f0cb53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:22.749455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a7a3c-e461-4d36-9e4d-40b461f0cb53 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ee1a7a3c-e461-4d36-9e4d-40b461f0cb53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:23:22.762870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:22.763850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:22.764804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:23:22.764804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:23:22.764804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:23:22.764804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:23:22.764804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:23:22.764804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:23:22.764804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:23:22.764804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:22.769382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 590/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:23:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:22.770715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e86f5a-f0ed-4624-8393-f715d30c1748 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:22.878988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e86f5a-f0ed-4624-8393-f715d30c1748 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:22.907148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:22.921824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6ed7d-aa45-4aff-a431-89d18c4aa6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:22.922485 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6ed7d-aa45-4aff-a431-89d18c4aa6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:22.922825 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6ed7d-aa45-4aff-a431-89d18c4aa6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:22.923112 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6ed7d-aa45-4aff-a431-89d18c4aa6e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:22.923955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6ed7d-aa45-4aff-a431-89d18c4aa6e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:22.924233 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6ed7d-aa45-4aff-a431-89d18c4aa6e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:22.926378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6ed7d-aa45-4aff-a431-89d18c4aa6e8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:22.939849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 628/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:23:22.946357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a7a3c-e461-4d36-9e4d-40b461f0cb53 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:23.083933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a7a3c-e461-4d36-9e4d-40b461f0cb53 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:23.116752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:23.124180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68346d6c-22dc-4f26-9bc1-3b5a1932ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:23.124959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68346d6c-22dc-4f26-9bc1-3b5a1932ff80 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:23.125358 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68346d6c-22dc-4f26-9bc1-3b5a1932ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:23.125635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68346d6c-22dc-4f26-9bc1-3b5a1932ff80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:23.126531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68346d6c-22dc-4f26-9bc1-3b5a1932ff80 None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=fc1bd453c1114da4a5d9aa543bf1ff32) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:23.126871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68346d6c-22dc-4f26-9bc1-3b5a1932ff80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:23.128859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68346d6c-22dc-4f26-9bc1-3b5a1932ff80 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:23.145201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 591/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:23:22 2022] GET /identity/v3/role_assignments?user.id=fc1bd453c1114da4a5d9aa543bf1ff32&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:25.281973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889edd-f7f2-4385-b822-9090d218f2e5 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:25.282580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889edd-f7f2-4385-b822-9090d218f2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:25.282580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889edd-f7f2-4385-b822-9090d218f2e5 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:25.283883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 629/1220] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:25.290357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dff78-922d-4dff-b063-fc8851d7cf46 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:25.290785 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dff78-922d-4dff-b063-fc8851d7cf46 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:25.290949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dff78-922d-4dff-b063-fc8851d7cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:25.309963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1b1dff78-922d-4dff-b063-fc8851d7cf46 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:25.311116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1b1dff78-922d-4dff-b063-fc8851d7cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:25.389716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 592/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:23:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:23:25.412204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889edd-f7f2-4385-b822-9090d218f2e5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:25.526052 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889edd-f7f2-4385-b822-9090d218f2e5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:25.566376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4181a5-44f7-447e-937c-6bf6681575cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:25.567016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4181a5-44f7-447e-937c-6bf6681575cc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:25.567361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4181a5-44f7-447e-937c-6bf6681575cc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:25.567640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4181a5-44f7-447e-937c-6bf6681575cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:25.578711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4181a5-44f7-447e-937c-6bf6681575cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5e4181a5-44f7-447e-937c-6bf6681575cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:23:25.584032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:25.585209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:25.586059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 630/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:23:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:25.591833 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dff78-922d-4dff-b063-fc8851d7cf46 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:25.707491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dff78-922d-4dff-b063-fc8851d7cf46 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:25.733286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:25.744689 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97826c-e2d5-4131-b63a-00a0e4499c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:25.745345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97826c-e2d5-4131-b63a-00a0e4499c03 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:25.745636 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97826c-e2d5-4131-b63a-00a0e4499c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:25.745934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97826c-e2d5-4131-b63a-00a0e4499c03 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:25.746920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97826c-e2d5-4131-b63a-00a0e4499c03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:25.747232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97826c-e2d5-4131-b63a-00a0e4499c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:25.749049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97826c-e2d5-4131-b63a-00a0e4499c03 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:25.759359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 593/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:23:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:25.765432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4181a5-44f7-447e-937c-6bf6681575cc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:25.813274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:25.879718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4181a5-44f7-447e-937c-6bf6681575cc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:25.914091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37361d82-0147-41b9-bfd9-67ad179d1d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:25.914728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37361d82-0147-41b9-bfd9-67ad179d1d66 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:25.915013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37361d82-0147-41b9-bfd9-67ad179d1d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:25.915286 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37361d82-0147-41b9-bfd9-67ad179d1d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:25.927091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37361d82-0147-41b9-bfd9-67ad179d1d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:25.928740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37361d82-0147-41b9-bfd9-67ad179d1d66 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-37361d82-0147-41b9-bfd9-67ad179d1d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:25.945829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:25.946933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:25.947878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:25.947878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:25.947878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:25.947878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:25.947878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 631/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:25.952848 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97826c-e2d5-4131-b63a-00a0e4499c03 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:26.064785 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97826c-e2d5-4131-b63a-00a0e4499c03 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:26.099840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227d7ff-657c-4d68-b664-c3da1525b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:26.100458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227d7ff-657c-4d68-b664-c3da1525b03e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:26.100737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227d7ff-657c-4d68-b664-c3da1525b03e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:26.101038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227d7ff-657c-4d68-b664-c3da1525b03e None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:26.101728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227d7ff-657c-4d68-b664-c3da1525b03e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:26.102030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227d7ff-657c-4d68-b664-c3da1525b03e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:26.103375 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227d7ff-657c-4d68-b664-c3da1525b03e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:26.116030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 594/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:26.121652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37361d82-0147-41b9-bfd9-67ad179d1d66 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:26.222029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:26.229034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37361d82-0147-41b9-bfd9-67ad179d1d66 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:26.267304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f8169-88a7-4a3e-8b23-8d2769cbadca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:26.268042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f8169-88a7-4a3e-8b23-8d2769cbadca None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:26.268357 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f8169-88a7-4a3e-8b23-8d2769cbadca None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:26.269157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f8169-88a7-4a3e-8b23-8d2769cbadca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:26.278041 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f8169-88a7-4a3e-8b23-8d2769cbadca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:26.279653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f8169-88a7-4a3e-8b23-8d2769cbadca None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3c9f8169-88a7-4a3e-8b23-8d2769cbadca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:23:26.293232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:26.294787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:26.296184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:26.296184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:26.296184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:23:26.296184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:23:26.296184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:23:26.296184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:23:26.296184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:23:26.296184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:23:26.296184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:23:26.296184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:26.296184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 632/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:26.301055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227d7ff-657c-4d68-b664-c3da1525b03e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:26.353992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:26.410120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227d7ff-657c-4d68-b664-c3da1525b03e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:26.446894 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed40239-a970-4877-81e2-e2fc9fc5d52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:26.447607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40239-a970-4877-81e2-e2fc9fc5d52f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:26.447902 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40239-a970-4877-81e2-e2fc9fc5d52f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:26.448249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40239-a970-4877-81e2-e2fc9fc5d52f None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:26.449079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed40239-a970-4877-81e2-e2fc9fc5d52f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:26.449389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed40239-a970-4877-81e2-e2fc9fc5d52f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:26.450802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed40239-a970-4877-81e2-e2fc9fc5d52f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:26.474824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 595/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Sat Aug 6 01:23:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:26.475917 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f8169-88a7-4a3e-8b23-8d2769cbadca None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:26.583148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f8169-88a7-4a3e-8b23-8d2769cbadca None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:26.617968 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7dc6ab-ed80-41f0-a28d-a3cee022429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:26.618642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dc6ab-ed80-41f0-a28d-a3cee022429d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:26.618903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dc6ab-ed80-41f0-a28d-a3cee022429d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:26.619163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dc6ab-ed80-41f0-a28d-a3cee022429d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:26.632360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dc6ab-ed80-41f0-a28d-a3cee022429d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:26.633915 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dc6ab-ed80-41f0-a28d-a3cee022429d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-8c7dc6ab-ed80-41f0-a28d-a3cee022429d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:26.651374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:26.652504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:26.653595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:26.653595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:26.653595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:26.653595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:26.653595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 633/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:26.658693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed40239-a970-4877-81e2-e2fc9fc5d52f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:26.771777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed40239-a970-4877-81e2-e2fc9fc5d52f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:26.774341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:26.810014 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cea4af-bdfb-4c90-9aca-410b290a57ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:26.810627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cea4af-bdfb-4c90-9aca-410b290a57ad None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:26.810912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cea4af-bdfb-4c90-9aca-410b290a57ad None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:26.811184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cea4af-bdfb-4c90-9aca-410b290a57ad None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:26.811871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cea4af-bdfb-4c90-9aca-410b290a57ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:26.812172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cea4af-bdfb-4c90-9aca-410b290a57ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:26.813580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cea4af-bdfb-4c90-9aca-410b290a57ad None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:26.826677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 596/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:26.832754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7dc6ab-ed80-41f0-a28d-a3cee022429d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:26.843932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:26.951060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7dc6ab-ed80-41f0-a28d-a3cee022429d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:26.996956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965262ec-c816-4811-96b7-67075716e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:26.997807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965262ec-c816-4811-96b7-67075716e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:26.997999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965262ec-c816-4811-96b7-67075716e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:26.998281 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965262ec-c816-4811-96b7-67075716e1fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:27.006238 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965262ec-c816-4811-96b7-67075716e1fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:27.007940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965262ec-c816-4811-96b7-67075716e1fe None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-965262ec-c816-4811-96b7-67075716e1fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:23:27.020888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:27.022126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:27.023424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:23:27.023424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:23:27.023424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:23:27.023424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:23:27.023424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:23:27.023424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:23:27.023424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:23:27.023424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:27.023424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 634/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:23:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:27.028107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cea4af-bdfb-4c90-9aca-410b290a57ad None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:27.136189 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cea4af-bdfb-4c90-9aca-410b290a57ad None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:27.173873 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90880f1-d525-46d7-a7d9-662ef2d0f46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:27.174587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90880f1-d525-46d7-a7d9-662ef2d0f46c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:27.175391 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90880f1-d525-46d7-a7d9-662ef2d0f46c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:27.175711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90880f1-d525-46d7-a7d9-662ef2d0f46c None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:27.176505 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90880f1-d525-46d7-a7d9-662ef2d0f46c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:27.176815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90880f1-d525-46d7-a7d9-662ef2d0f46c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:27.178272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90880f1-d525-46d7-a7d9-662ef2d0f46c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:27.196176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 597/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:23:27.197383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965262ec-c816-4811-96b7-67075716e1fe None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:27.275702 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:27.319637 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965262ec-c816-4811-96b7-67075716e1fe None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:27.360011 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa837df4-c879-4365-bcad-0d6f3c373e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:27.360693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa837df4-c879-4365-bcad-0d6f3c373e5f None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:27.361010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa837df4-c879-4365-bcad-0d6f3c373e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:27.361292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa837df4-c879-4365-bcad-0d6f3c373e5f None admin] PATH_INFO: `/v3/projects/c344ed6bac754173af05207b5f444dca/users/fc1bd453c1114da4a5d9aa543bf1ff32/roles/f053004b279b4e95a6123572360bd655` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:27.381362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa837df4-c879-4365-bcad-0d6f3c373e5f None admin] RBAC: Authorizing `identity:create_grant(project_id=c344ed6bac754173af05207b5f444dca, user_id=fc1bd453c1114da4a5d9aa543bf1ff32, role_id=f053004b279b4e95a6123572360bd655)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:27.382897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa837df4-c879-4365-bcad-0d6f3c373e5f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:27.397203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 635/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:23:27 2022] PUT /identity/v3/projects/c344ed6bac754173af05207b5f444dca/users/fc1bd453c1114da4a5d9aa543bf1ff32/roles/f053004b279b4e95a6123572360bd655 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:23:29.606660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bd0a7-8ea4-4703-bcb3-d2ea9f7f6a0d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:29.607211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bd0a7-8ea4-4703-bcb3-d2ea9f7f6a0d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:29.607211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bd0a7-8ea4-4703-bcb3-d2ea9f7f6a0d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:29.608572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 598/1233] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:29.615842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50704b2f-f002-454c-8c91-67facfbcdaec None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:29.616299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50704b2f-f002-454c-8c91-67facfbcdaec None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:29.616526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50704b2f-f002-454c-8c91-67facfbcdaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:29.637931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-50704b2f-f002-454c-8c91-67facfbcdaec None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:29.639222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-50704b2f-f002-454c-8c91-67facfbcdaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:29.713428 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 636/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:23:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:23:29.742559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bd0a7-8ea4-4703-bcb3-d2ea9f7f6a0d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:29.770471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:29.857534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bd0a7-8ea4-4703-bcb3-d2ea9f7f6a0d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:29.894246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5dbd-cfe0-4923-8540-9ba9bff5b64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:29.894856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5dbd-cfe0-4923-8540-9ba9bff5b64b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:29.895113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5dbd-cfe0-4923-8540-9ba9bff5b64b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:29.895398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5dbd-cfe0-4923-8540-9ba9bff5b64b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:29.906072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b5dbd-cfe0-4923-8540-9ba9bff5b64b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-137b5dbd-cfe0-4923-8540-9ba9bff5b64b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:23:29.911131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:29.912248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:29.918158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 599/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Sat Aug 6 01:23:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:29.918902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50704b2f-f002-454c-8c91-67facfbcdaec None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:29.969141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:30.035726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50704b2f-f002-454c-8c91-67facfbcdaec None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:30.070479 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6f43-bad1-4cc4-b5a9-b64cb50e04a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:30.071094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6f43-bad1-4cc4-b5a9-b64cb50e04a8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:30.071372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6f43-bad1-4cc4-b5a9-b64cb50e04a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:30.071642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6f43-bad1-4cc4-b5a9-b64cb50e04a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:30.072348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f6f43-bad1-4cc4-b5a9-b64cb50e04a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:30.072647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f6f43-bad1-4cc4-b5a9-b64cb50e04a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:30.074038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f6f43-bad1-4cc4-b5a9-b64cb50e04a8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:30.082676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 637/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Sat Aug 6 01:23:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:23:30.088426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5dbd-cfe0-4923-8540-9ba9bff5b64b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:30.180586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:30.198608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5dbd-cfe0-4923-8540-9ba9bff5b64b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:30.234653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ddb27-be4b-4878-9529-6f934fc647db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:30.235343 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ddb27-be4b-4878-9529-6f934fc647db None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:30.235648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ddb27-be4b-4878-9529-6f934fc647db None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:30.235911 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ddb27-be4b-4878-9529-6f934fc647db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:30.247179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ddb27-be4b-4878-9529-6f934fc647db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:30.248725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ddb27-be4b-4878-9529-6f934fc647db None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-494ddb27-be4b-4878-9529-6f934fc647db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:30.264721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:30.265852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:30.272888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:30.272888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:30.272888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:30.272888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:30.272888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 600/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:30.273291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6f43-bad1-4cc4-b5a9-b64cb50e04a8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:30.387992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6f43-bad1-4cc4-b5a9-b64cb50e04a8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:30.398678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:30.428161 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c161fe-ced5-48ce-94e5-1a7fe8cc49c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:30.429084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c161fe-ced5-48ce-94e5-1a7fe8cc49c9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:30.429451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c161fe-ced5-48ce-94e5-1a7fe8cc49c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:30.429641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c161fe-ced5-48ce-94e5-1a7fe8cc49c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:30.430332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c161fe-ced5-48ce-94e5-1a7fe8cc49c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:30.430701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c161fe-ced5-48ce-94e5-1a7fe8cc49c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:30.431999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c161fe-ced5-48ce-94e5-1a7fe8cc49c9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:30.444501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 638/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:23:30.450734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ddb27-be4b-4878-9529-6f934fc647db None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:30.559283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ddb27-be4b-4878-9529-6f934fc647db None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:30.595403 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2e622-f7fd-47aa-b4b3-7793a07b4a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:30.596082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2e622-f7fd-47aa-b4b3-7793a07b4a1b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:30.596512 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2e622-f7fd-47aa-b4b3-7793a07b4a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:30.596798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2e622-f7fd-47aa-b4b3-7793a07b4a1b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:30.600878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:30.607594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2e622-f7fd-47aa-b4b3-7793a07b4a1b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:30.609196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2e622-f7fd-47aa-b4b3-7793a07b4a1b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8ad2e622-f7fd-47aa-b4b3-7793a07b4a1b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:23:30.621798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:30.622905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:30.623938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:30.623938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:30.623938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:23:30.623938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:23:30.623938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:23:30.623938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:23:30.623938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:23:30.623938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:23:30.623938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:23:30.623938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:30.623938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 601/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:30.629405 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c161fe-ced5-48ce-94e5-1a7fe8cc49c9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:30.742927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c161fe-ced5-48ce-94e5-1a7fe8cc49c9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:30.778159 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe37994-8ead-4c42-9656-17b1925a2f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:30.778765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe37994-8ead-4c42-9656-17b1925a2f5d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:30.779044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe37994-8ead-4c42-9656-17b1925a2f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:30.779319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe37994-8ead-4c42-9656-17b1925a2f5d None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:30.780113 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe37994-8ead-4c42-9656-17b1925a2f5d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:30.780432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe37994-8ead-4c42-9656-17b1925a2f5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:30.781873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe37994-8ead-4c42-9656-17b1925a2f5d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:30.799347 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 639/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Sat Aug 6 01:23:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:23:30.805960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2e622-f7fd-47aa-b4b3-7793a07b4a1b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:30.919158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2e622-f7fd-47aa-b4b3-7793a07b4a1b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:30.958268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a4f3a-6881-4cc4-8671-096aba86061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:30.958997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a4f3a-6881-4cc4-8671-096aba86061f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:30.959283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a4f3a-6881-4cc4-8671-096aba86061f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:30.959561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a4f3a-6881-4cc4-8671-096aba86061f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:31.036516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:31.045029 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a4f3a-6881-4cc4-8671-096aba86061f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:31.046729 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a4f3a-6881-4cc4-8671-096aba86061f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:31.163445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 602/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:23:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:23:31.170006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe37994-8ead-4c42-9656-17b1925a2f5d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:31.201448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:31.281894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe37994-8ead-4c42-9656-17b1925a2f5d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:31.320635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabe4ac-e0f3-45c3-aa16-f12cfafabbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:31.321279 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabe4ac-e0f3-45c3-aa16-f12cfafabbef None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:31.321610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabe4ac-e0f3-45c3-aa16-f12cfafabbef None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:31.321958 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabe4ac-e0f3-45c3-aa16-f12cfafabbef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:31.333545 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabe4ac-e0f3-45c3-aa16-f12cfafabbef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:31.335222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabe4ac-e0f3-45c3-aa16-f12cfafabbef None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9cabe4ac-e0f3-45c3-aa16-f12cfafabbef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:31.351711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:31.352756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:31.353956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:31.353956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:31.353956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:31.353956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:31.361008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 640/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:23:31.361180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a4f3a-6881-4cc4-8671-096aba86061f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:31.463216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:31.470836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a4f3a-6881-4cc4-8671-096aba86061f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:31.507404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ea101-d035-42f9-984a-4489d88fe299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:31.508043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ea101-d035-42f9-984a-4489d88fe299 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:31.508324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ea101-d035-42f9-984a-4489d88fe299 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:31.508595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ea101-d035-42f9-984a-4489d88fe299 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:31.509322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ea101-d035-42f9-984a-4489d88fe299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:31.509624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ea101-d035-42f9-984a-4489d88fe299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:31.511374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ea101-d035-42f9-984a-4489d88fe299 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:31.524842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 603/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:31.530782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabe4ac-e0f3-45c3-aa16-f12cfafabbef None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:31.619018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:31.644936 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabe4ac-e0f3-45c3-aa16-f12cfafabbef None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:31.683171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf34be-4cf9-468d-a3da-ff2356daa5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:31.683878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf34be-4cf9-468d-a3da-ff2356daa5eb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:31.684217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf34be-4cf9-468d-a3da-ff2356daa5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:31.684464 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf34be-4cf9-468d-a3da-ff2356daa5eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:31.692822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf34be-4cf9-468d-a3da-ff2356daa5eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:31.694290 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf34be-4cf9-468d-a3da-ff2356daa5eb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-aadf34be-4cf9-468d-a3da-ff2356daa5eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:23:31.709746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:31.710935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:31.716823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:23:31.716823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:23:31.716823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:23:31.716823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:23:31.716823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:23:31.716823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:23:31.716823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:23:31.716823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:31.716823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 641/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:31.717444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ea101-d035-42f9-984a-4489d88fe299 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:31.836566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ea101-d035-42f9-984a-4489d88fe299 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:31.874853 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64febbee-4653-4cd7-9ba1-416e870d07ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:31.875406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64febbee-4653-4cd7-9ba1-416e870d07ab None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:31.875696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64febbee-4653-4cd7-9ba1-416e870d07ab None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:31.876065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64febbee-4653-4cd7-9ba1-416e870d07ab None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:31.876729 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64febbee-4653-4cd7-9ba1-416e870d07ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:31.877078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64febbee-4653-4cd7-9ba1-416e870d07ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:31.879492 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64febbee-4653-4cd7-9ba1-416e870d07ab None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:31.893020 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 604/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:23:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:23:31.899776 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf34be-4cf9-468d-a3da-ff2356daa5eb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:32.016575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf34be-4cf9-468d-a3da-ff2356daa5eb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:32.055460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a33d38-9d7e-48c8-a471-408cc5de22df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:32.056086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a33d38-9d7e-48c8-a471-408cc5de22df None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:32.056360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a33d38-9d7e-48c8-a471-408cc5de22df None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:32.056633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a33d38-9d7e-48c8-a471-408cc5de22df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:32.057457 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a33d38-9d7e-48c8-a471-408cc5de22df None admin] RBAC: Adding query filter params (role.id=f053004b279b4e95a6123572360bd655, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=fc1bd453c1114da4a5d9aa543bf1ff32) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:32.057769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a33d38-9d7e-48c8-a471-408cc5de22df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:32.059197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a33d38-9d7e-48c8-a471-408cc5de22df None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:32.066531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 642/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:23:31 2022] GET /identity/v3/role_assignments?user.id=fc1bd453c1114da4a5d9aa543bf1ff32&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=f053004b279b4e95a6123572360bd655 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:34.418004 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83543e30-0055-48f1-9909-f18b3fb9fd75 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:34.418568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83543e30-0055-48f1-9909-f18b3fb9fd75 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:34.418663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83543e30-0055-48f1-9909-f18b3fb9fd75 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:34.420034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 605/1247] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:34.425501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c42d-223f-4468-87aa-e803ed979674 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:34.425948 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c42d-223f-4468-87aa-e803ed979674 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:34.426062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c42d-223f-4468-87aa-e803ed979674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:34.432350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:34.445948 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8422c42d-223f-4468-87aa-e803ed979674 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:34.447132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8422c42d-223f-4468-87aa-e803ed979674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:34.519580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 643/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:23:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:23:34.545800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83543e30-0055-48f1-9909-f18b3fb9fd75 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:34.565997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:34.666180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83543e30-0055-48f1-9909-f18b3fb9fd75 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:34.712926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946ba20-a036-4b6d-bd09-c47aef68add9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:34.713651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946ba20-a036-4b6d-bd09-c47aef68add9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:34.713923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946ba20-a036-4b6d-bd09-c47aef68add9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:34.714197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946ba20-a036-4b6d-bd09-c47aef68add9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:34.726196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946ba20-a036-4b6d-bd09-c47aef68add9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e946ba20-a036-4b6d-bd09-c47aef68add9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:23:34.731186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:34.732340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:34.733347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 606/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:34.739888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c42d-223f-4468-87aa-e803ed979674 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:34.856090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c42d-223f-4468-87aa-e803ed979674 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:34.887796 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:34.893047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70eba-f857-4832-a144-e2f18959493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:34.893682 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70eba-f857-4832-a144-e2f18959493f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:34.893964 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70eba-f857-4832-a144-e2f18959493f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:34.894231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70eba-f857-4832-a144-e2f18959493f None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:34.894948 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70eba-f857-4832-a144-e2f18959493f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:34.895252 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70eba-f857-4832-a144-e2f18959493f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:34.896604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70eba-f857-4832-a144-e2f18959493f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:34.905818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 644/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:34.912811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946ba20-a036-4b6d-bd09-c47aef68add9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:35.005335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:35.032992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946ba20-a036-4b6d-bd09-c47aef68add9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:35.071535 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5047078-8a30-4ad4-8c13-d301d702c216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:35.072204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5047078-8a30-4ad4-8c13-d301d702c216 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:35.072480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5047078-8a30-4ad4-8c13-d301d702c216 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:35.072750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5047078-8a30-4ad4-8c13-d301d702c216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:35.084893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5047078-8a30-4ad4-8c13-d301d702c216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:35.086559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5047078-8a30-4ad4-8c13-d301d702c216 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f5047078-8a30-4ad4-8c13-d301d702c216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:35.102471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:35.103459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:35.104489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:35.104489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:35.104489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:35.104489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:35.104489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 607/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:35.109991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70eba-f857-4832-a144-e2f18959493f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:35.225501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70eba-f857-4832-a144-e2f18959493f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:35.265550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3414a7-95d3-425c-97b7-4d6c30eb003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:35.266157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3414a7-95d3-425c-97b7-4d6c30eb003b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:35.266375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3414a7-95d3-425c-97b7-4d6c30eb003b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:35.266773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3414a7-95d3-425c-97b7-4d6c30eb003b None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:35.267520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3414a7-95d3-425c-97b7-4d6c30eb003b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:35.267843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3414a7-95d3-425c-97b7-4d6c30eb003b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:35.270033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3414a7-95d3-425c-97b7-4d6c30eb003b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:35.284157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 645/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:23:35.290396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5047078-8a30-4ad4-8c13-d301d702c216 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:35.407179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5047078-8a30-4ad4-8c13-d301d702c216 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:35.435190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:35.446066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be9584-80ad-4a2b-b5f7-4b80ae34f689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:35.446854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be9584-80ad-4a2b-b5f7-4b80ae34f689 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:35.447128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be9584-80ad-4a2b-b5f7-4b80ae34f689 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:35.447432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be9584-80ad-4a2b-b5f7-4b80ae34f689 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:35.456408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be9584-80ad-4a2b-b5f7-4b80ae34f689 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:35.457987 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be9584-80ad-4a2b-b5f7-4b80ae34f689 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-01be9584-80ad-4a2b-b5f7-4b80ae34f689 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:23:35.472215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:35.473544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:35.474571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:35.474571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:35.474571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:23:35.474571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:23:35.474571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:23:35.474571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:23:35.474571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:23:35.474571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:23:35.474571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:23:35.474571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:35.474571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 608/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:35.480023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3414a7-95d3-425c-97b7-4d6c30eb003b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:35.542364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:35.590159 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3414a7-95d3-425c-97b7-4d6c30eb003b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:35.626180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d351c8-8523-493d-a4bd-94e3a0a432cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:35.626782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d351c8-8523-493d-a4bd-94e3a0a432cb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:35.627063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d351c8-8523-493d-a4bd-94e3a0a432cb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:35.627372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d351c8-8523-493d-a4bd-94e3a0a432cb None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:35.628171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d351c8-8523-493d-a4bd-94e3a0a432cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:35.628475 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d351c8-8523-493d-a4bd-94e3a0a432cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:35.629923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d351c8-8523-493d-a4bd-94e3a0a432cb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:35.649247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 646/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Sat Aug 6 01:23:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:35.655188 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be9584-80ad-4a2b-b5f7-4b80ae34f689 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:35.765586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be9584-80ad-4a2b-b5f7-4b80ae34f689 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:35.804100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f58eb-f45e-4817-b5c7-ed786a832104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:35.804722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f58eb-f45e-4817-b5c7-ed786a832104 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:35.805104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f58eb-f45e-4817-b5c7-ed786a832104 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:35.805385 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f58eb-f45e-4817-b5c7-ed786a832104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:35.870363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:35.886784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f58eb-f45e-4817-b5c7-ed786a832104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:35.888230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f58eb-f45e-4817-b5c7-ed786a832104 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:36.017765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 609/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:23:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 01:23:36.023827 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d351c8-8523-493d-a4bd-94e3a0a432cb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:36.136615 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d351c8-8523-493d-a4bd-94e3a0a432cb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:36.151548 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:36.175121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d235db-5efd-46ad-b4b8-57ee3ed2026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:36.175765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d235db-5efd-46ad-b4b8-57ee3ed2026c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:36.176042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d235db-5efd-46ad-b4b8-57ee3ed2026c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:36.176314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d235db-5efd-46ad-b4b8-57ee3ed2026c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:36.186946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d235db-5efd-46ad-b4b8-57ee3ed2026c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:36.188399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d235db-5efd-46ad-b4b8-57ee3ed2026c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a8d235db-5efd-46ad-b4b8-57ee3ed2026c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:36.206090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:36.207098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:36.208440 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:36.208440 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:36.208440 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:36.208440 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:36.208440 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 647/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:36.213038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f58eb-f45e-4817-b5c7-ed786a832104 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:36.311144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:36.329405 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f58eb-f45e-4817-b5c7-ed786a832104 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:36.371424 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93814fb7-4e11-4bb6-a3ef-6af41af5ca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:36.372215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93814fb7-4e11-4bb6-a3ef-6af41af5ca7e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:36.372538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93814fb7-4e11-4bb6-a3ef-6af41af5ca7e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:36.372817 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93814fb7-4e11-4bb6-a3ef-6af41af5ca7e None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:36.373639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93814fb7-4e11-4bb6-a3ef-6af41af5ca7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:36.373917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93814fb7-4e11-4bb6-a3ef-6af41af5ca7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:36.375601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93814fb7-4e11-4bb6-a3ef-6af41af5ca7e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:36.392747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 610/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:36.399368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d235db-5efd-46ad-b4b8-57ee3ed2026c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:36.512436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d235db-5efd-46ad-b4b8-57ee3ed2026c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:36.556059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8560e8c-71a6-4bdf-9dfd-04434d144755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:36.556948 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8560e8c-71a6-4bdf-9dfd-04434d144755 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:36.557271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8560e8c-71a6-4bdf-9dfd-04434d144755 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:36.557742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8560e8c-71a6-4bdf-9dfd-04434d144755 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:36.566064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8560e8c-71a6-4bdf-9dfd-04434d144755 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:36.567611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8560e8c-71a6-4bdf-9dfd-04434d144755 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f8560e8c-71a6-4bdf-9dfd-04434d144755 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:23:36.579906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:36.581772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:36.587635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:23:36.587635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:23:36.587635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:23:36.587635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:23:36.587635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:23:36.587635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:23:36.587635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:23:36.587635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:36.587635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 648/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:36.588135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93814fb7-4e11-4bb6-a3ef-6af41af5ca7e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:36.690620 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93814fb7-4e11-4bb6-a3ef-6af41af5ca7e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:36.725903 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b51de9-0e2c-47a8-8b94-5aaf88667a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:36.726520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b51de9-0e2c-47a8-8b94-5aaf88667a3d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:36.726799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b51de9-0e2c-47a8-8b94-5aaf88667a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:36.727069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b51de9-0e2c-47a8-8b94-5aaf88667a3d None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:36.727806 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b51de9-0e2c-47a8-8b94-5aaf88667a3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:36.728108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b51de9-0e2c-47a8-8b94-5aaf88667a3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:36.729544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b51de9-0e2c-47a8-8b94-5aaf88667a3d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:36.741699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 611/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:36.748080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8560e8c-71a6-4bdf-9dfd-04434d144755 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:36.780790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:36.865528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8560e8c-71a6-4bdf-9dfd-04434d144755 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:36.907557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25082f-71a4-4510-a1b2-3534f4feca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:36.908167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25082f-71a4-4510-a1b2-3534f4feca64 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:36.908491 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25082f-71a4-4510-a1b2-3534f4feca64 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:36.909555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25082f-71a4-4510-a1b2-3534f4feca64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:36.910419 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25082f-71a4-4510-a1b2-3534f4feca64 None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=fc1bd453c1114da4a5d9aa543bf1ff32) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:36.910739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25082f-71a4-4510-a1b2-3534f4feca64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:36.912183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25082f-71a4-4510-a1b2-3534f4feca64 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:36.918410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 649/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:23:36 2022] GET /identity/v3/role_assignments?user.id=fc1bd453c1114da4a5d9aa543bf1ff32&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:23:38.985413 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96b3f-0aad-47f6-b8db-929c155a3de6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:38.986073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96b3f-0aad-47f6-b8db-929c155a3de6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:38.986073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96b3f-0aad-47f6-b8db-929c155a3de6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:38.988441 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 612/1261] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:23:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:38.993739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0cbfe-986f-4b59-aca6-ce02286f657b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:38.994186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0cbfe-986f-4b59-aca6-ce02286f657b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:38.994349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0cbfe-986f-4b59-aca6-ce02286f657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:39.013709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-83d0cbfe-986f-4b59-aca6-ce02286f657b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:39.014896 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-83d0cbfe-986f-4b59-aca6-ce02286f657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:39.081158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 650/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:23:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:23:39.103392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb96b3f-0aad-47f6-b8db-929c155a3de6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:39.114557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:39.203117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb96b3f-0aad-47f6-b8db-929c155a3de6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:39.235257 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc0bb7-81c0-469f-9162-54d63c1c7322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:39.235925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0bb7-81c0-469f-9162-54d63c1c7322 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:39.236150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0bb7-81c0-469f-9162-54d63c1c7322 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:39.236988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0bb7-81c0-469f-9162-54d63c1c7322 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:39.247525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc0bb7-81c0-469f-9162-54d63c1c7322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f3cc0bb7-81c0-469f-9162-54d63c1c7322 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:23:39.252650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:39.253802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:39.255068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 613/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:23:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:39.259634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0cbfe-986f-4b59-aca6-ce02286f657b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:39.277913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:39.358386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0cbfe-986f-4b59-aca6-ce02286f657b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:39.392438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a0ae7-89df-43fb-83e0-266a2877e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:39.394076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a0ae7-89df-43fb-83e0-266a2877e2fc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:39.394364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a0ae7-89df-43fb-83e0-266a2877e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:39.394643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a0ae7-89df-43fb-83e0-266a2877e2fc None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:39.395356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a0ae7-89df-43fb-83e0-266a2877e2fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:39.395662 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a0ae7-89df-43fb-83e0-266a2877e2fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:39.397061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a0ae7-89df-43fb-83e0-266a2877e2fc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:39.404766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 651/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:23:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:39.410846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc0bb7-81c0-469f-9162-54d63c1c7322 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:39.475832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:39.509116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc0bb7-81c0-469f-9162-54d63c1c7322 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:39.543274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9220790-7397-4452-8db7-a17a46c75f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:39.543899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9220790-7397-4452-8db7-a17a46c75f47 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:39.544184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9220790-7397-4452-8db7-a17a46c75f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:39.544461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9220790-7397-4452-8db7-a17a46c75f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:39.555294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9220790-7397-4452-8db7-a17a46c75f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:39.556734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9220790-7397-4452-8db7-a17a46c75f47 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c9220790-7397-4452-8db7-a17a46c75f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:39.571253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:39.572260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:39.573380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:39.573380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:39.573380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:39.573380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:39.573380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 614/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:39.578150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a0ae7-89df-43fb-83e0-266a2877e2fc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:39.659416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:39.677841 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a0ae7-89df-43fb-83e0-266a2877e2fc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:39.710063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd5ff7-d8ee-42cd-ba84-c2147d829150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:39.710664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd5ff7-d8ee-42cd-ba84-c2147d829150 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:39.710944 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd5ff7-d8ee-42cd-ba84-c2147d829150 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:39.711216 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd5ff7-d8ee-42cd-ba84-c2147d829150 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:39.711894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd5ff7-d8ee-42cd-ba84-c2147d829150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:39.712196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd5ff7-d8ee-42cd-ba84-c2147d829150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:39.713566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd5ff7-d8ee-42cd-ba84-c2147d829150 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:39.724819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 652/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:39.730583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9220790-7397-4452-8db7-a17a46c75f47 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:39.828572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9220790-7397-4452-8db7-a17a46c75f47 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:39.847366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:39.860926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ce790-7550-410e-a28d-04c04c1c2d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:39.862080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ce790-7550-410e-a28d-04c04c1c2d2a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:39.862358 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ce790-7550-410e-a28d-04c04c1c2d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:39.862628 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ce790-7550-410e-a28d-04c04c1c2d2a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:39.869789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ce790-7550-410e-a28d-04c04c1c2d2a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:39.871204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ce790-7550-410e-a28d-04c04c1c2d2a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-695ce790-7550-410e-a28d-04c04c1c2d2a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:23:39.882742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:39.883811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:39.885379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:39.885379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:39.885379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:23:39.885379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:23:39.885379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:23:39.885379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:23:39.885379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:23:39.885379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:23:39.885379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:23:39.885379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:39.885379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 615/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:39.890004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd5ff7-d8ee-42cd-ba84-c2147d829150 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:39.991579 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd5ff7-d8ee-42cd-ba84-c2147d829150 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:40.028638 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e5cb4-2722-4147-8f0c-893da9e33f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:40.029369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e5cb4-2722-4147-8f0c-893da9e33f54 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:40.029554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e5cb4-2722-4147-8f0c-893da9e33f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:40.029829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e5cb4-2722-4147-8f0c-893da9e33f54 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:40.030648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e5cb4-2722-4147-8f0c-893da9e33f54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:40.030985 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e5cb4-2722-4147-8f0c-893da9e33f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:40.032347 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e5cb4-2722-4147-8f0c-893da9e33f54 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:40.042090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:40.051482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 653/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Sat Aug 6 01:23:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:40.057168 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ce790-7550-410e-a28d-04c04c1c2d2a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:40.154542 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ce790-7550-410e-a28d-04c04c1c2d2a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:40.186773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15b053-7c36-46bd-8ed4-19e52093dde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:40.187396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15b053-7c36-46bd-8ed4-19e52093dde8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:40.187674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15b053-7c36-46bd-8ed4-19e52093dde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:40.187946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15b053-7c36-46bd-8ed4-19e52093dde8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:40.198718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15b053-7c36-46bd-8ed4-19e52093dde8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:40.200142 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15b053-7c36-46bd-8ed4-19e52093dde8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4d15b053-7c36-46bd-8ed4-19e52093dde8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:40.214581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:40.215627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:40.216744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:40.216744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:40.216744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:40.216744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:40.216744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 616/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:40.221354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e5cb4-2722-4147-8f0c-893da9e33f54 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:40.318131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e5cb4-2722-4147-8f0c-893da9e33f54 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:40.351687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80561ed8-e0c2-4d57-996a-b61bc60aa1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:40.352282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80561ed8-e0c2-4d57-996a-b61bc60aa1fd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:40.352561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80561ed8-e0c2-4d57-996a-b61bc60aa1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:40.352832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80561ed8-e0c2-4d57-996a-b61bc60aa1fd None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:40.353549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80561ed8-e0c2-4d57-996a-b61bc60aa1fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:40.353850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80561ed8-e0c2-4d57-996a-b61bc60aa1fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:40.355188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80561ed8-e0c2-4d57-996a-b61bc60aa1fd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:40.366729 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 654/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:40.372432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15b053-7c36-46bd-8ed4-19e52093dde8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:40.404645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:40.471267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15b053-7c36-46bd-8ed4-19e52093dde8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:40.503843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b1dca-b3fb-4133-be1b-3539392323a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:40.504454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b1dca-b3fb-4133-be1b-3539392323a7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:40.504732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b1dca-b3fb-4133-be1b-3539392323a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:40.505035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b1dca-b3fb-4133-be1b-3539392323a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:40.511650 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b1dca-b3fb-4133-be1b-3539392323a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:40.513097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b1dca-b3fb-4133-be1b-3539392323a7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c04b1dca-b3fb-4133-be1b-3539392323a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:23:40.525815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:40.526852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:40.529167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:23:40.529167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:23:40.529167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:23:40.529167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:23:40.529167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:23:40.529167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:23:40.529167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:23:40.529167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:40.529167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 617/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:23:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:40.532719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80561ed8-e0c2-4d57-996a-b61bc60aa1fd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:40.598499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:40.641765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80561ed8-e0c2-4d57-996a-b61bc60aa1fd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:40.679187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d486afd-c2ae-4f5a-9ae7-8b7b2e2071fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:40.679715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d486afd-c2ae-4f5a-9ae7-8b7b2e2071fb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:40.680001 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d486afd-c2ae-4f5a-9ae7-8b7b2e2071fb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:40.680272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d486afd-c2ae-4f5a-9ae7-8b7b2e2071fb None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:40.681042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d486afd-c2ae-4f5a-9ae7-8b7b2e2071fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:40.681345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d486afd-c2ae-4f5a-9ae7-8b7b2e2071fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:40.682745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d486afd-c2ae-4f5a-9ae7-8b7b2e2071fb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:40.695409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 655/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:23:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:40.701502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b1dca-b3fb-4133-be1b-3539392323a7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:40.793895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:40.802520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b1dca-b3fb-4133-be1b-3539392323a7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:40.835716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f014d-c962-4260-90de-28c5ca6681b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:40.836375 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f014d-c962-4260-90de-28c5ca6681b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:40.836659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f014d-c962-4260-90de-28c5ca6681b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:40.836958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f014d-c962-4260-90de-28c5ca6681b7 None admin] PATH_INFO: `/v3/projects/c344ed6bac754173af05207b5f444dca/users/fc1bd453c1114da4a5d9aa543bf1ff32/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:40.838852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f014d-c962-4260-90de-28c5ca6681b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c344ed6bac754173af05207b5f444dca, user_id=fc1bd453c1114da4a5d9aa543bf1ff32, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:40.840274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f014d-c962-4260-90de-28c5ca6681b7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:40.852879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 618/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Sat Aug 6 01:23:40 2022] PUT /identity/v3/projects/c344ed6bac754173af05207b5f444dca/users/fc1bd453c1114da4a5d9aa543bf1ff32/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:23:42.819620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec607d-3a18-41da-85ec-7d7b918ce536 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:42.820144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec607d-3a18-41da-85ec-7d7b918ce536 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:42.820144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec607d-3a18-41da-85ec-7d7b918ce536 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:42.821445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 656/1274] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:42.826368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ec2d8-5f27-4e8e-8c2f-274f932d04cd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:42.826789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ec2d8-5f27-4e8e-8c2f-274f932d04cd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:42.826984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ec2d8-5f27-4e8e-8c2f-274f932d04cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:42.845136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7f4ec2d8-5f27-4e8e-8c2f-274f932d04cd None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:42.846901 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7f4ec2d8-5f27-4e8e-8c2f-274f932d04cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:42.910711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 619/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:23:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:23:42.933259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec607d-3a18-41da-85ec-7d7b918ce536 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:43.037147 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec607d-3a18-41da-85ec-7d7b918ce536 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:43.054344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:43.071108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9db1be-a09f-4246-b3be-dadabf05d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:43.071651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db1be-a09f-4246-b3be-dadabf05d432 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:43.071929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db1be-a09f-4246-b3be-dadabf05d432 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:43.072199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9db1be-a09f-4246-b3be-dadabf05d432 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:43.082439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9db1be-a09f-4246-b3be-dadabf05d432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5d9db1be-a09f-4246-b3be-dadabf05d432 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:23:43.087241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:43.088320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:43.089334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 657/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Sat Aug 6 01:23:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:43.094352 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ec2d8-5f27-4e8e-8c2f-274f932d04cd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:43.172581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:43.192532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ec2d8-5f27-4e8e-8c2f-274f932d04cd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:43.225114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c99d83-05c1-4e1c-be1f-a84a51b7e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:43.225712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c99d83-05c1-4e1c-be1f-a84a51b7e70f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:43.225990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c99d83-05c1-4e1c-be1f-a84a51b7e70f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:43.226260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c99d83-05c1-4e1c-be1f-a84a51b7e70f None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:43.226960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c99d83-05c1-4e1c-be1f-a84a51b7e70f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:43.227259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c99d83-05c1-4e1c-be1f-a84a51b7e70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:43.228601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c99d83-05c1-4e1c-be1f-a84a51b7e70f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:43.236933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 620/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Sat Aug 6 01:23:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:43.241970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9db1be-a09f-4246-b3be-dadabf05d432 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:43.340060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9db1be-a09f-4246-b3be-dadabf05d432 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:43.373444 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9c8c4-3ea3-48d6-8df0-6586e71683ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:43.374088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9c8c4-3ea3-48d6-8df0-6586e71683ad None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:43.374374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9c8c4-3ea3-48d6-8df0-6586e71683ad None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:43.374650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9c8c4-3ea3-48d6-8df0-6586e71683ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:43.385453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9c8c4-3ea3-48d6-8df0-6586e71683ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:43.386888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9c8c4-3ea3-48d6-8df0-6586e71683ad None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-55e9c8c4-3ea3-48d6-8df0-6586e71683ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:43.401450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:43.402594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:43.403884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:43.403884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:43.403884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:43.403884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:43.403884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 658/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:43.408222 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c99d83-05c1-4e1c-be1f-a84a51b7e70f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:43.505970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c99d83-05c1-4e1c-be1f-a84a51b7e70f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:43.537972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7946a86-6ffd-40bd-891d-e49e953e5739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:43.538579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946a86-6ffd-40bd-891d-e49e953e5739 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:43.538864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946a86-6ffd-40bd-891d-e49e953e5739 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:43.539141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7946a86-6ffd-40bd-891d-e49e953e5739 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:43.539823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7946a86-6ffd-40bd-891d-e49e953e5739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:43.540129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7946a86-6ffd-40bd-891d-e49e953e5739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:43.541515 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7946a86-6ffd-40bd-891d-e49e953e5739 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:43.553501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 621/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:43.558988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9c8c4-3ea3-48d6-8df0-6586e71683ad None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:43.589482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:43.657288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9c8c4-3ea3-48d6-8df0-6586e71683ad None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:43.691077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182923d-941f-4625-8650-37ec0e90cb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:43.691693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182923d-941f-4625-8650-37ec0e90cb80 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:43.691973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182923d-941f-4625-8650-37ec0e90cb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:43.692245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182923d-941f-4625-8650-37ec0e90cb80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:43.700177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182923d-941f-4625-8650-37ec0e90cb80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:43.701621 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182923d-941f-4625-8650-37ec0e90cb80 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c182923d-941f-4625-8650-37ec0e90cb80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:23:43.713013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:43.714165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:43.715140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:43.715140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:43.715140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:23:43.715140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:23:43.715140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:23:43.715140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:23:43.715140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:23:43.715140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:23:43.715140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:23:43.715140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:43.715140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 659/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:43.719926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7946a86-6ffd-40bd-891d-e49e953e5739 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:43.724243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:43.818084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7946a86-6ffd-40bd-891d-e49e953e5739 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:43.851459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dbcd6-f0f3-4d56-b5cf-a12ed072288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:43.852062 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dbcd6-f0f3-4d56-b5cf-a12ed072288a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:43.852339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dbcd6-f0f3-4d56-b5cf-a12ed072288a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:43.852617 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dbcd6-f0f3-4d56-b5cf-a12ed072288a None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:43.853440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dbcd6-f0f3-4d56-b5cf-a12ed072288a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:43.853750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dbcd6-f0f3-4d56-b5cf-a12ed072288a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:43.855167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dbcd6-f0f3-4d56-b5cf-a12ed072288a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:43.871849 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 622/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Sat Aug 6 01:23:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:43.878170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182923d-941f-4625-8650-37ec0e90cb80 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:43.967368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:43.981892 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182923d-941f-4625-8650-37ec0e90cb80 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:44.018837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b6e8a-f156-4611-bec3-d0f395467136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:44.019444 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b6e8a-f156-4611-bec3-d0f395467136 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:44.019723 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b6e8a-f156-4611-bec3-d0f395467136 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:44.019994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b6e8a-f156-4611-bec3-d0f395467136 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:44.083421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b6e8a-f156-4611-bec3-d0f395467136 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:44.084832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b6e8a-f156-4611-bec3-d0f395467136 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:44.168477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:44.179181 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 660/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Sat Aug 6 01:23:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:23:44.185077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dbcd6-f0f3-4d56-b5cf-a12ed072288a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:44.245712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:44.284230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dbcd6-f0f3-4d56-b5cf-a12ed072288a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:44.317579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c40f16-8e8b-4d32-a63b-d7c3db54c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:44.318218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c40f16-8e8b-4d32-a63b-d7c3db54c70a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:44.318486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c40f16-8e8b-4d32-a63b-d7c3db54c70a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:44.318759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c40f16-8e8b-4d32-a63b-d7c3db54c70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:44.328432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c40f16-8e8b-4d32-a63b-d7c3db54c70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:44.330471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c40f16-8e8b-4d32-a63b-d7c3db54c70a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-39c40f16-8e8b-4d32-a63b-d7c3db54c70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:23:44.344756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:44.345935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:44.346905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:23:44.346905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:23:44.346905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:23:44.346905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:44.346905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 623/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:44.351992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b6e8a-f156-4611-bec3-d0f395467136 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:44.448297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b6e8a-f156-4611-bec3-d0f395467136 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:44.480878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb575dd-badf-41c9-94d4-8ebd85da4f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:44.481508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb575dd-badf-41c9-94d4-8ebd85da4f59 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:44.481788 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb575dd-badf-41c9-94d4-8ebd85da4f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:44.482060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb575dd-badf-41c9-94d4-8ebd85da4f59 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:44.482744 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb575dd-badf-41c9-94d4-8ebd85da4f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:44.483048 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb575dd-badf-41c9-94d4-8ebd85da4f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:44.484390 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb575dd-badf-41c9-94d4-8ebd85da4f59 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:44.495184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 661/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Sat Aug 6 01:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:44.500945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c40f16-8e8b-4d32-a63b-d7c3db54c70a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:44.600133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c40f16-8e8b-4d32-a63b-d7c3db54c70a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:44.613803 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:44.633319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774f8e1-3b97-4a4f-befe-eb0d190c3491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:44.633946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774f8e1-3b97-4a4f-befe-eb0d190c3491 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:44.634229 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774f8e1-3b97-4a4f-befe-eb0d190c3491 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:44.634508 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774f8e1-3b97-4a4f-befe-eb0d190c3491 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:44.641253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774f8e1-3b97-4a4f-befe-eb0d190c3491 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:44.642709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774f8e1-3b97-4a4f-befe-eb0d190c3491 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f774f8e1-3b97-4a4f-befe-eb0d190c3491 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:23:44.653846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:44.654874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:44.656138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:23:44.656138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:23:44.656138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:23:44.656138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:23:44.656138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:23:44.656138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:23:44.656138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:23:44.656138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: ERROR keystone.server.flask.application Aug 06 01:23:44.656138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 624/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Sat Aug 6 01:23:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:44.661291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb575dd-badf-41c9-94d4-8ebd85da4f59 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:44.709387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:44.758246 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb575dd-badf-41c9-94d4-8ebd85da4f59 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:44.790140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1369b-60e6-4610-bf09-d37e4c14a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:44.790736 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1369b-60e6-4610-bf09-d37e4c14a527 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:44.791014 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1369b-60e6-4610-bf09-d37e4c14a527 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:44.791283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1369b-60e6-4610-bf09-d37e4c14a527 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:44.792019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1369b-60e6-4610-bf09-d37e4c14a527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:44.792322 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1369b-60e6-4610-bf09-d37e4c14a527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:44.793757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1369b-60e6-4610-bf09-d37e4c14a527 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:44.805279 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 662/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Sat Aug 6 01:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:44.811189 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774f8e1-3b97-4a4f-befe-eb0d190c3491 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:44.909746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774f8e1-3b97-4a4f-befe-eb0d190c3491 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:44.941625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a8fa6-1fdf-4aad-a049-e4a94b4f2493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:44.942224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a8fa6-1fdf-4aad-a049-e4a94b4f2493 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:44.942506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a8fa6-1fdf-4aad-a049-e4a94b4f2493 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:44.942781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a8fa6-1fdf-4aad-a049-e4a94b4f2493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:44.943563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a8fa6-1fdf-4aad-a049-e4a94b4f2493 None admin] RBAC: Adding query filter params (role.id=5a6ea74454b34ab3893038b7fe523d18, scope.project.id=c344ed6bac754173af05207b5f444dca, user.id=fc1bd453c1114da4a5d9aa543bf1ff32) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:44.943877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a8fa6-1fdf-4aad-a049-e4a94b4f2493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:44.945317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a8fa6-1fdf-4aad-a049-e4a94b4f2493 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:44.950952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 625/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Sat Aug 6 01:23:44 2022] GET /identity/v3/role_assignments?user.id=fc1bd453c1114da4a5d9aa543bf1ff32&scope.project.id=c344ed6bac754173af05207b5f444dca&role.id=5a6ea74454b34ab3893038b7fe523d18 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:46.968402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73fda1-a3c0-496a-a4de-aa63b9b70bdd None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:46.968991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73fda1-a3c0-496a-a4de-aa63b9b70bdd None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:46.968991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73fda1-a3c0-496a-a4de-aa63b9b70bdd None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:46.970901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 663/1288] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:46.976302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b245e-b409-4794-b216-aa2318077e91 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:46.976755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b245e-b409-4794-b216-aa2318077e91 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:46.976860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b245e-b409-4794-b216-aa2318077e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:46.999174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c20b245e-b409-4794-b216-aa2318077e91 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:47.000373 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c20b245e-b409-4794-b216-aa2318077e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:47.034877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:47.072529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 626/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:23:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:23:47.094075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73fda1-a3c0-496a-a4de-aa63b9b70bdd None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:47.193671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73fda1-a3c0-496a-a4de-aa63b9b70bdd None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:47.204432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:47.227842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9528761-ebd9-4f87-809b-7d80fe61d17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:47.228407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9528761-ebd9-4f87-809b-7d80fe61d17f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:47.228689 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9528761-ebd9-4f87-809b-7d80fe61d17f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:47.228990 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9528761-ebd9-4f87-809b-7d80fe61d17f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:47.229611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9528761-ebd9-4f87-809b-7d80fe61d17f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:47.230965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9528761-ebd9-4f87-809b-7d80fe61d17f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d9528761-ebd9-4f87-809b-7d80fe61d17f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:47.240659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:47.242040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:47.243188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 664/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 6 01:23:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:47.247750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b245e-b409-4794-b216-aa2318077e91 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:47.346191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b245e-b409-4794-b216-aa2318077e91 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:47.380606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3398e2e-03f8-4e05-9028-5521dd098bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:47.381258 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398e2e-03f8-4e05-9028-5521dd098bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:47.381541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398e2e-03f8-4e05-9028-5521dd098bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:47.381816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398e2e-03f8-4e05-9028-5521dd098bc3 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:47.382490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3398e2e-03f8-4e05-9028-5521dd098bc3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:47.382796 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3398e2e-03f8-4e05-9028-5521dd098bc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:47.384148 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3398e2e-03f8-4e05-9028-5521dd098bc3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:47.389219 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 627/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Sat Aug 6 01:23:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:47.394933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9528761-ebd9-4f87-809b-7d80fe61d17f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:47.491427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9528761-ebd9-4f87-809b-7d80fe61d17f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:47.523427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63af52-bda1-400b-8831-452c6e641b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:47.524018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63af52-bda1-400b-8831-452c6e641b5e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:47.524299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63af52-bda1-400b-8831-452c6e641b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:47.524571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63af52-bda1-400b-8831-452c6e641b5e None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:47.525268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63af52-bda1-400b-8831-452c6e641b5e None admin] RBAC: Adding query filter params (type=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:47.525571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63af52-bda1-400b-8831-452c6e641b5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:47.526911 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63af52-bda1-400b-8831-452c6e641b5e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:47.531170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 665/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Sat Aug 6 01:23:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:49.497275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754df01-9eb0-43cf-acf7-f3de493d88ec None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:49.497858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754df01-9eb0-43cf-acf7-f3de493d88ec None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:49.497858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754df01-9eb0-43cf-acf7-f3de493d88ec None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:49.499194 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 628/1293] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:49.504572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb72e1-4bda-404e-bd22-eef5bc88c3de None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:49.505048 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb72e1-4bda-404e-bd22-eef5bc88c3de None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:49.505151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb72e1-4bda-404e-bd22-eef5bc88c3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:49.523393 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4fbb72e1-4bda-404e-bd22-eef5bc88c3de None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:49.524571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4fbb72e1-4bda-404e-bd22-eef5bc88c3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:49.553448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:49.589699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 666/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:23:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:23:49.613706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754df01-9eb0-43cf-acf7-f3de493d88ec None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:49.644679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:49.714440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754df01-9eb0-43cf-acf7-f3de493d88ec None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:49.748291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de64d8-03ed-465e-8413-1bf2e6d254df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:49.748897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de64d8-03ed-465e-8413-1bf2e6d254df None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:49.749210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de64d8-03ed-465e-8413-1bf2e6d254df None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:49.749489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de64d8-03ed-465e-8413-1bf2e6d254df None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:49.750186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de64d8-03ed-465e-8413-1bf2e6d254df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:49.752121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de64d8-03ed-465e-8413-1bf2e6d254df None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:49.766203 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 629/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Sat Aug 6 01:23:49 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:23:51.777713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b47d08-efb4-4622-bb45-01abdea5cd1d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:51.778231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b47d08-efb4-4622-bb45-01abdea5cd1d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:51.778231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b47d08-efb4-4622-bb45-01abdea5cd1d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:51.779543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 667/1296] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:51.785473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6298c5-4b8a-46b1-b1ad-95ec8bac2bbf None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:51.785889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6298c5-4b8a-46b1-b1ad-95ec8bac2bbf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:51.786026 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6298c5-4b8a-46b1-b1ad-95ec8bac2bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:51.804003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1a6298c5-4b8a-46b1-b1ad-95ec8bac2bbf None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:51.805277 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1a6298c5-4b8a-46b1-b1ad-95ec8bac2bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:51.877969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 630/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:23:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:23:51.900346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b47d08-efb4-4622-bb45-01abdea5cd1d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:52.012740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b47d08-efb4-4622-bb45-01abdea5cd1d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:52.055089 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240623e-86f3-472d-b648-f143872dc745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:52.055657 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240623e-86f3-472d-b648-f143872dc745 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:52.055944 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240623e-86f3-472d-b648-f143872dc745 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:52.056223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240623e-86f3-472d-b648-f143872dc745 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:52.056847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240623e-86f3-472d-b648-f143872dc745 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:52.058235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240623e-86f3-472d-b648-f143872dc745 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5240623e-86f3-472d-b648-f143872dc745 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:52.067693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:52.068970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:52.070265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 668/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 6 01:23:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:52.074861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6298c5-4b8a-46b1-b1ad-95ec8bac2bbf None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:52.093493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:52.174199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6298c5-4b8a-46b1-b1ad-95ec8bac2bbf None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:52.207713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9541ed2-0453-488c-92be-5b0453037cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:52.208332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9541ed2-0453-488c-92be-5b0453037cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:52.208615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9541ed2-0453-488c-92be-5b0453037cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:52.208887 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9541ed2-0453-488c-92be-5b0453037cc3 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:52.209588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9541ed2-0453-488c-92be-5b0453037cc3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:52.209895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9541ed2-0453-488c-92be-5b0453037cc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:52.211256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9541ed2-0453-488c-92be-5b0453037cc3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:52.216239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 631/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Sat Aug 6 01:23:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:52.223309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240623e-86f3-472d-b648-f143872dc745 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:52.254524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:52.322305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240623e-86f3-472d-b648-f143872dc745 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:52.354595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c84d6b-fd68-4f1a-9d67-2ac37d560888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:52.355200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c84d6b-fd68-4f1a-9d67-2ac37d560888 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:52.355484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c84d6b-fd68-4f1a-9d67-2ac37d560888 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:52.355760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c84d6b-fd68-4f1a-9d67-2ac37d560888 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:52.356514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c84d6b-fd68-4f1a-9d67-2ac37d560888 None admin] RBAC: Adding query filter params (interface=public, service_id=0eb0efdcc579420382cfa9b097577c0b, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:52.356829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c84d6b-fd68-4f1a-9d67-2ac37d560888 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:52.358209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c84d6b-fd68-4f1a-9d67-2ac37d560888 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:52.363943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 669/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Sat Aug 6 01:23:52 2022] GET /identity/v3/endpoints?service_id=0eb0efdcc579420382cfa9b097577c0b&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:23:52.369770 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9541ed2-0453-488c-92be-5b0453037cc3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:52.449341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:52.467552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9541ed2-0453-488c-92be-5b0453037cc3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:52.500977 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e2d06-988e-4260-8acb-bceadd50fe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:52.502381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e2d06-988e-4260-8acb-bceadd50fe8f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:52.502667 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e2d06-988e-4260-8acb-bceadd50fe8f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:52.502938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e2d06-988e-4260-8acb-bceadd50fe8f None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:52.503583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e2d06-988e-4260-8acb-bceadd50fe8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:52.504953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e2d06-988e-4260-8acb-bceadd50fe8f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:52.511846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 632/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Sat Aug 6 01:23:52 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:23:54.497229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ab116-ac49-49c1-97a9-1377847ac143 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:54.497768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ab116-ac49-49c1-97a9-1377847ac143 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:54.497768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ab116-ac49-49c1-97a9-1377847ac143 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:54.499098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 670/1302] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:54.504334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56195d-0a5c-46ff-93eb-6d4651dbd09c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:54.504773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56195d-0a5c-46ff-93eb-6d4651dbd09c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:54.504877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56195d-0a5c-46ff-93eb-6d4651dbd09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:54.523234 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3e56195d-0a5c-46ff-93eb-6d4651dbd09c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:54.524412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3e56195d-0a5c-46ff-93eb-6d4651dbd09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:54.589232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 633/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:23:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:23:54.612891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ab116-ac49-49c1-97a9-1377847ac143 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:54.706050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:54.712914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ab116-ac49-49c1-97a9-1377847ac143 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:54.746148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1247503-db96-4766-b732-9fc7d5adb7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:54.746780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1247503-db96-4766-b732-9fc7d5adb7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:54.747072 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1247503-db96-4766-b732-9fc7d5adb7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:54.747350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1247503-db96-4766-b732-9fc7d5adb7e7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:54.747971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1247503-db96-4766-b732-9fc7d5adb7e7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:54.749403 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1247503-db96-4766-b732-9fc7d5adb7e7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b1247503-db96-4766-b732-9fc7d5adb7e7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:23:54.758663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:23:54.760115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:23:54.761213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: ERROR keystone.server.flask.application Aug 06 01:23:54.765069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 671/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Sat Aug 6 01:23:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:23:54.766160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56195d-0a5c-46ff-93eb-6d4651dbd09c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:54.839095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:54.861656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56195d-0a5c-46ff-93eb-6d4651dbd09c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:54.894349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc756d5-c6e8-452e-94cd-a361dc1bd372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:54.894949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc756d5-c6e8-452e-94cd-a361dc1bd372 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:54.895229 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc756d5-c6e8-452e-94cd-a361dc1bd372 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:54.895501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc756d5-c6e8-452e-94cd-a361dc1bd372 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:54.896173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc756d5-c6e8-452e-94cd-a361dc1bd372 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:23:54.896474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc756d5-c6e8-452e-94cd-a361dc1bd372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:54.897839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc756d5-c6e8-452e-94cd-a361dc1bd372 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:54.902811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 634/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Sat Aug 6 01:23:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:23:54.908513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1247503-db96-4766-b732-9fc7d5adb7e7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:55.012823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1247503-db96-4766-b732-9fc7d5adb7e7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:55.046201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c20a20-3b9d-4f22-82f7-af52acbe9bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:55.046813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c20a20-3b9d-4f22-82f7-af52acbe9bfa None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:55.047096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c20a20-3b9d-4f22-82f7-af52acbe9bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:55.047372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c20a20-3b9d-4f22-82f7-af52acbe9bfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:55.048085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c20a20-3b9d-4f22-82f7-af52acbe9bfa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:55.049487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c20a20-3b9d-4f22-82f7-af52acbe9bfa None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:55.068430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 672/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:23:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:24:04.900618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=30 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:24:05.064114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:24:57.573881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7795e4a-75f2-4ea2-bd47-5bd846e7b2b8 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:24:57.574446 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7795e4a-75f2-4ea2-bd47-5bd846e7b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:24:57.574446 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7795e4a-75f2-4ea2-bd47-5bd846e7b2b8 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:24:57.575828 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 635/1307] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:24:57.581641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ae94f-a3d3-4bb5-b294-796231847748 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:24:57.582513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ae94f-a3d3-4bb5-b294-796231847748 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:24:57.582949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ae94f-a3d3-4bb5-b294-796231847748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:24:57.660592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-638ae94f-a3d3-4bb5-b294-796231847748 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:24:57.662067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-638ae94f-a3d3-4bb5-b294-796231847748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:24:57.789811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 673/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:24:57.829171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790791ab-c9f3-420b-a8b0-11537b11498c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:24:57.829430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790791ab-c9f3-420b-a8b0-11537b11498c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:24:57.829707 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790791ab-c9f3-420b-a8b0-11537b11498c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:24:57.831240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 636/1309] 10.222.0.15 () {54 vars in 965 bytes} [Sat Aug 6 01:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:24:57.837205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d475e-372c-4946-8123-2d34d3b0c83c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:24:57.837525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d475e-372c-4946-8123-2d34d3b0c83c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:24:57.837756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d475e-372c-4946-8123-2d34d3b0c83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:24:57.928395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-075d475e-372c-4946-8123-2d34d3b0c83c None None] MFA Rules not processed for user `403beb9eb6c04cc69579361138bea12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:24:57.929830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-075d475e-372c-4946-8123-2d34d3b0c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:24:57.959985 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:24:58.034879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 674/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Sat Aug 6 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:24:58.046310 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790791ab-c9f3-420b-a8b0-11537b11498c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:24:58.049010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-790791ab-c9f3-420b-a8b0-11537b11498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:24:58.217498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790791ab-c9f3-420b-a8b0-11537b11498c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:24:58.302265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7e480-aa01-4d3c-be22-75712e09b0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:24:58.302885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e480-aa01-4d3c-be22-75712e09b0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:24:58.303166 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e480-aa01-4d3c-be22-75712e09b0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:24:58.303437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e480-aa01-4d3c-be22-75712e09b0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:24:58.305064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-11c7e480-aa01-4d3c-be22-75712e09b0c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:24:58.366279 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:24:58.428394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7e480-aa01-4d3c-be22-75712e09b0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:24:58.429857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7e480-aa01-4d3c-be22-75712e09b0c5 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:24:58.450398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 637/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:00.781094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198049-56a6-4e2a-b616-c660bc28d945 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:00.781676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198049-56a6-4e2a-b616-c660bc28d945 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:00.781901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198049-56a6-4e2a-b616-c660bc28d945 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:00.783589 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 675/1312] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:00.788611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2a3f4-5b4c-4948-aa26-eb32df28e0b3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:00.789101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2a3f4-5b4c-4948-aa26-eb32df28e0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:00.789205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2a3f4-5b4c-4948-aa26-eb32df28e0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:00.887611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-edd2a3f4-5b4c-4948-aa26-eb32df28e0b3 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:00.888860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-edd2a3f4-5b4c-4948-aa26-eb32df28e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:01.002241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 638/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:01.040580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7198049-56a6-4e2a-b616-c660bc28d945 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:01.042154 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f7198049-56a6-4e2a-b616-c660bc28d945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:01.163423 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7198049-56a6-4e2a-b616-c660bc28d945 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:01.248693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:01.251325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb469939-fa10-4062-9500-a85169e17b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:01.251960 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469939-fa10-4062-9500-a85169e17b29 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:01.252483 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469939-fa10-4062-9500-a85169e17b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:01.252880 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469939-fa10-4062-9500-a85169e17b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:01.254738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bb469939-fa10-4062-9500-a85169e17b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:01.367228 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb469939-fa10-4062-9500-a85169e17b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:01.368687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb469939-fa10-4062-9500-a85169e17b29 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:01.387745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 676/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:03.732838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7e0f6-d030-4efc-b1ac-316aebc496ea None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:03.733437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7e0f6-d030-4efc-b1ac-316aebc496ea None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:03.733437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7e0f6-d030-4efc-b1ac-316aebc496ea None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:03.734857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 639/1315] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:03.740560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176a8c-3f10-4349-9422-39e6bfeafdf6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:03.740984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176a8c-3f10-4349-9422-39e6bfeafdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:03.741170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176a8c-3f10-4349-9422-39e6bfeafdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:03.806259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-98176a8c-3f10-4349-9422-39e6bfeafdf6 None None] MFA Rules not processed for user `552b105a90954a8c9b8f34f2f992b2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:03.807449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-98176a8c-3f10-4349-9422-39e6bfeafdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:03.858017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:03.902868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 677/1316] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:03.943374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7e0f6-d030-4efc-b1ac-316aebc496ea None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:03.944936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-afd7e0f6-d030-4efc-b1ac-316aebc496ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:03.954680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:04.055194 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7e0f6-d030-4efc-b1ac-316aebc496ea None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:04.128789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ab31-715f-479b-b225-cbe28cea691e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:04.129429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ab31-715f-479b-b225-cbe28cea691e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:04.129711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ab31-715f-479b-b225-cbe28cea691e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:04.129985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ab31-715f-479b-b225-cbe28cea691e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:04.131603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-caa9ab31-715f-479b-b225-cbe28cea691e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:04.196407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:04.246514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9ab31-715f-479b-b225-cbe28cea691e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:04.247949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9ab31-715f-479b-b225-cbe28cea691e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:04.266867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 640/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:06.841145 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8837b-2d15-4d9a-b517-da49904e5bff None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:06.841661 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8837b-2d15-4d9a-b517-da49904e5bff None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:06.841779 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8837b-2d15-4d9a-b517-da49904e5bff None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:06.843047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 678/1318] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:06.848215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84afd6-d7c2-495a-8236-718a15e5a234 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:06.848612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84afd6-d7c2-495a-8236-718a15e5a234 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:06.848782 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84afd6-d7c2-495a-8236-718a15e5a234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:06.914880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ae84afd6-d7c2-495a-8236-718a15e5a234 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:06.916088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ae84afd6-d7c2-495a-8236-718a15e5a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:07.012296 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 641/1319] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:07.051904 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8837b-2d15-4d9a-b517-da49904e5bff None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:07.053530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3ca8837b-2d15-4d9a-b517-da49904e5bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:07.155530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8837b-2d15-4d9a-b517-da49904e5bff None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:07.227730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073471a0-9ae5-4ab2-84d5-870c20d2224f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:07.228346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073471a0-9ae5-4ab2-84d5-870c20d2224f service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:07.228626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073471a0-9ae5-4ab2-84d5-870c20d2224f service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:07.228897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073471a0-9ae5-4ab2-84d5-870c20d2224f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:07.230529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-073471a0-9ae5-4ab2-84d5-870c20d2224f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:07.237568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:07.337783 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073471a0-9ae5-4ab2-84d5-870c20d2224f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:07.339295 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073471a0-9ae5-4ab2-84d5-870c20d2224f service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:07.357772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 679/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:10.025610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8166d-216c-4d8f-9a80-da4957edcb71 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:10.026186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8166d-216c-4d8f-9a80-da4957edcb71 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:10.026186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8166d-216c-4d8f-9a80-da4957edcb71 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:10.027522 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 642/1321] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:10.033258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877dce7-95fc-41f3-bd49-eb946fe14fe9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:10.033675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877dce7-95fc-41f3-bd49-eb946fe14fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:10.033820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877dce7-95fc-41f3-bd49-eb946fe14fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:10.099392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8877dce7-95fc-41f3-bd49-eb946fe14fe9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:10.100599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8877dce7-95fc-41f3-bd49-eb946fe14fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:10.164767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:10.209255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 680/1322] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:10.247158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8166d-216c-4d8f-9a80-da4957edcb71 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:10.248689 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3bb8166d-216c-4d8f-9a80-da4957edcb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:10.269896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:10.356487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8166d-216c-4d8f-9a80-da4957edcb71 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:10.434261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed209e7-0284-4d59-9f6e-f4b7200a8d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:10.434884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed209e7-0284-4d59-9f6e-f4b7200a8d15 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:10.435167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed209e7-0284-4d59-9f6e-f4b7200a8d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:10.435444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed209e7-0284-4d59-9f6e-f4b7200a8d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:10.437202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aed209e7-0284-4d59-9f6e-f4b7200a8d15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:10.510140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:10.549714 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed209e7-0284-4d59-9f6e-f4b7200a8d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:10.551130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed209e7-0284-4d59-9f6e-f4b7200a8d15 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:10.570307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 643/1323] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:12.654477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c6514-3c41-4c4b-9cc9-6c78d2b02e2e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:12.654988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c6514-3c41-4c4b-9cc9-6c78d2b02e2e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:12.654988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c6514-3c41-4c4b-9cc9-6c78d2b02e2e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:12.656525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 681/1324] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:12.661719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7695cb-9a84-4dc6-bffd-2021773daf52 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:12.662158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7695cb-9a84-4dc6-bffd-2021773daf52 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:12.662323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7695cb-9a84-4dc6-bffd-2021773daf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:12.727927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4b7695cb-9a84-4dc6-bffd-2021773daf52 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:12.729179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4b7695cb-9a84-4dc6-bffd-2021773daf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:12.827954 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 644/1325] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:12.863724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c6514-3c41-4c4b-9cc9-6c78d2b02e2e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:12.865300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d69c6514-3c41-4c4b-9cc9-6c78d2b02e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:12.972651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c6514-3c41-4c4b-9cc9-6c78d2b02e2e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:13.052381 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81b502-feaa-4848-958c-4fcb0eb6aec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:13.053037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b502-feaa-4848-958c-4fcb0eb6aec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:13.053347 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b502-feaa-4848-958c-4fcb0eb6aec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:13.053628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b502-feaa-4848-958c-4fcb0eb6aec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:13.055256 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bf81b502-feaa-4848-958c-4fcb0eb6aec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:13.072313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:13.168571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81b502-feaa-4848-958c-4fcb0eb6aec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:13.170059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81b502-feaa-4848-958c-4fcb0eb6aec7 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:13.188815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 682/1326] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:15.278477 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1abac8-c219-411b-b815-b37ebc3a6bb7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:15.279022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1abac8-c219-411b-b815-b37ebc3a6bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:15.279022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1abac8-c219-411b-b815-b37ebc3a6bb7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:15.280960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 645/1327] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:15.286253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0782-1537-4add-a129-c113c2e30f97 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:15.286701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0782-1537-4add-a129-c113c2e30f97 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:15.286799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d0782-1537-4add-a129-c113c2e30f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:15.352181 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ff8d0782-1537-4add-a129-c113c2e30f97 None None] MFA Rules not processed for user `552b105a90954a8c9b8f34f2f992b2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:15.353484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ff8d0782-1537-4add-a129-c113c2e30f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:15.422930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:15.456159 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 683/1328] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:15.495026 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1abac8-c219-411b-b815-b37ebc3a6bb7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:15.496624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8d1abac8-c219-411b-b815-b37ebc3a6bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:15.527356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:15.606411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1abac8-c219-411b-b815-b37ebc3a6bb7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:15.680391 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0c0c8-4d6e-4a83-9ab4-e267f82a3b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:15.680971 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c0c8-4d6e-4a83-9ab4-e267f82a3b79 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:15.681236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c0c8-4d6e-4a83-9ab4-e267f82a3b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:15.681508 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0c0c8-4d6e-4a83-9ab4-e267f82a3b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:15.683138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d9a0c0c8-4d6e-4a83-9ab4-e267f82a3b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:15.761000 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:15.793540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0c0c8-4d6e-4a83-9ab4-e267f82a3b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:15.794971 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0c0c8-4d6e-4a83-9ab4-e267f82a3b79 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:15.816133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 646/1329] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:18.102253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88b5e4-c776-4ed1-b035-749cd6d2b086 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:18.102772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88b5e4-c776-4ed1-b035-749cd6d2b086 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:18.102868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88b5e4-c776-4ed1-b035-749cd6d2b086 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:18.104135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 684/1330] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:18.109699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead386b-c345-4bcf-b997-b9586562bd65 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:18.110082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead386b-c345-4bcf-b997-b9586562bd65 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:18.110247 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead386b-c345-4bcf-b997-b9586562bd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:18.175419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-aead386b-c345-4bcf-b997-b9586562bd65 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:18.176619 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aead386b-c345-4bcf-b997-b9586562bd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:18.273323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 647/1331] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:18.325764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cf26f-95e2-4bd9-9b5d-7933a7a01a77 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:18.326049 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cf26f-95e2-4bd9-9b5d-7933a7a01a77 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:18.326324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cf26f-95e2-4bd9-9b5d-7933a7a01a77 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:18.327762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 685/1332] 10.222.0.15 () {54 vars in 965 bytes} [Sat Aug 6 01:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:18.333748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecb4c7-3cc6-41d6-b0f4-aed04e17a958 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:18.334039 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecb4c7-3cc6-41d6-b0f4-aed04e17a958 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:18.334316 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecb4c7-3cc6-41d6-b0f4-aed04e17a958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:18.380188 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:18.412086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-97ecb4c7-3cc6-41d6-b0f4-aed04e17a958 None None] MFA Rules not processed for user `403beb9eb6c04cc69579361138bea12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:18.413340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-97ecb4c7-3cc6-41d6-b0f4-aed04e17a958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:18.490329 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 648/1333] 10.222.0.15 () {58 vars in 1062 bytes} [Sat Aug 6 01:25:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:18.499480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cf26f-95e2-4bd9-9b5d-7933a7a01a77 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:18.501144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3f5cf26f-95e2-4bd9-9b5d-7933a7a01a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:18.603177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cf26f-95e2-4bd9-9b5d-7933a7a01a77 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:18.675837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97e1cc-5e19-41cb-879f-728dec07f552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:18.676376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97e1cc-5e19-41cb-879f-728dec07f552 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:18.676662 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97e1cc-5e19-41cb-879f-728dec07f552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:18.676966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97e1cc-5e19-41cb-879f-728dec07f552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:18.678587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6f97e1cc-5e19-41cb-879f-728dec07f552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:18.705210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:18.787506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97e1cc-5e19-41cb-879f-728dec07f552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:18.788984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97e1cc-5e19-41cb-879f-728dec07f552 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:18.808805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 686/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:21.075946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d9a17-85a8-45c2-b0c8-5f541a428ee9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:21.076601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d9a17-85a8-45c2-b0c8-5f541a428ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:21.076741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d9a17-85a8-45c2-b0c8-5f541a428ee9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:21.078130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 649/1335] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:21.083392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08896bc-7873-483b-8b93-d72825110130 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:21.083857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08896bc-7873-483b-8b93-d72825110130 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:21.083972 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08896bc-7873-483b-8b93-d72825110130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:21.147908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f08896bc-7873-483b-8b93-d72825110130 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:21.149120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f08896bc-7873-483b-8b93-d72825110130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:21.222121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:21.245094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 687/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:21.286610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d9a17-85a8-45c2-b0c8-5f541a428ee9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:21.288122 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7e7d9a17-85a8-45c2-b0c8-5f541a428ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:21.393929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d9a17-85a8-45c2-b0c8-5f541a428ee9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:21.421989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:21.466276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dda5d8-c7a6-4f48-a6c4-6961ed0a2179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:21.466890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dda5d8-c7a6-4f48-a6c4-6961ed0a2179 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:21.467169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dda5d8-c7a6-4f48-a6c4-6961ed0a2179 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:21.467442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dda5d8-c7a6-4f48-a6c4-6961ed0a2179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:21.469789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e1dda5d8-c7a6-4f48-a6c4-6961ed0a2179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:21.577119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dda5d8-c7a6-4f48-a6c4-6961ed0a2179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:21.578564 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dda5d8-c7a6-4f48-a6c4-6961ed0a2179 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:21.596436 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 650/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:24.271654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f74b51-8860-4229-9862-25e1807feeff None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:24.272237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f74b51-8860-4229-9862-25e1807feeff None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:24.272237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f74b51-8860-4229-9862-25e1807feeff None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:24.273595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 688/1338] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:24.278808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e2ab8-bdc9-4f47-aea6-11f7dbe9e1b7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:24.279205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e2ab8-bdc9-4f47-aea6-11f7dbe9e1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:24.279377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e2ab8-bdc9-4f47-aea6-11f7dbe9e1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:24.346125 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-000e2ab8-bdc9-4f47-aea6-11f7dbe9e1b7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:24.347333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-000e2ab8-bdc9-4f47-aea6-11f7dbe9e1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:24.355485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:24.443115 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 651/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:24.479726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f74b51-8860-4229-9862-25e1807feeff None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:24.481300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-16f74b51-8860-4229-9862-25e1807feeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:24.583854 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f74b51-8860-4229-9862-25e1807feeff None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:24.655239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cd945-b2a6-4330-aee6-5df08db96709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:24.655856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cd945-b2a6-4330-aee6-5df08db96709 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:24.656135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cd945-b2a6-4330-aee6-5df08db96709 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:24.656977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cd945-b2a6-4330-aee6-5df08db96709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:24.658715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d81cd945-b2a6-4330-aee6-5df08db96709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:24.694582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:24.767564 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cd945-b2a6-4330-aee6-5df08db96709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:24.769017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cd945-b2a6-4330-aee6-5df08db96709 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:24.786989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 689/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:28.813804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a66cfc-9fef-4c3e-adcb-b835e6b5ac9f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:28.814336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a66cfc-9fef-4c3e-adcb-b835e6b5ac9f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:28.814336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a66cfc-9fef-4c3e-adcb-b835e6b5ac9f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:28.815712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 652/1341] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:28.820930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339c8f-cd20-478b-8505-0b1092405d5f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:28.821412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339c8f-cd20-478b-8505-0b1092405d5f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:28.821516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339c8f-cd20-478b-8505-0b1092405d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:28.889176 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-56339c8f-cd20-478b-8505-0b1092405d5f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:28.890403 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-56339c8f-cd20-478b-8505-0b1092405d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:28.977251 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:28.990206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 690/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:29.029810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a66cfc-9fef-4c3e-adcb-b835e6b5ac9f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:29.031368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a0a66cfc-9fef-4c3e-adcb-b835e6b5ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:29.138682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a66cfc-9fef-4c3e-adcb-b835e6b5ac9f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:29.176529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:29.212880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72f327-6d6c-4f95-a73a-2c381b9905fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:29.213535 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72f327-6d6c-4f95-a73a-2c381b9905fc service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:29.213845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72f327-6d6c-4f95-a73a-2c381b9905fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:29.214118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72f327-6d6c-4f95-a73a-2c381b9905fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:29.215757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1d72f327-6d6c-4f95-a73a-2c381b9905fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:29.329549 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72f327-6d6c-4f95-a73a-2c381b9905fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:29.331035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72f327-6d6c-4f95-a73a-2c381b9905fc service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:29.349727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 653/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:31.963328 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af64e3b-9887-4110-9f59-19bbfbdef54a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:31.963903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af64e3b-9887-4110-9f59-19bbfbdef54a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:31.963903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af64e3b-9887-4110-9f59-19bbfbdef54a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:31.965239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 691/1344] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:31.972216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991ba77-60d0-4d36-9a02-4ee7cf7b1a6c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:31.972818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991ba77-60d0-4d36-9a02-4ee7cf7b1a6c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:31.973169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991ba77-60d0-4d36-9a02-4ee7cf7b1a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:32.047311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6991ba77-60d0-4d36-9a02-4ee7cf7b1a6c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:32.048555 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6991ba77-60d0-4d36-9a02-4ee7cf7b1a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:32.067932 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:32.153006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 654/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:32.191147 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af64e3b-9887-4110-9f59-19bbfbdef54a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:32.192667 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9af64e3b-9887-4110-9f59-19bbfbdef54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:32.301006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af64e3b-9887-4110-9f59-19bbfbdef54a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:32.379934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441ee7a-2202-4f0c-9606-97f904661c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:32.380559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441ee7a-2202-4f0c-9606-97f904661c37 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:32.380839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441ee7a-2202-4f0c-9606-97f904661c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:32.381138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441ee7a-2202-4f0c-9606-97f904661c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:32.383028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4441ee7a-2202-4f0c-9606-97f904661c37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:32.428425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:32.496740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441ee7a-2202-4f0c-9606-97f904661c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:32.498199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441ee7a-2202-4f0c-9606-97f904661c37 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:32.517147 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 692/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:36.567279 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5c3b-6100-448d-bb0f-3651de7c0644 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:36.567855 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5c3b-6100-448d-bb0f-3651de7c0644 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:36.567855 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5c3b-6100-448d-bb0f-3651de7c0644 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:36.569455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 655/1347] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:25:36.575168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6dc69-fff1-4d79-91a1-e18c47211ce8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:36.575576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6dc69-fff1-4d79-91a1-e18c47211ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:36.575728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6dc69-fff1-4d79-91a1-e18c47211ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:36.644959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-dde6dc69-fff1-4d79-91a1-e18c47211ce8 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:36.646099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-dde6dc69-fff1-4d79-91a1-e18c47211ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:36.745314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:36.748875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 693/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:36.787807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5c3b-6100-448d-bb0f-3651de7c0644 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:36.789417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f41b5c3b-6100-448d-bb0f-3651de7c0644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:36.922090 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5c3b-6100-448d-bb0f-3651de7c0644 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:36.974497 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:37.004858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644bba4-c22a-4f14-b469-5955db74ca0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:37.005519 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644bba4-c22a-4f14-b469-5955db74ca0a service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:37.005804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644bba4-c22a-4f14-b469-5955db74ca0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:37.006078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644bba4-c22a-4f14-b469-5955db74ca0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:37.008014 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c644bba4-c22a-4f14-b469-5955db74ca0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:37.129848 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644bba4-c22a-4f14-b469-5955db74ca0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:37.131607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644bba4-c22a-4f14-b469-5955db74ca0a service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:37.153082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 656/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:42.143447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbd02a-a2af-4145-9325-9c1c56ef536f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:42.143871 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbd02a-a2af-4145-9325-9c1c56ef536f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:42.144073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbd02a-a2af-4145-9325-9c1c56ef536f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:42.146328 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 694/1350] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:42.152450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17891-a592-4e73-ab50-c15cf65c9906 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:42.152948 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17891-a592-4e73-ab50-c15cf65c9906 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:42.153034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17891-a592-4e73-ab50-c15cf65c9906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:42.257586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4ae17891-a592-4e73-ab50-c15cf65c9906 None None] MFA Rules not processed for user `fc1bd453c1114da4a5d9aa543bf1ff32`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:42.258894 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4ae17891-a592-4e73-ab50-c15cf65c9906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:42.292666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:42.415641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 657/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:46.654550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869895e6-d27a-4af7-94b5-71c7175f78e6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:46.655788 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869895e6-d27a-4af7-94b5-71c7175f78e6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:46.656209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869895e6-d27a-4af7-94b5-71c7175f78e6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:46.657730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 695/1352] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:25:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:46.663221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde7e84-4c0d-4207-a404-897b683a3657 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:46.663665 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde7e84-4c0d-4207-a404-897b683a3657 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:46.663878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde7e84-4c0d-4207-a404-897b683a3657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:46.744635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-afde7e84-4c0d-4207-a404-897b683a3657 None None] MFA Rules not processed for user `fc1bd453c1114da4a5d9aa543bf1ff32`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:46.745885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-afde7e84-4c0d-4207-a404-897b683a3657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:46.821859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:46.865960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 658/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:48.191938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a2f46-8d63-46c9-9635-768cc2968b77 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:48.192467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a2f46-8d63-46c9-9635-768cc2968b77 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:48.192467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a2f46-8d63-46c9-9635-768cc2968b77 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:48.193826 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 696/1354] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:48.199051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f79ad-4c0d-4587-9284-6aaad7abfe7c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:48.199464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f79ad-4c0d-4587-9284-6aaad7abfe7c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:48.199607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f79ad-4c0d-4587-9284-6aaad7abfe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:48.276878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-569f79ad-4c0d-4587-9284-6aaad7abfe7c None None] MFA Rules not processed for user `fc1bd453c1114da4a5d9aa543bf1ff32`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:48.278134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-569f79ad-4c0d-4587-9284-6aaad7abfe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:48.390588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 659/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:25:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:51.747862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3a25c-5ec7-40b8-94a9-a21a86bee14b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:51.749520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3a25c-5ec7-40b8-94a9-a21a86bee14b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:51.749837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3a25c-5ec7-40b8-94a9-a21a86bee14b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:51.751285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 697/1356] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:51.757632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb4a1c-2ad5-43cc-ab66-8a4d001b1e82 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:51.758460 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb4a1c-2ad5-43cc-ab66-8a4d001b1e82 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:51.758898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb4a1c-2ad5-43cc-ab66-8a4d001b1e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:51.809310 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:51.844216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6feb4a1c-2ad5-43cc-ab66-8a4d001b1e82 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:51.845481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6feb4a1c-2ad5-43cc-ab66-8a4d001b1e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:51.948041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 660/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:52.005314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa019b4-ba20-44ea-9bc7-3e13f485bdef None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:52.006311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa019b4-ba20-44ea-9bc7-3e13f485bdef None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:52.007786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa019b4-ba20-44ea-9bc7-3e13f485bdef None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:52.009737 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 698/1358] 10.222.0.15 () {54 vars in 962 bytes} [Sat Aug 6 01:25:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:52.021581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9a593-a3ca-4727-a156-45370216dbea None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:52.022164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9a593-a3ca-4727-a156-45370216dbea None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:52.022626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9a593-a3ca-4727-a156-45370216dbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:52.107070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f7a9a593-a3ca-4727-a156-45370216dbea None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:52.108606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f7a9a593-a3ca-4727-a156-45370216dbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:52.162980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:52.239079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 661/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Sat Aug 6 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:52.246903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa019b4-ba20-44ea-9bc7-3e13f485bdef None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:52.249078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5aa019b4-ba20-44ea-9bc7-3e13f485bdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:52.405079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa019b4-ba20-44ea-9bc7-3e13f485bdef None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:52.503285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:52.548932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5876cca-fa28-415b-a9d5-96ef7303ad16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:52.549722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5876cca-fa28-415b-a9d5-96ef7303ad16 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:52.550107 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5876cca-fa28-415b-a9d5-96ef7303ad16 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:52.550576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5876cca-fa28-415b-a9d5-96ef7303ad16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:52.552202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a5876cca-fa28-415b-a9d5-96ef7303ad16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:52.650702 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5876cca-fa28-415b-a9d5-96ef7303ad16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:52.652440 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5876cca-fa28-415b-a9d5-96ef7303ad16 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:52.672641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 699/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:54.905622 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb30a-863b-41cf-9f17-01bbe7b7bec2 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:54.906510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb30a-863b-41cf-9f17-01bbe7b7bec2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:54.906510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb30a-863b-41cf-9f17-01bbe7b7bec2 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:54.907438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 662/1361] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:54.913012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e1d03-6688-446d-aca5-0a1a89dee9b6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:54.913524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e1d03-6688-446d-aca5-0a1a89dee9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:54.913628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e1d03-6688-446d-aca5-0a1a89dee9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:54.983112 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d99e1d03-6688-446d-aca5-0a1a89dee9b6 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:54.984474 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d99e1d03-6688-446d-aca5-0a1a89dee9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:55.023529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:55.087732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 700/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:55.133307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb30a-863b-41cf-9f17-01bbe7b7bec2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:55.135040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8cffb30a-863b-41cf-9f17-01bbe7b7bec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:55.312759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb30a-863b-41cf-9f17-01bbe7b7bec2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:55.322854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:55.454830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93b4d8-455a-4fc3-8637-e0d4668ac6c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:55.455450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93b4d8-455a-4fc3-8637-e0d4668ac6c2 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:55.455804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93b4d8-455a-4fc3-8637-e0d4668ac6c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:55.456131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93b4d8-455a-4fc3-8637-e0d4668ac6c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:55.458159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ef93b4d8-455a-4fc3-8637-e0d4668ac6c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:55.555470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93b4d8-455a-4fc3-8637-e0d4668ac6c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:55.557196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93b4d8-455a-4fc3-8637-e0d4668ac6c2 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:55.576743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 663/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:57.952388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4d57a-64b5-4d8c-b3a3-abdca9222963 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:57.953034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4d57a-64b5-4d8c-b3a3-abdca9222963 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:57.953401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4d57a-64b5-4d8c-b3a3-abdca9222963 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:57.955254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 701/1364] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:57.960589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900d287-3bf7-49e0-822f-fed0559757bc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:57.961199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900d287-3bf7-49e0-822f-fed0559757bc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:57.961199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900d287-3bf7-49e0-822f-fed0559757bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:57.979390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:58.039753 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a900d287-3bf7-49e0-822f-fed0559757bc None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:58.041319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a900d287-3bf7-49e0-822f-fed0559757bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:58.155635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 664/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:58.200656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedafdfd-b794-4f10-a905-9aa87ba458af None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:58.201157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedafdfd-b794-4f10-a905-9aa87ba458af None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:58.201450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedafdfd-b794-4f10-a905-9aa87ba458af None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:58.202875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 702/1366] 10.222.0.15 () {54 vars in 962 bytes} [Sat Aug 6 01:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:58.208266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c2ad0-42e3-4919-9304-9e9032f1ea98 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:58.208560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c2ad0-42e3-4919-9304-9e9032f1ea98 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:58.208836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c2ad0-42e3-4919-9304-9e9032f1ea98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:58.292516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-634c2ad0-42e3-4919-9304-9e9032f1ea98 None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:58.293749 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-634c2ad0-42e3-4919-9304-9e9032f1ea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:58.330669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:58.426713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 665/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Sat Aug 6 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:58.436171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedafdfd-b794-4f10-a905-9aa87ba458af None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:58.437913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-eedafdfd-b794-4f10-a905-9aa87ba458af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:58.590065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedafdfd-b794-4f10-a905-9aa87ba458af None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:58.611225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:58.710656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfc180-3ff1-4854-b037-9fb92879480f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:58.711273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfc180-3ff1-4854-b037-9fb92879480f service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:58.711552 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfc180-3ff1-4854-b037-9fb92879480f service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:58.711838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfc180-3ff1-4854-b037-9fb92879480f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:58.713586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-71bfc180-3ff1-4854-b037-9fb92879480f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:58.808782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfc180-3ff1-4854-b037-9fb92879480f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:58.810998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfc180-3ff1-4854-b037-9fb92879480f service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:58.830282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 703/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:59.844738 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40972425-218f-43a8-a3c5-598fb9f808c9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:59.845334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40972425-218f-43a8-a3c5-598fb9f808c9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:59.845334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40972425-218f-43a8-a3c5-598fb9f808c9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:59.847009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 666/1369] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:25:59.851941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa42b7-38e6-485a-b484-f19942961684 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:59.852350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa42b7-38e6-485a-b484-f19942961684 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:59.852518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa42b7-38e6-485a-b484-f19942961684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:59.885689 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:59.923439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-beaa42b7-38e6-485a-b484-f19942961684 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:59.924630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-beaa42b7-38e6-485a-b484-f19942961684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:00.031192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 704/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:00.401600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c213d5-9e41-4322-9b03-3e9e50ddf4c7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:00.401600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c213d5-9e41-4322-9b03-3e9e50ddf4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:00.401600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c213d5-9e41-4322-9b03-3e9e50ddf4c7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:00.403417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 667/1371] 10.222.0.15 () {54 vars in 964 bytes} [Sat Aug 6 01:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:00.408435 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b0b57-e01a-4e35-b807-bdc2a1d78cc5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:00.408824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b0b57-e01a-4e35-b807-bdc2a1d78cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:00.409146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b0b57-e01a-4e35-b807-bdc2a1d78cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:00.493477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6c5b0b57-e01a-4e35-b807-bdc2a1d78cc5 None None] MFA Rules not processed for user `acd6aba844f04489adec2ce9f1eb49dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:00.494704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6c5b0b57-e01a-4e35-b807-bdc2a1d78cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:00.544018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:00.578582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 705/1372] 10.222.0.15 () {58 vars in 1061 bytes} [Sat Aug 6 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:00.586197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c213d5-9e41-4322-9b03-3e9e50ddf4c7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:00.587706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-72c213d5-9e41-4322-9b03-3e9e50ddf4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:00.707268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c213d5-9e41-4322-9b03-3e9e50ddf4c7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:00.750064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:00.789449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6480d2c-46f1-4c8a-a05e-9519dc5549f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:00.790082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6480d2c-46f1-4c8a-a05e-9519dc5549f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:00.790368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6480d2c-46f1-4c8a-a05e-9519dc5549f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:00.790644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6480d2c-46f1-4c8a-a05e-9519dc5549f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:00.792287 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a6480d2c-46f1-4c8a-a05e-9519dc5549f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:00.909222 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6480d2c-46f1-4c8a-a05e-9519dc5549f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:00.910718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6480d2c-46f1-4c8a-a05e-9519dc5549f9 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:00.930841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 668/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:00.936571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd56bb-97be-4c89-8740-a1e893e5643a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:00.937173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd56bb-97be-4c89-8740-a1e893e5643a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:00.937173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd56bb-97be-4c89-8740-a1e893e5643a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:00.938410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 706/1374] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:00.943601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebcf78-48a1-47bb-8533-e196b6cb60a9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:00.943898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebcf78-48a1-47bb-8533-e196b6cb60a9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:00.944172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebcf78-48a1-47bb-8533-e196b6cb60a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:01.012509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-29ebcf78-48a1-47bb-8533-e196b6cb60a9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:01.013909 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-29ebcf78-48a1-47bb-8533-e196b6cb60a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:01.036153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:01.129312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 669/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:01.172603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd56bb-97be-4c89-8740-a1e893e5643a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:01.174085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-abbd56bb-97be-4c89-8740-a1e893e5643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:01.336032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd56bb-97be-4c89-8740-a1e893e5643a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:01.389754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:01.451959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d86bdd-1d00-4a57-9414-e1718ab47caf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:01.452584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d86bdd-1d00-4a57-9414-e1718ab47caf service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:01.452869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d86bdd-1d00-4a57-9414-e1718ab47caf service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:01.453176 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d86bdd-1d00-4a57-9414-e1718ab47caf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:01.454818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-94d86bdd-1d00-4a57-9414-e1718ab47caf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:01.544816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d86bdd-1d00-4a57-9414-e1718ab47caf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:01.546639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d86bdd-1d00-4a57-9414-e1718ab47caf service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:01.565254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 707/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:03.633882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167acad2-5766-48bf-912a-c5866560ec3d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.634437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167acad2-5766-48bf-912a-c5866560ec3d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.634437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167acad2-5766-48bf-912a-c5866560ec3d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.635791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 670/1377] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:03.641573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a87b7c-3e76-4960-9944-3219799772c5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.642337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a87b7c-3e76-4960-9944-3219799772c5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.642617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a87b7c-3e76-4960-9944-3219799772c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.709081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-82a87b7c-3e76-4960-9944-3219799772c5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:03.710283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-82a87b7c-3e76-4960-9944-3219799772c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:03.717468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:03.816034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 708/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:03.861101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167acad2-5766-48bf-912a-c5866560ec3d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.862625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-167acad2-5766-48bf-912a-c5866560ec3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:04.027901 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167acad2-5766-48bf-912a-c5866560ec3d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:04.031525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:04.139828 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f13ff-c5fd-4cbf-bf84-48632082974d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:04.140451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f13ff-c5fd-4cbf-bf84-48632082974d service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:04.140732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f13ff-c5fd-4cbf-bf84-48632082974d service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:04.141044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f13ff-c5fd-4cbf-bf84-48632082974d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:04.143712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a88f13ff-c5fd-4cbf-bf84-48632082974d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:04.236286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f13ff-c5fd-4cbf-bf84-48632082974d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:04.238004 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f13ff-c5fd-4cbf-bf84-48632082974d service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:04.256556 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 671/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:06.351446 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f66905-12e3-4c38-9bb2-22a761aa632f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.352026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f66905-12e3-4c38-9bb2-22a761aa632f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.352026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f66905-12e3-4c38-9bb2-22a761aa632f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.353551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 709/1380] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:06.358699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a848e-4c8e-4b8d-b244-08776c505f86 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.359140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a848e-4c8e-4b8d-b244-08776c505f86 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.359245 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a848e-4c8e-4b8d-b244-08776c505f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.375002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:06.433991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-af8a848e-4c8e-4b8d-b244-08776c505f86 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:06.435868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-af8a848e-4c8e-4b8d-b244-08776c505f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:06.547904 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 672/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:06.593118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f66905-12e3-4c38-9bb2-22a761aa632f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.594632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-36f66905-12e3-4c38-9bb2-22a761aa632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:06.741546 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:06.756009 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f66905-12e3-4c38-9bb2-22a761aa632f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:06.880007 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48f2aa-f4bf-41a6-b8a6-64e28eb5ab70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:06.880629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f2aa-f4bf-41a6-b8a6-64e28eb5ab70 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.880925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f2aa-f4bf-41a6-b8a6-64e28eb5ab70 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.881476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f2aa-f4bf-41a6-b8a6-64e28eb5ab70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.883105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9f48f2aa-f4bf-41a6-b8a6-64e28eb5ab70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:06.983501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48f2aa-f4bf-41a6-b8a6-64e28eb5ab70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:06.986038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48f2aa-f4bf-41a6-b8a6-64e28eb5ab70 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.998945 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:07.010581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 710/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:09.105170 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd256432-5bf1-4547-a6b2-1ddd87d78d61 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:09.105960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd256432-5bf1-4547-a6b2-1ddd87d78d61 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:09.105960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd256432-5bf1-4547-a6b2-1ddd87d78d61 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:09.108685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 673/1383] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:26:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:09.115071 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a55ce-1439-4f67-8140-6854ef567fe8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:09.115613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a55ce-1439-4f67-8140-6854ef567fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:09.115729 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a55ce-1439-4f67-8140-6854ef567fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:09.194520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-418a55ce-1439-4f67-8140-6854ef567fe8 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:09.195767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-418a55ce-1439-4f67-8140-6854ef567fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:09.298393 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 711/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:09.341926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd256432-5bf1-4547-a6b2-1ddd87d78d61 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:09.343522 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bd256432-5bf1-4547-a6b2-1ddd87d78d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:09.433663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:09.498983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd256432-5bf1-4547-a6b2-1ddd87d78d61 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:09.625201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859e60f-b7f3-4bc7-8136-3beb162becc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:09.626199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859e60f-b7f3-4bc7-8136-3beb162becc8 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:09.626754 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859e60f-b7f3-4bc7-8136-3beb162becc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:09.627123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859e60f-b7f3-4bc7-8136-3beb162becc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:09.629449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e859e60f-b7f3-4bc7-8136-3beb162becc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:09.694279 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:09.740158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859e60f-b7f3-4bc7-8136-3beb162becc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:09.741868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859e60f-b7f3-4bc7-8136-3beb162becc8 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:09.763346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 674/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:11.812676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795f2db-0d67-458b-b86f-4e9262924494 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:11.813257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795f2db-0d67-458b-b86f-4e9262924494 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:11.813257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795f2db-0d67-458b-b86f-4e9262924494 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:11.814621 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 712/1386] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:11.819885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210167c-2a8e-4d37-8187-881d776627be None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:11.820472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210167c-2a8e-4d37-8187-881d776627be None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:11.820472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210167c-2a8e-4d37-8187-881d776627be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:11.889853 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6210167c-2a8e-4d37-8187-881d776627be None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:11.891091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6210167c-2a8e-4d37-8187-881d776627be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:11.996070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 675/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:12.042867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795f2db-0d67-458b-b86f-4e9262924494 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.044485 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0795f2db-0d67-458b-b86f-4e9262924494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:12.122145 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:12.193540 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795f2db-0d67-458b-b86f-4e9262924494 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.321832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920b3fb-2c68-4a3a-8a09-9d1805167c45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.322471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b3fb-2c68-4a3a-8a09-9d1805167c45 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.322805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b3fb-2c68-4a3a-8a09-9d1805167c45 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.323078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b3fb-2c68-4a3a-8a09-9d1805167c45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.324672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6920b3fb-2c68-4a3a-8a09-9d1805167c45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:12.364253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:12.431269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920b3fb-2c68-4a3a-8a09-9d1805167c45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.432940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920b3fb-2c68-4a3a-8a09-9d1805167c45 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.452354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 713/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:14.523470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42196812-0955-46c9-abb6-6bfb9ea14def None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:14.524002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42196812-0955-46c9-abb6-6bfb9ea14def None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:14.524002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42196812-0955-46c9-abb6-6bfb9ea14def None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:14.525750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 676/1389] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:14.531628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeef8dc-f5fb-4969-99f9-da17163d504b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:14.532089 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeef8dc-f5fb-4969-99f9-da17163d504b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:14.532184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeef8dc-f5fb-4969-99f9-da17163d504b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:14.599589 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-eeeef8dc-f5fb-4969-99f9-da17163d504b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:14.600799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-eeeef8dc-f5fb-4969-99f9-da17163d504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:14.702799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 714/1390] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:14.747599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42196812-0955-46c9-abb6-6bfb9ea14def None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:14.749232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-42196812-0955-46c9-abb6-6bfb9ea14def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:14.782931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:14.898153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42196812-0955-46c9-abb6-6bfb9ea14def None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:14.999620 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:15.012538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d6f69-63b2-4d01-8b6d-e3a053459af4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:15.013184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d6f69-63b2-4d01-8b6d-e3a053459af4 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:15.013464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d6f69-63b2-4d01-8b6d-e3a053459af4 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:15.013757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d6f69-63b2-4d01-8b6d-e3a053459af4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:15.015341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f58d6f69-63b2-4d01-8b6d-e3a053459af4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:15.109344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d6f69-63b2-4d01-8b6d-e3a053459af4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:15.110937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d6f69-63b2-4d01-8b6d-e3a053459af4 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:15.129575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 677/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:15.970395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c371111-b195-46fd-ae64-894ff4646345 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:15.970934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c371111-b195-46fd-ae64-894ff4646345 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:15.970934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c371111-b195-46fd-ae64-894ff4646345 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:15.972427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 715/1392] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:15.977465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3e798-3302-4b30-96f9-7dd57a150b3c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:15.977923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3e798-3302-4b30-96f9-7dd57a150b3c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:15.978022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3e798-3302-4b30-96f9-7dd57a150b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:16.045878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e8b3e798-3302-4b30-96f9-7dd57a150b3c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:16.047080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e8b3e798-3302-4b30-96f9-7dd57a150b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:16.104816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:16.145544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 678/1393] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:16.202481 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a038b0-2e39-49a9-8ae8-31ea583ed0a6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:16.202767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a038b0-2e39-49a9-8ae8-31ea583ed0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:16.203042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a038b0-2e39-49a9-8ae8-31ea583ed0a6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:16.204355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 716/1394] 10.222.0.15 () {54 vars in 966 bytes} [Sat Aug 6 01:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:16.209365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709bbc9-c61f-4248-af8d-b22bb1e9cced None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:16.209655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709bbc9-c61f-4248-af8d-b22bb1e9cced None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:16.209935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709bbc9-c61f-4248-af8d-b22bb1e9cced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:16.293635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5709bbc9-c61f-4248-af8d-b22bb1e9cced None None] MFA Rules not processed for user `da39170a654d4d52a39b4b2c8cfd8906`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:16.295023 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5709bbc9-c61f-4248-af8d-b22bb1e9cced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:16.375064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 679/1395] 10.222.0.15 () {58 vars in 1063 bytes} [Sat Aug 6 01:26:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:16.383321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a038b0-2e39-49a9-8ae8-31ea583ed0a6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:16.384813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-88a038b0-2e39-49a9-8ae8-31ea583ed0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:16.398898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:16.493344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a038b0-2e39-49a9-8ae8-31ea583ed0a6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:16.568986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c5eef-987a-45b9-a685-4d4e9efc96b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da39170a654d4d52a39b4b2c8cfd8906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:16.569530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c5eef-987a-45b9-a685-4d4e9efc96b5 service glance] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:16.569814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c5eef-987a-45b9-a685-4d4e9efc96b5 service glance] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:16.570094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c5eef-987a-45b9-a685-4d4e9efc96b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:16.571716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-550c5eef-987a-45b9-a685-4d4e9efc96b5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:16.642370 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:16.685250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c5eef-987a-45b9-a685-4d4e9efc96b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:16.686718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c5eef-987a-45b9-a685-4d4e9efc96b5 service glance] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:16.704651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 717/1396] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:17.178303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43596-e9c3-49a7-a61c-64e185a7cfaa None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:17.178862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43596-e9c3-49a7-a61c-64e185a7cfaa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:17.178862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43596-e9c3-49a7-a61c-64e185a7cfaa None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:17.180213 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 680/1397] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:17.185719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb41fe-4ac3-4353-ba85-eb31ecdc6a08 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:17.186159 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb41fe-4ac3-4353-ba85-eb31ecdc6a08 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:17.186302 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb41fe-4ac3-4353-ba85-eb31ecdc6a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:17.256785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e6fb41fe-4ac3-4353-ba85-eb31ecdc6a08 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:17.258131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e6fb41fe-4ac3-4353-ba85-eb31ecdc6a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:17.365128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 718/1398] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:17.412167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f43596-e9c3-49a7-a61c-64e185a7cfaa None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:17.413840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-03f43596-e9c3-49a7-a61c-64e185a7cfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:17.454431 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f965b-e17f-40e7-8d48-f7d58173122f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:17.454724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f965b-e17f-40e7-8d48-f7d58173122f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:17.455002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f965b-e17f-40e7-8d48-f7d58173122f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:17.482800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:17.483845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:17.527677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-699f965b-e17f-40e7-8d48-f7d58173122f None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:17.529012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-699f965b-e17f-40e7-8d48-f7d58173122f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:17.568485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f43596-e9c3-49a7-a61c-64e185a7cfaa None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:17.616113 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 719/1399] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:17.661016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665bce0-f18c-43d4-bbb2-97a1246df786 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:17.661312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665bce0-f18c-43d4-bbb2-97a1246df786 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:17.661843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665bce0-f18c-43d4-bbb2-97a1246df786 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:17.663229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 720/1400] 10.222.0.15 () {54 vars in 943 bytes} [Sat Aug 6 01:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:26:17.669772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac7be4-6ab6-482a-bbfd-b4dc93c7cb9e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:17.670050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac7be4-6ab6-482a-bbfd-b4dc93c7cb9e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:17.670320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac7be4-6ab6-482a-bbfd-b4dc93c7cb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:17.688727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e383030-9368-4440-a6b4-04c849499062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:17.689452 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e383030-9368-4440-a6b4-04c849499062 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:17.689730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e383030-9368-4440-a6b4-04c849499062 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:17.690341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e383030-9368-4440-a6b4-04c849499062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:17.691666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9e383030-9368-4440-a6b4-04c849499062 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:17.712546 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:17.746546 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e5ac7be4-6ab6-482a-bbfd-b4dc93c7cb9e None None] MFA Rules not processed for user `a8d43b9ceeba432db6d141bb52d4bf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:17.747814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e5ac7be4-6ab6-482a-bbfd-b4dc93c7cb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:17.785909 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e383030-9368-4440-a6b4-04c849499062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:17.787489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e383030-9368-4440-a6b4-04c849499062 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:17.801793 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:17.807199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 681/1401] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:17.861569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 721/1402] 10.222.0.15 () {58 vars in 1040 bytes} [Sat Aug 6 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:17.871209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e383030-9368-4440-a6b4-04c849499062 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:17.873201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9e383030-9368-4440-a6b4-04c849499062 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:17.983503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e383030-9368-4440-a6b4-04c849499062 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:18.046207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:18.095677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ce781-a64b-414e-8c86-ac89829132f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:18.096298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ce781-a64b-414e-8c86-ac89829132f8 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.096582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ce781-a64b-414e-8c86-ac89829132f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.096860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ce781-a64b-414e-8c86-ac89829132f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.098556 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-353ce781-a64b-414e-8c86-ac89829132f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:18.184572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ce781-a64b-414e-8c86-ac89829132f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:18.186197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ce781-a64b-414e-8c86-ac89829132f8 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:18.194552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 682/1403] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:26:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:26:19.877439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb89a-c069-4fbb-a850-18c5d5cbe43e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:19.877439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb89a-c069-4fbb-a850-18c5d5cbe43e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:19.877439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb89a-c069-4fbb-a850-18c5d5cbe43e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:19.877439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 722/1404] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:26:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:19.879611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2761115-8ae4-49e3-af0c-e3b36ef9ba72 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:19.879611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2761115-8ae4-49e3-af0c-e3b36ef9ba72 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:19.879611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2761115-8ae4-49e3-af0c-e3b36ef9ba72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:19.967061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f2761115-8ae4-49e3-af0c-e3b36ef9ba72 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:19.968306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f2761115-8ae4-49e3-af0c-e3b36ef9ba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:20.040653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:20.101148 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 683/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:20.145938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fb89a-c069-4fbb-a850-18c5d5cbe43e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:20.147467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1e0fb89a-c069-4fbb-a850-18c5d5cbe43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:20.311894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fb89a-c069-4fbb-a850-18c5d5cbe43e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:20.343220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:20.446998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c242c-2b0f-4e72-aada-9f300c2c032b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:20.447536 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c242c-2b0f-4e72-aada-9f300c2c032b service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:20.447814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c242c-2b0f-4e72-aada-9f300c2c032b service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:20.448083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c242c-2b0f-4e72-aada-9f300c2c032b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:20.449843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f96c242c-2b0f-4e72-aada-9f300c2c032b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:20.552982 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c242c-2b0f-4e72-aada-9f300c2c032b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:20.554846 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c242c-2b0f-4e72-aada-9f300c2c032b service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:20.575040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 723/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:26:22.632352 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fc96f-4e00-4fe2-a97a-eabb3a542d0d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:22.632871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fc96f-4e00-4fe2-a97a-eabb3a542d0d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:22.632871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fc96f-4e00-4fe2-a97a-eabb3a542d0d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:22.634390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 684/1407] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:22.640491 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45bbb9-e8ac-4f5e-9302-8571042f8bfb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:22.640946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45bbb9-e8ac-4f5e-9302-8571042f8bfb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:22.641061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45bbb9-e8ac-4f5e-9302-8571042f8bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:22.688236 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:22.717408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-bf45bbb9-e8ac-4f5e-9302-8571042f8bfb None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:22.718634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bf45bbb9-e8ac-4f5e-9302-8571042f8bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:22.823562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 724/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:22.868589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fc96f-4e00-4fe2-a97a-eabb3a542d0d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:22.870243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3c7fc96f-4e00-4fe2-a97a-eabb3a542d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:23.035177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fc96f-4e00-4fe2-a97a-eabb3a542d0d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:23.064031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:23.163802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fef70-6fd7-449f-8938-c7a51c819467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:23.164426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fef70-6fd7-449f-8938-c7a51c819467 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:23.164711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fef70-6fd7-449f-8938-c7a51c819467 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:23.165021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fef70-6fd7-449f-8938-c7a51c819467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:23.166666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-063fef70-6fd7-449f-8938-c7a51c819467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:23.261762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fef70-6fd7-449f-8938-c7a51c819467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:23.264063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fef70-6fd7-449f-8938-c7a51c819467 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:23.288358 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 685/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:32.821654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=51 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:33.285270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=86 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:40.545588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616b9ab-d979-405d-a011-5eebb184b7f4 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:40.546144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616b9ab-d979-405d-a011-5eebb184b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:40.546144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616b9ab-d979-405d-a011-5eebb184b7f4 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:40.547490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 725/1410] 10.222.0.15 () {54 vars in 918 bytes} [Sat Aug 6 01:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:40.553351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6c24f-ea89-4471-9fce-54963b93ba59 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:40.553797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6c24f-ea89-4471-9fce-54963b93ba59 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:40.553901 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6c24f-ea89-4471-9fce-54963b93ba59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:40.631001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-22f6c24f-ea89-4471-9fce-54963b93ba59 None None] MFA Rules not processed for user `fc1bd453c1114da4a5d9aa543bf1ff32`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:40.632128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-22f6c24f-ea89-4471-9fce-54963b93ba59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:40.738710 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 686/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Aug 6 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:40.753787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962beaf2-b7a5-4ac1-89d5-ae54b76c8453 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:40.754072 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962beaf2-b7a5-4ac1-89d5-ae54b76c8453 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:40.754345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962beaf2-b7a5-4ac1-89d5-ae54b76c8453 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:40.755920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 726/1412] 10.222.0.15 () {54 vars in 918 bytes} [Sat Aug 6 01:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:40.760463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715c4bf-d450-4197-9064-1758db21a91c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:40.761470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715c4bf-d450-4197-9064-1758db21a91c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:40.761964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715c4bf-d450-4197-9064-1758db21a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:40.835424 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:40.838411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0715c4bf-d450-4197-9064-1758db21a91c None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:40.840735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0715c4bf-d450-4197-9064-1758db21a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:40.954542 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 687/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Aug 6 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:43.440955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98baf-38fa-4516-b4e7-96641d66df8f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:43.441522 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98baf-38fa-4516-b4e7-96641d66df8f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:43.441522 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98baf-38fa-4516-b4e7-96641d66df8f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:43.442881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 727/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:43.448187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4032d-8627-4a9e-ba6a-32d1ff93e101 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:43.448833 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4032d-8627-4a9e-ba6a-32d1ff93e101 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:43.448833 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4032d-8627-4a9e-ba6a-32d1ff93e101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:43.516393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-04f4032d-8627-4a9e-ba6a-32d1ff93e101 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:43.517631 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-04f4032d-8627-4a9e-ba6a-32d1ff93e101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:43.572581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:43.614896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 688/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:43.660045 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd98baf-38fa-4516-b4e7-96641d66df8f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:43.661562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bcd98baf-38fa-4516-b4e7-96641d66df8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:43.808643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd98baf-38fa-4516-b4e7-96641d66df8f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:43.881794 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:43.922585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118d010-8e48-4922-bb15-2aca38575db5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:43.923201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118d010-8e48-4922-bb15-2aca38575db5 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:43.923480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118d010-8e48-4922-bb15-2aca38575db5 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:43.923753 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118d010-8e48-4922-bb15-2aca38575db5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:43.925419 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1118d010-8e48-4922-bb15-2aca38575db5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:44.016288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118d010-8e48-4922-bb15-2aca38575db5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:44.017942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118d010-8e48-4922-bb15-2aca38575db5 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:44.036478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 728/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:44.951598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f023f-0fce-4566-95b6-adb241a4c708 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:44.952169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f023f-0fce-4566-95b6-adb241a4c708 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:44.952169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f023f-0fce-4566-95b6-adb241a4c708 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:44.953581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 689/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:44.958407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305347-cb69-49d7-bdfc-706270325efa None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:44.958835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305347-cb69-49d7-bdfc-706270325efa None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:44.958973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305347-cb69-49d7-bdfc-706270325efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:45.035562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d7305347-cb69-49d7-bdfc-706270325efa None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:45.036787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d7305347-cb69-49d7-bdfc-706270325efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:45.063699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:45.133845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 729/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:45.285246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f023f-0fce-4566-95b6-adb241a4c708 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:45.286800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-095f023f-0fce-4566-95b6-adb241a4c708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:45.433724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f023f-0fce-4566-95b6-adb241a4c708 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:45.473362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:45.547662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d565c2-6ac3-4d9f-b5c6-9cf5e09bbb3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:45.548197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d565c2-6ac3-4d9f-b5c6-9cf5e09bbb3d service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:45.548483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d565c2-6ac3-4d9f-b5c6-9cf5e09bbb3d service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:45.548762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d565c2-6ac3-4d9f-b5c6-9cf5e09bbb3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:45.550417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-82d565c2-6ac3-4d9f-b5c6-9cf5e09bbb3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:45.639036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d565c2-6ac3-4d9f-b5c6-9cf5e09bbb3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:45.640616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d565c2-6ac3-4d9f-b5c6-9cf5e09bbb3d service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:45.658631 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 690/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:46.562682 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f35e1-dcc0-4fa3-ba3a-93b8f30d6546 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.563283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f35e1-dcc0-4fa3-ba3a-93b8f30d6546 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.563283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f35e1-dcc0-4fa3-ba3a-93b8f30d6546 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.564667 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 730/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:46.569768 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef50e7-5535-4819-9e00-b2b355234c99 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.570224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef50e7-5535-4819-9e00-b2b355234c99 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.570365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef50e7-5535-4819-9e00-b2b355234c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.626742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:46.767957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-18ef50e7-5535-4819-9e00-b2b355234c99 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:46.769231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-18ef50e7-5535-4819-9e00-b2b355234c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:46.864722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 691/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:47.020252 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f35e1-dcc0-4fa3-ba3a-93b8f30d6546 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:47.021783 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a88f35e1-dcc0-4fa3-ba3a-93b8f30d6546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:47.170709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f35e1-dcc0-4fa3-ba3a-93b8f30d6546 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:47.182631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:47.284796 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d66bf2-e767-4091-bfbb-d0e6c61c6650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:47.285456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66bf2-e767-4091-bfbb-d0e6c61c6650 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:47.285742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66bf2-e767-4091-bfbb-d0e6c61c6650 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:47.286038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66bf2-e767-4091-bfbb-d0e6c61c6650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:47.287677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-92d66bf2-e767-4091-bfbb-d0e6c61c6650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:47.379051 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d66bf2-e767-4091-bfbb-d0e6c61c6650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:47.380966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d66bf2-e767-4091-bfbb-d0e6c61c6650 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:47.398842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 731/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:48.250694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e237b-86a3-4920-b606-9ce33535bb82 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:48.251271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e237b-86a3-4920-b606-9ce33535bb82 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:48.251271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e237b-86a3-4920-b606-9ce33535bb82 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:48.252661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 692/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:48.258060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762395d0-f721-497c-8850-dcedb2608700 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:48.258499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762395d0-f721-497c-8850-dcedb2608700 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:48.258619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762395d0-f721-497c-8850-dcedb2608700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:48.279800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:48.335227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-762395d0-f721-497c-8850-dcedb2608700 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:48.336445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-762395d0-f721-497c-8850-dcedb2608700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:48.432400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 732/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:48.586914 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e237b-86a3-4920-b606-9ce33535bb82 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:48.588344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-849e237b-86a3-4920-b606-9ce33535bb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:48.695402 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:48.733174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e237b-86a3-4920-b606-9ce33535bb82 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:48.845975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8199e1e-a12c-4d2a-8700-77c1317dd294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:48.846600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8199e1e-a12c-4d2a-8700-77c1317dd294 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:48.846886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8199e1e-a12c-4d2a-8700-77c1317dd294 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:48.847164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8199e1e-a12c-4d2a-8700-77c1317dd294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:48.848793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a8199e1e-a12c-4d2a-8700-77c1317dd294 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:48.923476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:48.937938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8199e1e-a12c-4d2a-8700-77c1317dd294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:48.939526 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8199e1e-a12c-4d2a-8700-77c1317dd294 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:48.957815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 693/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:49.816690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362a28e-1bdd-4074-bb46-ecd4c5ccf490 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:49.817289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362a28e-1bdd-4074-bb46-ecd4c5ccf490 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:49.817289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362a28e-1bdd-4074-bb46-ecd4c5ccf490 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:49.818616 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 733/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:49.823646 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbd8a6-7c18-4769-95ad-b1a810811eae None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:49.824081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbd8a6-7c18-4769-95ad-b1a810811eae None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:49.824234 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbd8a6-7c18-4769-95ad-b1a810811eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:49.899009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-afdbd8a6-7c18-4769-95ad-b1a810811eae None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:49.900218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-afdbd8a6-7c18-4769-95ad-b1a810811eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:49.997027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 694/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:50.147852 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362a28e-1bdd-4074-bb46-ecd4c5ccf490 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:50.149422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1362a28e-1bdd-4074-bb46-ecd4c5ccf490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:50.232157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:50.294206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362a28e-1bdd-4074-bb46-ecd4c5ccf490 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:50.409909 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a6f15-e3c6-4728-a890-142dfc43c58e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:50.410460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6f15-e3c6-4728-a890-142dfc43c58e service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:50.410740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6f15-e3c6-4728-a890-142dfc43c58e service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:50.411013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a6f15-e3c6-4728-a890-142dfc43c58e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:50.412667 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c12a6f15-e3c6-4728-a890-142dfc43c58e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:50.461863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:50.503670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a6f15-e3c6-4728-a890-142dfc43c58e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:50.505312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a6f15-e3c6-4728-a890-142dfc43c58e service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:50.523897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 734/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:51.323459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeabea-3806-4bb6-a00c-fba00223a226 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:51.323965 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeabea-3806-4bb6-a00c-fba00223a226 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:51.324142 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaeabea-3806-4bb6-a00c-fba00223a226 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:51.325582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 695/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:51.330645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623c9c8-c10d-4f07-8efe-c34c7091ccb9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:51.331101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623c9c8-c10d-4f07-8efe-c34c7091ccb9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:51.331237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623c9c8-c10d-4f07-8efe-c34c7091ccb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:51.408197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d623c9c8-c10d-4f07-8efe-c34c7091ccb9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:51.409417 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d623c9c8-c10d-4f07-8efe-c34c7091ccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:51.505184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 735/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:51.659161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaeabea-3806-4bb6-a00c-fba00223a226 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:51.660683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bdaeabea-3806-4bb6-a00c-fba00223a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:51.709303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:51.805492 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaeabea-3806-4bb6-a00c-fba00223a226 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:51.916771 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed28c7-4efc-40ff-b486-670b0a858b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:51.917476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed28c7-4efc-40ff-b486-670b0a858b00 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:51.917760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed28c7-4efc-40ff-b486-670b0a858b00 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:51.918035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed28c7-4efc-40ff-b486-670b0a858b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:51.919646 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a4ed28c7-4efc-40ff-b486-670b0a858b00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:51.926521 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:52.011395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed28c7-4efc-40ff-b486-670b0a858b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:52.013037 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed28c7-4efc-40ff-b486-670b0a858b00 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:52.030991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 696/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:52.851477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a2b4f-282a-4efb-9a51-3b3ff67ce688 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:52.852023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a2b4f-282a-4efb-9a51-3b3ff67ce688 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:52.852023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a2b4f-282a-4efb-9a51-3b3ff67ce688 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:52.853418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 736/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:52.858917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06213ec4-7922-4a68-ba39-913f8a13914c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:52.859353 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06213ec4-7922-4a68-ba39-913f8a13914c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:52.859522 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06213ec4-7922-4a68-ba39-913f8a13914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:52.935388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-06213ec4-7922-4a68-ba39-913f8a13914c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:52.936595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-06213ec4-7922-4a68-ba39-913f8a13914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.004153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:53.034767 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 697/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:53.187550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a2b4f-282a-4efb-9a51-3b3ff67ce688 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:53.189033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-382a2b4f-282a-4efb-9a51-3b3ff67ce688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.206779 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:53.333538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a2b4f-282a-4efb-9a51-3b3ff67ce688 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:53.423450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:53.450299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599c055-e606-4d13-a33c-cadd4fa23477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:53.450847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599c055-e606-4d13-a33c-cadd4fa23477 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.451128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599c055-e606-4d13-a33c-cadd4fa23477 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.451400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599c055-e606-4d13-a33c-cadd4fa23477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.453053 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9599c055-e606-4d13-a33c-cadd4fa23477 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.542034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599c055-e606-4d13-a33c-cadd4fa23477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:53.543634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599c055-e606-4d13-a33c-cadd4fa23477 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:53.561980 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 737/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:54.360479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8163b-33e6-4c46-a76f-9431607c4539 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:54.361112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8163b-33e6-4c46-a76f-9431607c4539 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:54.361112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8163b-33e6-4c46-a76f-9431607c4539 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:54.362448 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 698/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:54.367654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d58c7-23cc-42a3-9fc9-67e4cd03c2ca None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:54.368126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d58c7-23cc-42a3-9fc9-67e4cd03c2ca None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:54.368294 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d58c7-23cc-42a3-9fc9-67e4cd03c2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:54.443613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-194d58c7-23cc-42a3-9fc9-67e4cd03c2ca None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:54.444818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-194d58c7-23cc-42a3-9fc9-67e4cd03c2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:54.486165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:54.543312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 738/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:54.693958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8163b-33e6-4c46-a76f-9431607c4539 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:54.695488 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c6f8163b-33e6-4c46-a76f-9431607c4539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:54.841256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8163b-33e6-4c46-a76f-9431607c4539 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:54.894856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:54.952823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0397ff-d7c7-41e6-8d8f-daaef4551eef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:54.953385 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0397ff-d7c7-41e6-8d8f-daaef4551eef service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:54.953664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0397ff-d7c7-41e6-8d8f-daaef4551eef service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:54.953937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0397ff-d7c7-41e6-8d8f-daaef4551eef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:54.955540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4c0397ff-d7c7-41e6-8d8f-daaef4551eef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:55.044825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0397ff-d7c7-41e6-8d8f-daaef4551eef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:55.046438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0397ff-d7c7-41e6-8d8f-daaef4551eef service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:55.064370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 699/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:26:55.871894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9363b05-6864-457d-bcac-8d0f4690c00a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:55.872462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9363b05-6864-457d-bcac-8d0f4690c00a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:55.872462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9363b05-6864-457d-bcac-8d0f4690c00a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:55.873897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 739/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:55.878877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843c896-fcef-4791-97a4-c330f0484263 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:55.879311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843c896-fcef-4791-97a4-c330f0484263 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:55.879425 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843c896-fcef-4791-97a4-c330f0484263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:55.957464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7843c896-fcef-4791-97a4-c330f0484263 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:55.958672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7843c896-fcef-4791-97a4-c330f0484263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:55.960653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:56.055584 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 700/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:56.210366 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9363b05-6864-457d-bcac-8d0f4690c00a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:56.211810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c9363b05-6864-457d-bcac-8d0f4690c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:56.358046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9363b05-6864-457d-bcac-8d0f4690c00a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:56.389932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:56.475508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee163-9132-4590-a531-8fffb00e61be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:56.476130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee163-9132-4590-a531-8fffb00e61be service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:56.476413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee163-9132-4590-a531-8fffb00e61be service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:56.476690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee163-9132-4590-a531-8fffb00e61be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:56.478364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-151ee163-9132-4590-a531-8fffb00e61be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:56.569094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ee163-9132-4590-a531-8fffb00e61be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:56.570681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ee163-9132-4590-a531-8fffb00e61be service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:56.588813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 740/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:58.535357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352206e-5ccc-44a7-92ff-69bd67c386c3 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.535882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352206e-5ccc-44a7-92ff-69bd67c386c3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.535882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352206e-5ccc-44a7-92ff-69bd67c386c3 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.537362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 701/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:58.543441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f06326-7cc6-44f4-8d05-f184b83819ba None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.543857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f06326-7cc6-44f4-8d05-f184b83819ba None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.543990 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f06326-7cc6-44f4-8d05-f184b83819ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.584002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:58.609112 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-15f06326-7cc6-44f4-8d05-f184b83819ba None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:58.610309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-15f06326-7cc6-44f4-8d05-f184b83819ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:58.708492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 741/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:58.748134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352206e-5ccc-44a7-92ff-69bd67c386c3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:58.749812 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9352206e-5ccc-44a7-92ff-69bd67c386c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:58.852846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352206e-5ccc-44a7-92ff-69bd67c386c3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:58.885141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:58.928738 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3460b2-4bc0-4c32-aad5-08e01c19dd6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:58.929395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3460b2-4bc0-4c32-aad5-08e01c19dd6b service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.929679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3460b2-4bc0-4c32-aad5-08e01c19dd6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.929952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3460b2-4bc0-4c32-aad5-08e01c19dd6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.931564 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6f3460b2-4bc0-4c32-aad5-08e01c19dd6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:59.041328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3460b2-4bc0-4c32-aad5-08e01c19dd6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:59.042851 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3460b2-4bc0-4c32-aad5-08e01c19dd6b service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:59.062019 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 702/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:01.365189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3309668-2698-4fbe-9dd1-0c534bb57405 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:01.365784 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3309668-2698-4fbe-9dd1-0c534bb57405 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:01.365784 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3309668-2698-4fbe-9dd1-0c534bb57405 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:01.367087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 742/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:01.373318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2ee82-a177-4b26-829d-acef309dd10e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:01.373770 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2ee82-a177-4b26-829d-acef309dd10e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:01.373874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2ee82-a177-4b26-829d-acef309dd10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:01.440386 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0bd2ee82-a177-4b26-829d-acef309dd10e None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:01.441621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0bd2ee82-a177-4b26-829d-acef309dd10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:01.454228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:01.536920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 703/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:01.575958 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3309668-2698-4fbe-9dd1-0c534bb57405 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:01.577485 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f3309668-2698-4fbe-9dd1-0c534bb57405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:01.679995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3309668-2698-4fbe-9dd1-0c534bb57405 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:01.692013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:01.753535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d88c2-dc3e-4e59-ae59-b96aa1f3f2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:01.754156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d88c2-dc3e-4e59-ae59-b96aa1f3f2de service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:01.754438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d88c2-dc3e-4e59-ae59-b96aa1f3f2de service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:01.754715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d88c2-dc3e-4e59-ae59-b96aa1f3f2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:01.756608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f92d88c2-dc3e-4e59-ae59-b96aa1f3f2de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:01.864478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d88c2-dc3e-4e59-ae59-b96aa1f3f2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:01.865939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d88c2-dc3e-4e59-ae59-b96aa1f3f2de service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:01.883850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 743/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:04.204303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5aa9b-624a-4af8-8d63-c14cc0ee1629 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:04.204868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5aa9b-624a-4af8-8d63-c14cc0ee1629 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:04.204868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5aa9b-624a-4af8-8d63-c14cc0ee1629 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:04.206258 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 704/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:04.211393 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237d56a-948a-493f-9dc8-692a9fe771f7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:04.211819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237d56a-948a-493f-9dc8-692a9fe771f7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:04.211971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237d56a-948a-493f-9dc8-692a9fe771f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:04.262795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:04.402679 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4237d56a-948a-493f-9dc8-692a9fe771f7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:04.403883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4237d56a-948a-493f-9dc8-692a9fe771f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:04.496928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 744/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:04.535670 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5aa9b-624a-4af8-8d63-c14cc0ee1629 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:04.537227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d0e5aa9b-624a-4af8-8d63-c14cc0ee1629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:04.641354 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5aa9b-624a-4af8-8d63-c14cc0ee1629 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:04.685038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:04.719648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad130b3-7a95-4bab-a3e3-cda7f3ddf10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:04.720270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad130b3-7a95-4bab-a3e3-cda7f3ddf10c service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:04.720551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad130b3-7a95-4bab-a3e3-cda7f3ddf10c service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:04.721137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad130b3-7a95-4bab-a3e3-cda7f3ddf10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:04.722780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bad130b3-7a95-4bab-a3e3-cda7f3ddf10c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:04.831498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad130b3-7a95-4bab-a3e3-cda7f3ddf10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:04.832847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad130b3-7a95-4bab-a3e3-cda7f3ddf10c service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:04.851651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 705/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:06.975534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39875d4e-437f-4ec5-ac68-8958a2fa06f8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:06.976504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39875d4e-437f-4ec5-ac68-8958a2fa06f8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:06.976873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39875d4e-437f-4ec5-ac68-8958a2fa06f8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:06.978422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 745/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:06.984578 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bad93e-4a92-40b8-8b2b-b2a9c754f943 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:06.985044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bad93e-4a92-40b8-8b2b-b2a9c754f943 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:06.985159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bad93e-4a92-40b8-8b2b-b2a9c754f943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:07.051654 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d3bad93e-4a92-40b8-8b2b-b2a9c754f943 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:07.052869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d3bad93e-4a92-40b8-8b2b-b2a9c754f943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:07.073110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:07.149673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 706/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:27:07.189357 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39875d4e-437f-4ec5-ac68-8958a2fa06f8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:07.190874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-39875d4e-437f-4ec5-ac68-8958a2fa06f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:07.292478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39875d4e-437f-4ec5-ac68-8958a2fa06f8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:07.312955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:07.365259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b40df-c44c-4a7f-bf72-81e80abfb223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:07.365874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b40df-c44c-4a7f-bf72-81e80abfb223 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:07.366156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b40df-c44c-4a7f-bf72-81e80abfb223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:07.366429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b40df-c44c-4a7f-bf72-81e80abfb223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:07.368049 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f93b40df-c44c-4a7f-bf72-81e80abfb223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:07.474892 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b40df-c44c-4a7f-bf72-81e80abfb223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:07.476331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b40df-c44c-4a7f-bf72-81e80abfb223 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:07.494612 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 746/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:09.662268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f75f3e-0b1f-488c-b267-d00acf768671 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:09.662913 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f75f3e-0b1f-488c-b267-d00acf768671 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:09.662913 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f75f3e-0b1f-488c-b267-d00acf768671 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:09.664195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 707/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:09.670268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b818c4-b23a-4036-8f8b-68a8b2376272 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:09.670704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b818c4-b23a-4036-8f8b-68a8b2376272 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:09.670816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b818c4-b23a-4036-8f8b-68a8b2376272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:09.735526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:09.738399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-12b818c4-b23a-4036-8f8b-68a8b2376272 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:09.740106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-12b818c4-b23a-4036-8f8b-68a8b2376272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:09.834599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 747/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:09.873870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f75f3e-0b1f-488c-b267-d00acf768671 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:09.875429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-08f75f3e-0b1f-488c-b267-d00acf768671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:09.981239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f75f3e-0b1f-488c-b267-d00acf768671 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:10.029620 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:10.054306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0a0e8-9b9a-498e-ba4e-4ade608e94f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:10.054920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0a0e8-9b9a-498e-ba4e-4ade608e94f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:10.055201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0a0e8-9b9a-498e-ba4e-4ade608e94f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:10.055473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0a0e8-9b9a-498e-ba4e-4ade608e94f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:10.057136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-34d0a0e8-9b9a-498e-ba4e-4ade608e94f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:10.165815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0a0e8-9b9a-498e-ba4e-4ade608e94f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:10.167633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0a0e8-9b9a-498e-ba4e-4ade608e94f8 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:10.186906 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 708/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:12.255106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf43af-4507-4286-a699-81f33d10d37f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:12.255645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf43af-4507-4286-a699-81f33d10d37f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:12.255779 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf43af-4507-4286-a699-81f33d10d37f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:12.257320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 748/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:12.262792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017c77b-0382-410e-8c2d-7e9e7ca5f672 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:12.263241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017c77b-0382-410e-8c2d-7e9e7ca5f672 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:12.263381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017c77b-0382-410e-8c2d-7e9e7ca5f672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:12.329505 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e017c77b-0382-410e-8c2d-7e9e7ca5f672 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:12.330721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e017c77b-0382-410e-8c2d-7e9e7ca5f672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:12.360255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:12.429858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 709/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:12.468692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf43af-4507-4286-a699-81f33d10d37f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:12.470339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6daf43af-4507-4286-a699-81f33d10d37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:12.575958 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf43af-4507-4286-a699-81f33d10d37f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:12.604102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:12.648978 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838d24e-4a2f-437e-a07a-1561039cc75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:12.649595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838d24e-4a2f-437e-a07a-1561039cc75e service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:12.649879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838d24e-4a2f-437e-a07a-1561039cc75e service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:12.650151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838d24e-4a2f-437e-a07a-1561039cc75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:12.652387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a838d24e-4a2f-437e-a07a-1561039cc75e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:12.762207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838d24e-4a2f-437e-a07a-1561039cc75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:12.763649 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838d24e-4a2f-437e-a07a-1561039cc75e service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:12.782142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 749/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:14.868132 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d71d8-3725-4744-821a-43b12065acbc None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:14.868654 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d71d8-3725-4744-821a-43b12065acbc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:14.868775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d71d8-3725-4744-821a-43b12065acbc None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:14.870104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 710/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:14.875542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66409108-31ad-45c1-8990-be3f56c7391f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:14.875983 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66409108-31ad-45c1-8990-be3f56c7391f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:14.876093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66409108-31ad-45c1-8990-be3f56c7391f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:14.941912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-66409108-31ad-45c1-8990-be3f56c7391f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:14.943126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-66409108-31ad-45c1-8990-be3f56c7391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:14.952404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:15.041178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 750/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:15.078956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d71d8-3725-4744-821a-43b12065acbc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:15.080467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-067d71d8-3725-4744-821a-43b12065acbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:15.183775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d71d8-3725-4744-821a-43b12065acbc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:15.238972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:15.257635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaa58c-c80e-4940-b57a-4d92205ce04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:15.258281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaa58c-c80e-4940-b57a-4d92205ce04b service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:15.258563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaa58c-c80e-4940-b57a-4d92205ce04b service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:15.258862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaa58c-c80e-4940-b57a-4d92205ce04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:15.260513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0aaaa58c-c80e-4940-b57a-4d92205ce04b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:15.370433 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaa58c-c80e-4940-b57a-4d92205ce04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:15.371897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaa58c-c80e-4940-b57a-4d92205ce04b service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:15.390198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 711/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:17.427077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe687a26-6360-4ee8-926c-e0ec4201302a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.427589 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe687a26-6360-4ee8-926c-e0ec4201302a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.427686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe687a26-6360-4ee8-926c-e0ec4201302a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.428962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 751/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:17.434085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8233f-130e-49d6-88d2-371fd8c22072 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.434523 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8233f-130e-49d6-88d2-371fd8c22072 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.434630 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8233f-130e-49d6-88d2-371fd8c22072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.500470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-66b8233f-130e-49d6-88d2-371fd8c22072 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:17.501723 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-66b8233f-130e-49d6-88d2-371fd8c22072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:17.540046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:17.598329 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 712/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:27:17.636833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe687a26-6360-4ee8-926c-e0ec4201302a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:17.638387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fe687a26-6360-4ee8-926c-e0ec4201302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:17.740267 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe687a26-6360-4ee8-926c-e0ec4201302a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:17.778004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:17.813332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248470fb-c549-4ccf-88b9-d31a837ad717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:17.813948 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248470fb-c549-4ccf-88b9-d31a837ad717 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.814228 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248470fb-c549-4ccf-88b9-d31a837ad717 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.814501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248470fb-c549-4ccf-88b9-d31a837ad717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.816123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-248470fb-c549-4ccf-88b9-d31a837ad717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:17.925061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248470fb-c549-4ccf-88b9-d31a837ad717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:17.926412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248470fb-c549-4ccf-88b9-d31a837ad717 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:17.944110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 752/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:20.009639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e436224-c5f9-4359-a631-8bd0c3f3e658 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:20.010183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e436224-c5f9-4359-a631-8bd0c3f3e658 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:20.010183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e436224-c5f9-4359-a631-8bd0c3f3e658 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:20.012553 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 713/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:20.017923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a24ad-4cfc-465a-a571-cd6fa2c372d8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:20.018369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a24ad-4cfc-465a-a571-cd6fa2c372d8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:20.018511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a24ad-4cfc-465a-a571-cd6fa2c372d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:20.083893 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9d2a24ad-4cfc-465a-a571-cd6fa2c372d8 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:20.085098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9d2a24ad-4cfc-465a-a571-cd6fa2c372d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:20.103209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:20.182015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 753/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:20.220255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e436224-c5f9-4359-a631-8bd0c3f3e658 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:20.221817 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7e436224-c5f9-4359-a631-8bd0c3f3e658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:20.326120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e436224-c5f9-4359-a631-8bd0c3f3e658 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:20.394286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:20.401515 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add68c73-e9b4-4346-a5b4-3c64d76ac331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:20.402138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add68c73-e9b4-4346-a5b4-3c64d76ac331 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:20.402420 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add68c73-e9b4-4346-a5b4-3c64d76ac331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:20.402694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add68c73-e9b4-4346-a5b4-3c64d76ac331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:20.404310 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-add68c73-e9b4-4346-a5b4-3c64d76ac331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:20.512004 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add68c73-e9b4-4346-a5b4-3c64d76ac331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:20.513464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add68c73-e9b4-4346-a5b4-3c64d76ac331 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:20.530914 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 714/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:22.586831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23052eb4-7dd9-41b8-ab3e-80013f187fb9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:22.587392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23052eb4-7dd9-41b8-ab3e-80013f187fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:22.587494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23052eb4-7dd9-41b8-ab3e-80013f187fb9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:22.588797 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 754/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:22.594171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffcad7-10a0-450a-9fab-ae9bb9d42310 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:22.594621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffcad7-10a0-450a-9fab-ae9bb9d42310 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:22.594737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffcad7-10a0-450a-9fab-ae9bb9d42310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:22.660735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-33ffcad7-10a0-450a-9fab-ae9bb9d42310 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:22.661898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-33ffcad7-10a0-450a-9fab-ae9bb9d42310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:22.710209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:22.760155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 715/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:22.797456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23052eb4-7dd9-41b8-ab3e-80013f187fb9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:22.798999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-23052eb4-7dd9-41b8-ab3e-80013f187fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:22.900695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23052eb4-7dd9-41b8-ab3e-80013f187fb9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:22.948108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:22.974671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd939f1-6ceb-4e95-9492-8028ffe8cffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:22.975282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd939f1-6ceb-4e95-9492-8028ffe8cffa service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:22.975564 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd939f1-6ceb-4e95-9492-8028ffe8cffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:22.975837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd939f1-6ceb-4e95-9492-8028ffe8cffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:22.977596 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7cd939f1-6ceb-4e95-9492-8028ffe8cffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:23.084454 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd939f1-6ceb-4e95-9492-8028ffe8cffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:23.085907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd939f1-6ceb-4e95-9492-8028ffe8cffa service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:23.103984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 755/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:27:32.758414 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=22 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:33.101672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=66 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:42.694939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb75f6-d8ba-4b55-9a6a-1fffd67d95bf None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:42.695467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb75f6-d8ba-4b55-9a6a-1fffd67d95bf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:42.695467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb75f6-d8ba-4b55-9a6a-1fffd67d95bf None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:42.696761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 716/1471] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:42.702169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f2272-a2fe-4b10-94ba-8493f616caf0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:42.702579 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f2272-a2fe-4b10-94ba-8493f616caf0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:42.702719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f2272-a2fe-4b10-94ba-8493f616caf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:42.767731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-830f2272-a2fe-4b10-94ba-8493f616caf0 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:42.768958 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-830f2272-a2fe-4b10-94ba-8493f616caf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:42.866633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 756/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:42.951349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208d98d-4625-4f18-8f70-00aeec07577d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:42.951629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208d98d-4625-4f18-8f70-00aeec07577d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:42.951899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208d98d-4625-4f18-8f70-00aeec07577d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:42.953265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 717/1473] 10.222.0.15 () {54 vars in 966 bytes} [Sat Aug 6 01:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:42.958023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ad814-b238-435a-9807-cdebbbc823a4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:42.958316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ad814-b238-435a-9807-cdebbbc823a4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:42.958595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ad814-b238-435a-9807-cdebbbc823a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:43.034332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7c6ad814-b238-435a-9807-cdebbbc823a4 None None] MFA Rules not processed for user `da39170a654d4d52a39b4b2c8cfd8906`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:43.035536 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7c6ad814-b238-435a-9807-cdebbbc823a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:43.056052 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:43.111980 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 757/1474] 10.222.0.15 () {58 vars in 1063 bytes} [Sat Aug 6 01:27:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:43.119423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208d98d-4625-4f18-8f70-00aeec07577d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:43.121637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6208d98d-4625-4f18-8f70-00aeec07577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:43.223117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208d98d-4625-4f18-8f70-00aeec07577d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:43.295041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9f27d-ad59-4f9b-b670-282da25665e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da39170a654d4d52a39b4b2c8cfd8906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:43.295653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9f27d-ad59-4f9b-b670-282da25665e3 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:43.295936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9f27d-ad59-4f9b-b670-282da25665e3 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:43.296207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9f27d-ad59-4f9b-b670-282da25665e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:43.297853 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1bc9f27d-ad59-4f9b-b670-282da25665e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:43.352488 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:43.421610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9f27d-ad59-4f9b-b670-282da25665e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:43.423057 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9f27d-ad59-4f9b-b670-282da25665e3 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:43.442248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 718/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:45.548649 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca001de-cdfa-469b-a92e-70c03c267a90 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:45.549232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca001de-cdfa-469b-a92e-70c03c267a90 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:45.549232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca001de-cdfa-469b-a92e-70c03c267a90 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:45.550571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 758/1476] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:45.555811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28932b0f-e3c6-4dd7-9522-eda5cd8a2ace None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:45.556203 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28932b0f-e3c6-4dd7-9522-eda5cd8a2ace None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:45.556305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28932b0f-e3c6-4dd7-9522-eda5cd8a2ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:45.622691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-28932b0f-e3c6-4dd7-9522-eda5cd8a2ace None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:45.623879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-28932b0f-e3c6-4dd7-9522-eda5cd8a2ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:45.718339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 719/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:45.741873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca001de-cdfa-469b-a92e-70c03c267a90 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:45.743389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9ca001de-cdfa-469b-a92e-70c03c267a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:45.866828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca001de-cdfa-469b-a92e-70c03c267a90 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:45.915539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:45.960770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482450e-26e0-4bd2-9e3b-eaad2f4c644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:45.961414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482450e-26e0-4bd2-9e3b-eaad2f4c644c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:45.961695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482450e-26e0-4bd2-9e3b-eaad2f4c644c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:45.961969 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482450e-26e0-4bd2-9e3b-eaad2f4c644c admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:45.962665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482450e-26e0-4bd2-9e3b-eaad2f4c644c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:45.964710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: WARNING py.warnings [None req-d482450e-26e0-4bd2-9e3b-eaad2f4c644c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:27:45.964710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: warnings.warn(msg) Aug 06 01:27:45.964710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: Aug 06 01:27:45.965872 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482450e-26e0-4bd2-9e3b-eaad2f4c644c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:45.984704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 759/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Sat Aug 6 01:27:45 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:47.993283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237485b-bcad-46c9-aacc-38d8bff02a58 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:47.993857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237485b-bcad-46c9-aacc-38d8bff02a58 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:47.993857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237485b-bcad-46c9-aacc-38d8bff02a58 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:47.995318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 720/1479] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:48.000543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347017-00cb-4665-be93-ec6c3338e7b7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:48.000998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347017-00cb-4665-be93-ec6c3338e7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:48.001109 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347017-00cb-4665-be93-ec6c3338e7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:48.065014 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-91347017-00cb-4665-be93-ec6c3338e7b7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:48.066248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-91347017-00cb-4665-be93-ec6c3338e7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:48.162063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 760/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:48.206168 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237485b-bcad-46c9-aacc-38d8bff02a58 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:48.207719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7237485b-bcad-46c9-aacc-38d8bff02a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:48.217897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:48.352150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237485b-bcad-46c9-aacc-38d8bff02a58 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:48.434524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:48.469006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df50b0-db19-479a-b303-80a36ccd69b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:48.469624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df50b0-db19-479a-b303-80a36ccd69b6 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:48.469905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df50b0-db19-479a-b303-80a36ccd69b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:48.470178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df50b0-db19-479a-b303-80a36ccd69b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:48.471799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-18df50b0-db19-479a-b303-80a36ccd69b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:48.561183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df50b0-db19-479a-b303-80a36ccd69b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:48.562766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df50b0-db19-479a-b303-80a36ccd69b6 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:48.580668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 721/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:50.770304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a77785-d10d-429b-9f30-b72e8b81dfa1 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:50.770851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a77785-d10d-429b-9f30-b72e8b81dfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:50.770851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a77785-d10d-429b-9f30-b72e8b81dfa1 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:50.772146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 761/1482] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:50.778118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c17ff-b988-458e-8002-23cce7c99b58 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:50.778560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c17ff-b988-458e-8002-23cce7c99b58 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:50.778691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c17ff-b988-458e-8002-23cce7c99b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:50.847395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-433c17ff-b988-458e-8002-23cce7c99b58 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:50.848618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-433c17ff-b988-458e-8002-23cce7c99b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:50.895588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:50.946087 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 722/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:50.983934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a77785-d10d-429b-9f30-b72e8b81dfa1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:50.985477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b1a77785-d10d-429b-9f30-b72e8b81dfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:51.009003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:51.090166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a77785-d10d-429b-9f30-b72e8b81dfa1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:51.162257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3d4e-b08d-4943-8703-2b4efb0723ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:51.162872 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3d4e-b08d-4943-8703-2b4efb0723ea service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:51.163155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3d4e-b08d-4943-8703-2b4efb0723ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:51.163426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3d4e-b08d-4943-8703-2b4efb0723ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:51.165092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e67b3d4e-b08d-4943-8703-2b4efb0723ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:51.238751 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:51.274314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3d4e-b08d-4943-8703-2b4efb0723ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:51.275780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3d4e-b08d-4943-8703-2b4efb0723ea service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:51.293570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 762/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:53.340006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379f8b5-012d-4481-8944-803e5310c632 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:53.340504 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379f8b5-012d-4481-8944-803e5310c632 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:53.340616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379f8b5-012d-4481-8944-803e5310c632 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:53.341970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 723/1485] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:53.347198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b1836-c676-4d16-91cd-ed1ede976de4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:53.347588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b1836-c676-4d16-91cd-ed1ede976de4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:53.347756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b1836-c676-4d16-91cd-ed1ede976de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:53.414264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0f2b1836-c676-4d16-91cd-ed1ede976de4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:53.415486 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0f2b1836-c676-4d16-91cd-ed1ede976de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:53.510256 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 763/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:53.548402 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379f8b5-012d-4481-8944-803e5310c632 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:53.550004 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7379f8b5-012d-4481-8944-803e5310c632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:53.653509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379f8b5-012d-4481-8944-803e5310c632 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:53.725956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:53.727962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29a4a2-167a-4968-85d1-c846a978bae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:53.728788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a4a2-167a-4968-85d1-c846a978bae2 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:53.729160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a4a2-167a-4968-85d1-c846a978bae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:53.729659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a4a2-167a-4968-85d1-c846a978bae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:53.732069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-df29a4a2-167a-4968-85d1-c846a978bae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:53.843901 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29a4a2-167a-4968-85d1-c846a978bae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:53.845355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29a4a2-167a-4968-85d1-c846a978bae2 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:53.863479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 724/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:55.963214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9754-70f6-4618-ba64-b32a45464192 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:55.964430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9754-70f6-4618-ba64-b32a45464192 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:55.964430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9754-70f6-4618-ba64-b32a45464192 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:55.966085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 764/1488] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:55.971341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef333e1-9152-4af9-88df-0482c19a77cb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:55.971827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef333e1-9152-4af9-88df-0482c19a77cb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:55.972111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef333e1-9152-4af9-88df-0482c19a77cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:56.038670 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9ef333e1-9152-4af9-88df-0482c19a77cb None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:56.039865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9ef333e1-9152-4af9-88df-0482c19a77cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:56.092404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:56.135285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 725/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:56.177008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e9754-70f6-4618-ba64-b32a45464192 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:56.178544 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0c6e9754-70f6-4618-ba64-b32a45464192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:56.215773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:56.284036 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e9754-70f6-4618-ba64-b32a45464192 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:56.356877 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cc38d-ce1d-449e-9a0c-2c2309b3e637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:56.357515 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cc38d-ce1d-449e-9a0c-2c2309b3e637 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:56.357793 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cc38d-ce1d-449e-9a0c-2c2309b3e637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:56.358060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cc38d-ce1d-449e-9a0c-2c2309b3e637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:56.359701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-527cc38d-ce1d-449e-9a0c-2c2309b3e637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:56.441443 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:56.472693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cc38d-ce1d-449e-9a0c-2c2309b3e637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:56.474171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cc38d-ce1d-449e-9a0c-2c2309b3e637 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:56.492554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 765/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:58.713451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14878-7a9b-465e-8fe3-dca69669b36a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:58.714962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14878-7a9b-465e-8fe3-dca69669b36a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:58.714962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14878-7a9b-465e-8fe3-dca69669b36a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:58.716073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 726/1491] 10.222.0.15 () {54 vars in 927 bytes} [Sat Aug 6 01:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:27:58.721213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d905e-a48b-4cfe-abef-1c0e9cb4d566 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:58.721624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d905e-a48b-4cfe-abef-1c0e9cb4d566 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:58.721762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d905e-a48b-4cfe-abef-1c0e9cb4d566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:58.788086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f83d905e-a48b-4cfe-abef-1c0e9cb4d566 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:58.789348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f83d905e-a48b-4cfe-abef-1c0e9cb4d566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:58.887359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 766/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Sat Aug 6 01:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:58.930663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14878-7a9b-465e-8fe3-dca69669b36a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:58.932221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0af14878-7a9b-465e-8fe3-dca69669b36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:59.038005 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14878-7a9b-465e-8fe3-dca69669b36a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:59.110157 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b7510-c049-47d6-bb84-d409538d5444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:59.110779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7510-c049-47d6-bb84-d409538d5444 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:59.111062 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7510-c049-47d6-bb84-d409538d5444 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:59.111338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7510-c049-47d6-bb84-d409538d5444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:59.112982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6a9b7510-c049-47d6-bb84-d409538d5444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:59.122144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:59.222874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b7510-c049-47d6-bb84-d409538d5444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:59.224309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b7510-c049-47d6-bb84-d409538d5444 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:59.241961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 727/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:08.885113 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=82 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:09.239755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=50 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:09.572314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a477ea-265d-475a-934e-d6b182572dc5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:09.572975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a477ea-265d-475a-934e-d6b182572dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:09.572975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a477ea-265d-475a-934e-d6b182572dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:09.653101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-04a477ea-265d-475a-934e-d6b182572dc5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:29:09.654305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-04a477ea-265d-475a-934e-d6b182572dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:09.748166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 767/1494] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:29:09.756482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4094e3d-bdfc-42fe-9b63-c424b2b275f3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:09.756988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4094e3d-bdfc-42fe-9b63-c424b2b275f3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:09.757095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4094e3d-bdfc-42fe-9b63-c424b2b275f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:09.834204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d4094e3d-bdfc-42fe-9b63-c424b2b275f3 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:29:09.835392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d4094e3d-bdfc-42fe-9b63-c424b2b275f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:09.929283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 728/1495] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:29:09.934648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a477ea-265d-475a-934e-d6b182572dc5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:09.935835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-04a477ea-265d-475a-934e-d6b182572dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:09.947022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a477ea-265d-475a-934e-d6b182572dc5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:10.007797 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:10.041033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac6767-86d7-4d3e-9cd9-cf410fc792bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:10.041651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac6767-86d7-4d3e-9cd9-cf410fc792bb admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:10.041932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac6767-86d7-4d3e-9cd9-cf410fc792bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:10.042247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac6767-86d7-4d3e-9cd9-cf410fc792bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:10.042932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac6767-86d7-4d3e-9cd9-cf410fc792bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:29:10.043230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac6767-86d7-4d3e-9cd9-cf410fc792bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:10.044232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: WARNING py.warnings [None req-ceac6767-86d7-4d3e-9cd9-cf410fc792bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:29:10.044232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: warnings.warn(msg) Aug 06 01:29:10.044232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: Aug 06 01:29:10.045123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac6767-86d7-4d3e-9cd9-cf410fc792bb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:10.056205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 768/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:29:10.065164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4094e3d-bdfc-42fe-9b63-c424b2b275f3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:10.075063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4094e3d-bdfc-42fe-9b63-c424b2b275f3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:10.135495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:10.169231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75731f0f-545a-48c1-a499-5924d74142c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:10.169846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75731f0f-545a-48c1-a499-5924d74142c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:10.170129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75731f0f-545a-48c1-a499-5924d74142c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:10.170405 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75731f0f-545a-48c1-a499-5924d74142c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:10.171061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75731f0f-545a-48c1-a499-5924d74142c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:10.172778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-75731f0f-545a-48c1-a499-5924d74142c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:29:10.172778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: warnings.warn(msg) Aug 06 01:29:10.172778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: Aug 06 01:29:10.174008 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75731f0f-545a-48c1-a499-5924d74142c2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:10.229475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 729/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:29:10 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:29:10.234435 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac6767-86d7-4d3e-9cd9-cf410fc792bb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:10.235999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ceac6767-86d7-4d3e-9cd9-cf410fc792bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:10.270761 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac6767-86d7-4d3e-9cd9-cf410fc792bb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:10.362231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381e737-d661-4840-b9a1-5b0978f901c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:10.362843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e737-d661-4840-b9a1-5b0978f901c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:10.363136 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e737-d661-4840-b9a1-5b0978f901c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:10.363387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e737-d661-4840-b9a1-5b0978f901c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:10.364050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381e737-d661-4840-b9a1-5b0978f901c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:10.365085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: WARNING py.warnings [None req-6381e737-d661-4840-b9a1-5b0978f901c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:29:10.365085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: warnings.warn(msg) Aug 06 01:29:10.365085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: Aug 06 01:29:10.366281 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381e737-d661-4840-b9a1-5b0978f901c7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:10.408437 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 769/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:29:10 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:29:10.412605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75731f0f-545a-48c1-a499-5924d74142c2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:10.414177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-75731f0f-545a-48c1-a499-5924d74142c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:10.477973 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75731f0f-545a-48c1-a499-5924d74142c2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:10.561335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:10.572490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc924e98-193a-45e4-8fc5-35953744f5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:10.573138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc924e98-193a-45e4-8fc5-35953744f5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:10.573473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc924e98-193a-45e4-8fc5-35953744f5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:10.573748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc924e98-193a-45e4-8fc5-35953744f5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:10.574537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc924e98-193a-45e4-8fc5-35953744f5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:10.575538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-fc924e98-193a-45e4-8fc5-35953744f5d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:29:10.575538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: warnings.warn(msg) Aug 06 01:29:10.575538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: Aug 06 01:29:10.576416 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc924e98-193a-45e4-8fc5-35953744f5d0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:10.589712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 730/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:29:10.593769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381e737-d661-4840-b9a1-5b0978f901c7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:10.595276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6381e737-d661-4840-b9a1-5b0978f901c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:10.607592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381e737-d661-4840-b9a1-5b0978f901c7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:10.631700 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:10.701142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed671b18-e66a-47b0-a753-8b7f3a9aba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:10.702040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed671b18-e66a-47b0-a753-8b7f3a9aba36 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:10.702327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed671b18-e66a-47b0-a753-8b7f3a9aba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:10.702608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed671b18-e66a-47b0-a753-8b7f3a9aba36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:10.703301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed671b18-e66a-47b0-a753-8b7f3a9aba36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:10.704312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: WARNING py.warnings [None req-ed671b18-e66a-47b0-a753-8b7f3a9aba36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:29:10.704312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: warnings.warn(msg) Aug 06 01:29:10.704312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: Aug 06 01:29:10.705216 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed671b18-e66a-47b0-a753-8b7f3a9aba36 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:10.718029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 770/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:29:10.722296 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc924e98-193a-45e4-8fc5-35953744f5d0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:10.723797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fc924e98-193a-45e4-8fc5-35953744f5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:10.757870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc924e98-193a-45e4-8fc5-35953744f5d0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:10.849401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637d1f4-9dba-43a9-a0e5-8466436b913b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:10.850066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637d1f4-9dba-43a9-a0e5-8466436b913b admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:10.850359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637d1f4-9dba-43a9-a0e5-8466436b913b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:10.850630 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637d1f4-9dba-43a9-a0e5-8466436b913b admin admin] PATH_INFO: `/v3/projects/17042c509c9e46e9bd86843f59970aea/users/8a2a5ba3ab4a4034b0b1da9d2f81d0e5/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:10.872340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637d1f4-9dba-43a9-a0e5-8466436b913b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17042c509c9e46e9bd86843f59970aea, user_id=8a2a5ba3ab4a4034b0b1da9d2f81d0e5, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:10.873389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-d637d1f4-9dba-43a9-a0e5-8466436b913b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:29:10.873389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: warnings.warn(msg) Aug 06 01:29:10.873389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: Aug 06 01:29:10.875292 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637d1f4-9dba-43a9-a0e5-8466436b913b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:10.898708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 731/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:29:10 2022] PUT /identity/v3/projects/17042c509c9e46e9bd86843f59970aea/users/8a2a5ba3ab4a4034b0b1da9d2f81d0e5/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:29:10.912299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b8170-7f8f-4f74-9a6a-263a13acccd5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:10.912594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b8170-7f8f-4f74-9a6a-263a13acccd5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:10.912873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b8170-7f8f-4f74-9a6a-263a13acccd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:10.969716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9f7b8170-7f8f-4f74-9a6a-263a13acccd5 None None] MFA Rules not processed for user `8a2a5ba3ab4a4034b0b1da9d2f81d0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:29:10.970937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9f7b8170-7f8f-4f74-9a6a-263a13acccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:11.048790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 771/1502] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:29:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:29:11.061945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a77784-acd3-4c2f-a637-e4f8d79daed6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:11.062235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a77784-acd3-4c2f-a637-e4f8d79daed6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:11.062510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a77784-acd3-4c2f-a637-e4f8d79daed6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:11.063843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 732/1503] 10.222.0.15 () {54 vars in 964 bytes} [Sat Aug 6 01:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:29:11.068535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eec775-6eae-4206-90ce-2fffef36eabe None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:11.068826 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eec775-6eae-4206-90ce-2fffef36eabe None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:11.069127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eec775-6eae-4206-90ce-2fffef36eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:11.101943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:11.146114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-79eec775-6eae-4206-90ce-2fffef36eabe None None] MFA Rules not processed for user `acd6aba844f04489adec2ce9f1eb49dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:29:11.147314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-79eec775-6eae-4206-90ce-2fffef36eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:11.221732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 772/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Sat Aug 6 01:29:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:29:11.230132 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a77784-acd3-4c2f-a637-e4f8d79daed6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:11.231633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-06a77784-acd3-4c2f-a637-e4f8d79daed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:11.281860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:11.337090 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a77784-acd3-4c2f-a637-e4f8d79daed6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:11.415041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1aeb9b-97d9-446e-98bf-c3f23c4a2424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:11.415676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aeb9b-97d9-446e-98bf-c3f23c4a2424 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:11.415954 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aeb9b-97d9-446e-98bf-c3f23c4a2424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:11.416225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aeb9b-97d9-446e-98bf-c3f23c4a2424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:11.418595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ff1aeb9b-97d9-446e-98bf-c3f23c4a2424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:11.527764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1aeb9b-97d9-446e-98bf-c3f23c4a2424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:11.529261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1aeb9b-97d9-446e-98bf-c3f23c4a2424 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:11.532852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:11.548739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 733/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:29:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:29:11.594007 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d3fe-75c3-4193-bcd9-9e9a05cc9eab None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:11.594486 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d3fe-75c3-4193-bcd9-9e9a05cc9eab None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:11.594587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1d3fe-75c3-4193-bcd9-9e9a05cc9eab None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:11.595825 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 773/1506] 10.222.0.15 () {52 vars in 830 bytes} [Sat Aug 6 01:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:29:11.599467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1aeb9b-97d9-446e-98bf-c3f23c4a2424 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:11.600684 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ff1aeb9b-97d9-446e-98bf-c3f23c4a2424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:11.699698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1aeb9b-97d9-446e-98bf-c3f23c4a2424 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:11.794563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:11.795214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:11.795478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:11.795756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] PATH_INFO: `/v3/users/8a2a5ba3ab4a4034b0b1da9d2f81d0e5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:11.808662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2a5ba3ab4a4034b0b1da9d2f81d0e5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:11.809721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:29:11.809721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: warnings.warn(msg) Aug 06 01:29:11.809721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: Aug 06 01:29:11.810926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:11.820443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:11.877316 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2a5ba3ab4a4034b0b1da9d2f81d0e5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:29:11.891407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2a5ba3ab4a4034b0b1da9d2f81d0e5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:29:11.913319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2a5ba3ab4a4034b0b1da9d2f81d0e5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:29:11.913889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2a5ba3ab4a4034b0b1da9d2f81d0e5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:29:11.914325 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2a5ba3ab4a4034b0b1da9d2f81d0e5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:29:11.929137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 734/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:29:11 2022] DELETE /identity/v3/users/8a2a5ba3ab4a4034b0b1da9d2f81d0e5 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:29:11.934507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5db29d-be3c-4979-9652-5a27964f26d4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:11.934796 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5db29d-be3c-4979-9652-5a27964f26d4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:11.935070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5db29d-be3c-4979-9652-5a27964f26d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:11.991400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3f5db29d-be3c-4979-9652-5a27964f26d4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:29:11.992541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3f5db29d-be3c-4979-9652-5a27964f26d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:12.067035 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:12.080396 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 774/1508] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:29:12.090643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:12.091849 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:12.190151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2dcc9-18d3-47ff-9d1b-c3d3e295f977 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:12.243848 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:12.266068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafba4cf-6302-4940-baac-c11e8dcbdec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:12.266690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba4cf-6302-4940-baac-c11e8dcbdec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:12.266973 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba4cf-6302-4940-baac-c11e8dcbdec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:12.267250 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafba4cf-6302-4940-baac-c11e8dcbdec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:12.268887 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eafba4cf-6302-4940-baac-c11e8dcbdec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:12.376561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafba4cf-6302-4940-baac-c11e8dcbdec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:12.378053 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafba4cf-6302-4940-baac-c11e8dcbdec8 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:12.396889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 735/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:29:12.723344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5db29d-be3c-4979-9652-5a27964f26d4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:12.724616 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3f5db29d-be3c-4979-9652-5a27964f26d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:12.736846 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5db29d-be3c-4979-9652-5a27964f26d4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:12.833278 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:12.833844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:12.834127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:12.834399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] PATH_INFO: `/v3/projects/17042c509c9e46e9bd86843f59970aea` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:12.844698 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17042c509c9e46e9bd86843f59970aea)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:12.845765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: WARNING py.warnings [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:29:12.845765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: warnings.warn(msg) Aug 06 01:29:12.845765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: Aug 06 01:29:12.846950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:12.904223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17042c509c9e46e9bd86843f59970aea', 'request_id': 'req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:29:12.910278 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17042c509c9e46e9bd86843f59970aea', 'request_id': 'req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:29:12.922158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17042c509c9e46e9bd86843f59970aea', 'request_id': 'req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:29:12.951017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] The token cache is being invalidate because project 17042c509c9e46e9bd86843f59970aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:29:12.951310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:29:12.951830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f2b0c626-4db7-4cab-93cc-0bd9a2780d56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:29:12.953173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 775/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:29:12 2022] DELETE /identity/v3/projects/17042c509c9e46e9bd86843f59970aea => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:29:22.394623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=62 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:22.948924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:30:46.446359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6cd8b-a9f9-4435-b402-197e481e99af None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:46.446938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6cd8b-a9f9-4435-b402-197e481e99af None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:46.446938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6cd8b-a9f9-4435-b402-197e481e99af None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:46.448277 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 736/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:30:46.453308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833c0fc-41db-4585-b42c-2a5902e9618f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:46.453776 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833c0fc-41db-4585-b42c-2a5902e9618f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:46.453882 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833c0fc-41db-4585-b42c-2a5902e9618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:46.534224 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d833c0fc-41db-4585-b42c-2a5902e9618f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:30:46.535435 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d833c0fc-41db-4585-b42c-2a5902e9618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:30:46.637409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 776/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:30:46.794553 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6cd8b-a9f9-4435-b402-197e481e99af None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:30:46.797265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bbb6cd8b-a9f9-4435-b402-197e481e99af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:30:46.914474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6cd8b-a9f9-4435-b402-197e481e99af None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:30:46.919878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7b912-19fa-4c7c-9b65-b59b59c6f528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:30:46.921107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7b912-19fa-4c7c-9b65-b59b59c6f528 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:46.921391 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7b912-19fa-4c7c-9b65-b59b59c6f528 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:46.921671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7b912-19fa-4c7c-9b65-b59b59c6f528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:46.929704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7b912-19fa-4c7c-9b65-b59b59c6f528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:30:46.931289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7b912-19fa-4c7c-9b65-b59b59c6f528 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:30:46.941328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 737/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:30:47.781048 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b56ff4-3299-40b8-9a46-17b39ad3b35b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:47.781582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b56ff4-3299-40b8-9a46-17b39ad3b35b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:47.781582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b56ff4-3299-40b8-9a46-17b39ad3b35b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:47.782885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 777/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:30:47.787592 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55184200-50b5-4e1a-b462-4c024d22723d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:47.787989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55184200-50b5-4e1a-b462-4c024d22723d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:47.788155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55184200-50b5-4e1a-b462-4c024d22723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:47.808657 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-55184200-50b5-4e1a-b462-4c024d22723d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:30:47.809901 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-55184200-50b5-4e1a-b462-4c024d22723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:30:47.818522 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 738/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:30:47.971530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b56ff4-3299-40b8-9a46-17b39ad3b35b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:30:47.986514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b56ff4-3299-40b8-9a46-17b39ad3b35b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:30:47.991969 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee81b7-430a-4aee-8021-772e70b9c313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:30:47.992607 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee81b7-430a-4aee-8021-772e70b9c313 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:47.992894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee81b7-430a-4aee-8021-772e70b9c313 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:47.993269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee81b7-430a-4aee-8021-772e70b9c313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:48.001643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee81b7-430a-4aee-8021-772e70b9c313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:30:48.003258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee81b7-430a-4aee-8021-772e70b9c313 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:30:48.012851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 778/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:30:48.484424 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781aadf4-2d0e-4e9f-993f-9ecd8845f7b2 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:48.484698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781aadf4-2d0e-4e9f-993f-9ecd8845f7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:48.484994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781aadf4-2d0e-4e9f-993f-9ecd8845f7b2 None None] PATH_INFO: `/v3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:48.486278 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 739/1517] 10.222.0.43 () {54 vars in 925 bytes} [Sat Aug 6 01:30:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:30:48.515279 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e5d59-4e6f-4d64-9675-4a168f379739 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:48.515559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e5d59-4e6f-4d64-9675-4a168f379739 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:48.515833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e5d59-4e6f-4d64-9675-4a168f379739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:48.574021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0b3e5d59-4e6f-4d64-9675-4a168f379739 None None] MFA Rules not processed for user `fc1bd453c1114da4a5d9aa543bf1ff32`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:30:48.575220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0b3e5d59-4e6f-4d64-9675-4a168f379739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:30:48.592997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:30:48.653740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 779/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Sat Aug 6 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:30:57.803876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=56 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:30:57.904499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa246e7d-d2ff-48a7-8322-1e26e5546bdf None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:57.904819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa246e7d-d2ff-48a7-8322-1e26e5546bdf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:57.906207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa246e7d-d2ff-48a7-8322-1e26e5546bdf None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:57.908057 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 740/1519] 10.222.0.15 () {54 vars in 961 bytes} [Sat Aug 6 01:30:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:30:57.913550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f015bec-d9ec-4b8a-bae8-8dd1444d3f44 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:57.914032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f015bec-d9ec-4b8a-bae8-8dd1444d3f44 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:57.914139 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f015bec-d9ec-4b8a-bae8-8dd1444d3f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:57.933592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4f015bec-d9ec-4b8a-bae8-8dd1444d3f44 None None] MFA Rules not processed for user `fc1bd453c1114da4a5d9aa543bf1ff32`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:30:57.934768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4f015bec-d9ec-4b8a-bae8-8dd1444d3f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:30:57.943115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 780/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Sat Aug 6 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:30:57.950395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa246e7d-d2ff-48a7-8322-1e26e5546bdf None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:30:57.964264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa246e7d-d2ff-48a7-8322-1e26e5546bdf None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:30:57.969903 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878c9fa-4af2-494e-bdab-f2610d299a94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:30:57.970511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878c9fa-4af2-494e-bdab-f2610d299a94 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:57.970795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878c9fa-4af2-494e-bdab-f2610d299a94 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:57.971073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878c9fa-4af2-494e-bdab-f2610d299a94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:57.979411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878c9fa-4af2-494e-bdab-f2610d299a94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:30:57.981028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878c9fa-4af2-494e-bdab-f2610d299a94 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:30:57.991174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 741/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:30:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:30:59.256130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57cc5-6364-4255-8a65-b474524b7ade None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:59.256676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57cc5-6364-4255-8a65-b474524b7ade None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:59.256676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57cc5-6364-4255-8a65-b474524b7ade None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:59.258104 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 781/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:30:59.263408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225144b-4150-453d-87fa-4c07de0b34d5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:59.263815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225144b-4150-453d-87fa-4c07de0b34d5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:59.263963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225144b-4150-453d-87fa-4c07de0b34d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:59.284450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8225144b-4150-453d-87fa-4c07de0b34d5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:30:59.285673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8225144b-4150-453d-87fa-4c07de0b34d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:30:59.293462 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 742/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:30:59.451581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea57cc5-6364-4255-8a65-b474524b7ade None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:30:59.466653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea57cc5-6364-4255-8a65-b474524b7ade None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:30:59.472137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938735ed-9742-4189-b342-c9ddb09db121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:30:59.472757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938735ed-9742-4189-b342-c9ddb09db121 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:59.473074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938735ed-9742-4189-b342-c9ddb09db121 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:59.473356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938735ed-9742-4189-b342-c9ddb09db121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:59.481572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938735ed-9742-4189-b342-c9ddb09db121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:30:59.483188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938735ed-9742-4189-b342-c9ddb09db121 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:30:59.492950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 782/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:31:00.338390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8e344-7715-4c6c-ab7a-0aae5d501b9c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:00.338978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8e344-7715-4c6c-ab7a-0aae5d501b9c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:00.338978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8e344-7715-4c6c-ab7a-0aae5d501b9c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:00.340323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 743/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:31:00.345726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3d83b-8ed1-4e78-8731-86e08aad891a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:00.346109 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3d83b-8ed1-4e78-8731-86e08aad891a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:00.346275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3d83b-8ed1-4e78-8731-86e08aad891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:00.366388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0dd3d83b-8ed1-4e78-8731-86e08aad891a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:31:00.367591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0dd3d83b-8ed1-4e78-8731-86e08aad891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:00.376385 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 783/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:31:00.527571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8e344-7715-4c6c-ab7a-0aae5d501b9c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:31:00.542480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8e344-7715-4c6c-ab7a-0aae5d501b9c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:31:00.548141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90e4f1-b1a6-4277-af63-af9cdaba6c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:31:00.548752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90e4f1-b1a6-4277-af63-af9cdaba6c35 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:00.549065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90e4f1-b1a6-4277-af63-af9cdaba6c35 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:00.549339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90e4f1-b1a6-4277-af63-af9cdaba6c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:00.557885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90e4f1-b1a6-4277-af63-af9cdaba6c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:31:00.559462 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90e4f1-b1a6-4277-af63-af9cdaba6c35 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:31:00.568996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 744/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:31:04.308888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de9e3c-b3ee-424d-b627-8f58e5663f18 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:04.309448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de9e3c-b3ee-424d-b627-8f58e5663f18 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:04.309565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de9e3c-b3ee-424d-b627-8f58e5663f18 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:04.310832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 784/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:31:04.316173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2edce-5c4b-413f-b69d-a21e73426c24 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:04.316588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2edce-5c4b-413f-b69d-a21e73426c24 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:04.316725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2edce-5c4b-413f-b69d-a21e73426c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:04.336254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-89a2edce-5c4b-413f-b69d-a21e73426c24 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:31:04.337483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-89a2edce-5c4b-413f-b69d-a21e73426c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:04.345891 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 745/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:31:04.419568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de9e3c-b3ee-424d-b627-8f58e5663f18 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:31:04.421382 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b3de9e3c-b3ee-424d-b627-8f58e5663f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:04.501017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de9e3c-b3ee-424d-b627-8f58e5663f18 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:31:04.504508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9ad3f-5e4b-4e0a-8844-15712dade804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:31:04.505151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9ad3f-5e4b-4e0a-8844-15712dade804 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:04.505430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9ad3f-5e4b-4e0a-8844-15712dade804 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:04.505702 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9ad3f-5e4b-4e0a-8844-15712dade804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:04.514939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9ad3f-5e4b-4e0a-8844-15712dade804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:31:04.516340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9ad3f-5e4b-4e0a-8844-15712dade804 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:31:04.525464 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 785/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:31:06.506577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8a317-52ec-45d8-a7bd-f959679cae06 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:06.507104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8a317-52ec-45d8-a7bd-f959679cae06 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:06.507250 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8a317-52ec-45d8-a7bd-f959679cae06 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:06.508478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 746/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:31:06.513870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10c192-e922-45ef-8399-df6ef8726ca9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:06.514811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10c192-e922-45ef-8399-df6ef8726ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:06.515115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10c192-e922-45ef-8399-df6ef8726ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:06.535115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2d10c192-e922-45ef-8399-df6ef8726ca9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:31:06.536299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2d10c192-e922-45ef-8399-df6ef8726ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:06.543940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 786/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:31:06.580048 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8a317-52ec-45d8-a7bd-f959679cae06 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:31:06.590640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8a317-52ec-45d8-a7bd-f959679cae06 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:31:06.595202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6adf84-395b-46ad-850f-4478ed445990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:31:06.595801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6adf84-395b-46ad-850f-4478ed445990 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:06.596080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6adf84-395b-46ad-850f-4478ed445990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:06.596354 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6adf84-395b-46ad-850f-4478ed445990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:06.607868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6adf84-395b-46ad-850f-4478ed445990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:31:06.609781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6adf84-395b-46ad-850f-4478ed445990 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:31:06.619083 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 747/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:31:10.074876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea39f6-1fc2-4a3a-abba-1310e89f17c2 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:10.075456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea39f6-1fc2-4a3a-abba-1310e89f17c2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:10.075456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea39f6-1fc2-4a3a-abba-1310e89f17c2 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:10.077412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 787/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:31:10.082756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa322901-f0be-49d4-91b8-fd122230702d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:10.083197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa322901-f0be-49d4-91b8-fd122230702d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:10.083312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa322901-f0be-49d4-91b8-fd122230702d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:10.102921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fa322901-f0be-49d4-91b8-fd122230702d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:31:10.104097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fa322901-f0be-49d4-91b8-fd122230702d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:10.111961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 748/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:31:10.416834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea39f6-1fc2-4a3a-abba-1310e89f17c2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:31:10.418611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-20ea39f6-1fc2-4a3a-abba-1310e89f17c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:10.482454 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:31:10.495868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea39f6-1fc2-4a3a-abba-1310e89f17c2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:31:10.500016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97951a4b-00a3-4115-983c-9c641b08896d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:31:10.500628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97951a4b-00a3-4115-983c-9c641b08896d service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:10.500931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97951a4b-00a3-4115-983c-9c641b08896d service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:10.501207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97951a4b-00a3-4115-983c-9c641b08896d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:10.509959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97951a4b-00a3-4115-983c-9c641b08896d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:31:10.511646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97951a4b-00a3-4115-983c-9c641b08896d service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:31:10.521401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 788/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:31:12.569351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32208ef0-d799-4c66-9add-8a1a5dc7894f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:12.569919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32208ef0-d799-4c66-9add-8a1a5dc7894f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:12.569919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32208ef0-d799-4c66-9add-8a1a5dc7894f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:12.571268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 749/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:31:12.576989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07f69-5d40-4944-84a8-1e9e55d99fd3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:12.577552 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07f69-5d40-4944-84a8-1e9e55d99fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:12.577552 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07f69-5d40-4944-84a8-1e9e55d99fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:12.597248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-25f07f69-5d40-4944-84a8-1e9e55d99fd3 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:31:12.598448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-25f07f69-5d40-4944-84a8-1e9e55d99fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:12.606074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 789/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:31:12.908857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32208ef0-d799-4c66-9add-8a1a5dc7894f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:31:12.910569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-32208ef0-d799-4c66-9add-8a1a5dc7894f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:12.924124 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32208ef0-d799-4c66-9add-8a1a5dc7894f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:31:12.927582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c56f75-dbb6-4d3c-8ab7-372a3c0b472d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:31:12.928178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c56f75-dbb6-4d3c-8ab7-372a3c0b472d service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:12.928463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c56f75-dbb6-4d3c-8ab7-372a3c0b472d service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:12.928734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c56f75-dbb6-4d3c-8ab7-372a3c0b472d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:12.937568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c56f75-dbb6-4d3c-8ab7-372a3c0b472d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:31:12.939014 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c56f75-dbb6-4d3c-8ab7-372a3c0b472d service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:31:12.948597 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 750/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:31:22.592756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=11 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:31:22.944187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=33 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:46.442730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31773a-db84-48f3-8050-102ebafb55d0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.445346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31773a-db84-48f3-8050-102ebafb55d0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.445346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31773a-db84-48f3-8050-102ebafb55d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.471293 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2d31773a-db84-48f3-8050-102ebafb55d0 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.473138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2d31773a-db84-48f3-8050-102ebafb55d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.484863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 790/1540] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:46.494439 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e197bd-f07c-4d3c-9d97-7de6ed030fbb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.495004 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e197bd-f07c-4d3c-9d97-7de6ed030fbb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.495004 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e197bd-f07c-4d3c-9d97-7de6ed030fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.512861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66f374-ecc6-4dbb-8557-0398b96fe512 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.513551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66f374-ecc6-4dbb-8557-0398b96fe512 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.514046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66f374-ecc6-4dbb-8557-0398b96fe512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.533828 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a1e197bd-f07c-4d3c-9d97-7de6ed030fbb None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.536031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a1e197bd-f07c-4d3c-9d97-7de6ed030fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.540720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8d66f374-ecc6-4dbb-8557-0398b96fe512 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.546679 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8d66f374-ecc6-4dbb-8557-0398b96fe512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.550322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 751/1541] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:46.558263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 791/1542] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:32:46.561854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e197bd-f07c-4d3c-9d97-7de6ed030fbb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:46.568079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2300f5-3830-44ae-8c44-9de2118cb351 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.568650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2300f5-3830-44ae-8c44-9de2118cb351 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.569247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2300f5-3830-44ae-8c44-9de2118cb351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.576225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e197bd-f07c-4d3c-9d97-7de6ed030fbb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:46.595756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55ace0-a455-449f-965a-8b648e0520d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:46.596400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55ace0-a455-449f-965a-8b648e0520d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.596686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55ace0-a455-449f-965a-8b648e0520d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.596986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55ace0-a455-449f-965a-8b648e0520d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.598390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55ace0-a455-449f-965a-8b648e0520d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:32:46.598953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55ace0-a455-449f-965a-8b648e0520d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:46.600872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-6f55ace0-a455-449f-965a-8b648e0520d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:32:46.600872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: warnings.warn(msg) Aug 06 01:32:46.600872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: Aug 06 01:32:46.602042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2a2300f5-3830-44ae-8c44-9de2118cb351 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.602558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55ace0-a455-449f-965a-8b648e0520d4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:46.603735 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2a2300f5-3830-44ae-8c44-9de2118cb351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.620340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 792/1543] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:32:46.622401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c93076-4886-4871-b651-d8b9ce4f8cc9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.623299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c93076-4886-4871-b651-d8b9ce4f8cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.623802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c93076-4886-4871-b651-d8b9ce4f8cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.627720 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 752/1544] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:32:46.634107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2682562-0889-4436-9a49-6700e58f61e9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.634645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2682562-0889-4436-9a49-6700e58f61e9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.634991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2682562-0889-4436-9a49-6700e58f61e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.657703 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-47c93076-4886-4871-b651-d8b9ce4f8cc9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.659467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-47c93076-4886-4871-b651-d8b9ce4f8cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.665872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f2682562-0889-4436-9a49-6700e58f61e9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.667117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f2682562-0889-4436-9a49-6700e58f61e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.670214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 793/1545] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:46.670927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c93076-4886-4871-b651-d8b9ce4f8cc9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:46.681203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c93076-4886-4871-b651-d8b9ce4f8cc9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:46.683273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 753/1546] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:46.684716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57007-ecc4-4f17-b637-3b7c3894cb37 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.685047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57007-ecc4-4f17-b637-3b7c3894cb37 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.685329 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57007-ecc4-4f17-b637-3b7c3894cb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.686683 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eb3b7-257f-4edb-9135-75b0097070ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:46.687497 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb3b7-257f-4edb-9135-75b0097070ba admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.688081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb3b7-257f-4edb-9135-75b0097070ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.688543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb3b7-257f-4edb-9135-75b0097070ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.690033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eb3b7-257f-4edb-9135-75b0097070ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:32:46.690585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eb3b7-257f-4edb-9135-75b0097070ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:46.692356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eb3b7-257f-4edb-9135-75b0097070ba admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:46.704619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 794/1547] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:32:46.704885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8aa57007-ecc4-4f17-b637-3b7c3894cb37 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.706101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d554-28b9-4369-9100-a0297185f817 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.706221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8aa57007-ecc4-4f17-b637-3b7c3894cb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.706415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d554-28b9-4369-9100-a0297185f817 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.706666 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d554-28b9-4369-9100-a0297185f817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.715797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 754/1548] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:46.717182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154a808-9f69-409c-a1e2-c0d612ef9a75 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.717476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154a808-9f69-409c-a1e2-c0d612ef9a75 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.717767 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154a808-9f69-409c-a1e2-c0d612ef9a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.730037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-86d5d554-28b9-4369-9100-a0297185f817 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.731838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-86d5d554-28b9-4369-9100-a0297185f817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.737533 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4154a808-9f69-409c-a1e2-c0d612ef9a75 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.738692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4154a808-9f69-409c-a1e2-c0d612ef9a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.739728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 795/1549] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:46.740470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5d554-28b9-4369-9100-a0297185f817 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:46.746971 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 755/1550] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:46.748474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4780c65-8b9d-4a6b-bf07-ebc136e40a98 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.748765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4780c65-8b9d-4a6b-bf07-ebc136e40a98 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.749080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4780c65-8b9d-4a6b-bf07-ebc136e40a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.750668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5d554-28b9-4369-9100-a0297185f817 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:46.757366 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7866c7-9580-40ad-b072-5483e10787f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:46.758868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7866c7-9580-40ad-b072-5483e10787f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.759295 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7866c7-9580-40ad-b072-5483e10787f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.759576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7866c7-9580-40ad-b072-5483e10787f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.760242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7866c7-9580-40ad-b072-5483e10787f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:46.761562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: WARNING py.warnings [None req-5e7866c7-9580-40ad-b072-5483e10787f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:32:46.761562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: warnings.warn(msg) Aug 06 01:32:46.761562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: Aug 06 01:32:46.763344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7866c7-9580-40ad-b072-5483e10787f2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:46.769846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a4780c65-8b9d-4a6b-bf07-ebc136e40a98 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.771047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a4780c65-8b9d-4a6b-bf07-ebc136e40a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.780061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 756/1551] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:46.781313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcec9ca-08cb-4d65-8fa3-89ef555684df None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.781595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcec9ca-08cb-4d65-8fa3-89ef555684df None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.781982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcec9ca-08cb-4d65-8fa3-89ef555684df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.802450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 796/1552] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:46.804125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e9f70-b2ba-4d24-afbf-f38aebb877d1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.804421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e9f70-b2ba-4d24-afbf-f38aebb877d1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.804696 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e9f70-b2ba-4d24-afbf-f38aebb877d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.806624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-efcec9ca-08cb-4d65-8fa3-89ef555684df None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.807945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-efcec9ca-08cb-4d65-8fa3-89ef555684df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.824809 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-150e9f70-b2ba-4d24-afbf-f38aebb877d1 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.826324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-150e9f70-b2ba-4d24-afbf-f38aebb877d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.868733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 757/1553] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:46.869616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcec9ca-08cb-4d65-8fa3-89ef555684df None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:46.878881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcec9ca-08cb-4d65-8fa3-89ef555684df None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:46.883384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17306691-fd80-4fea-b6d8-103bb761fa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:46.883984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17306691-fd80-4fea-b6d8-103bb761fa13 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.884267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17306691-fd80-4fea-b6d8-103bb761fa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.884543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17306691-fd80-4fea-b6d8-103bb761fa13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.885327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17306691-fd80-4fea-b6d8-103bb761fa13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:46.886136 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 797/1554] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:46.888068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b59367-72ec-42ee-99fe-b27444691282 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.888259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17306691-fd80-4fea-b6d8-103bb761fa13 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:46.888583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b59367-72ec-42ee-99fe-b27444691282 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.888943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b59367-72ec-42ee-99fe-b27444691282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.909398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-45b59367-72ec-42ee-99fe-b27444691282 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.910602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-45b59367-72ec-42ee-99fe-b27444691282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.920447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 758/1555] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:46.920447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7c841-2843-4075-97af-771c821d07dd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.920447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7c841-2843-4075-97af-771c821d07dd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.920447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7c841-2843-4075-97af-771c821d07dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.920874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 798/1556] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:46.920874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515d4c4-76b8-4b28-9206-7df6c4c9d1af None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:46.921222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515d4c4-76b8-4b28-9206-7df6c4c9d1af None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:46.921441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515d4c4-76b8-4b28-9206-7df6c4c9d1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:46.938860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-32b7c841-2843-4075-97af-771c821d07dd None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.940050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-32b7c841-2843-4075-97af-771c821d07dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:46.940815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1515d4c4-76b8-4b28-9206-7df6c4c9d1af None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:46.941999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1515d4c4-76b8-4b28-9206-7df6c4c9d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:47.000011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 759/1557] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:47.001711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded157-9823-4976-b7bf-dee92605fdd8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.002003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded157-9823-4976-b7bf-dee92605fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.002280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded157-9823-4976-b7bf-dee92605fdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.006502 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 799/1558] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:47.007494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515d4c4-76b8-4b28-9206-7df6c4c9d1af None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.017715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515d4c4-76b8-4b28-9206-7df6c4c9d1af None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.022248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0909ee-d09a-476c-b9ba-dd8dfe501398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.022694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e6ded157-9823-4976-b7bf-dee92605fdd8 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:47.022884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0909ee-d09a-476c-b9ba-dd8dfe501398 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.023170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0909ee-d09a-476c-b9ba-dd8dfe501398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.023450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0909ee-d09a-476c-b9ba-dd8dfe501398 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.023891 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e6ded157-9823-4976-b7bf-dee92605fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:47.024115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0909ee-d09a-476c-b9ba-dd8dfe501398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.026132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0909ee-d09a-476c-b9ba-dd8dfe501398 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.032236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 760/1559] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:47.036045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded157-9823-4976-b7bf-dee92605fdd8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.044865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded157-9823-4976-b7bf-dee92605fdd8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.045360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:47.050383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b373b-a71f-48de-adf8-52804ec92b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.051319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b373b-a71f-48de-adf8-52804ec92b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.051547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b373b-a71f-48de-adf8-52804ec92b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.052030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b373b-a71f-48de-adf8-52804ec92b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.052272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 800/1560] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.053182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b373b-a71f-48de-adf8-52804ec92b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:32:47.053643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b373b-a71f-48de-adf8-52804ec92b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.053764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0909ee-d09a-476c-b9ba-dd8dfe501398 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.055482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b373b-a71f-48de-adf8-52804ec92b07 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.063902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0909ee-d09a-476c-b9ba-dd8dfe501398 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.073398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 761/1561] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:32:47.073603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212d29-1eb6-4b34-8989-e61a2200742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.073723 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b373b-a71f-48de-adf8-52804ec92b07 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.073818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212d29-1eb6-4b34-8989-e61a2200742c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.073818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212d29-1eb6-4b34-8989-e61a2200742c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.073818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212d29-1eb6-4b34-8989-e61a2200742c admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.073818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a212d29-1eb6-4b34-8989-e61a2200742c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:32:47.073818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a212d29-1eb6-4b34-8989-e61a2200742c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.073818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a212d29-1eb6-4b34-8989-e61a2200742c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.080459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b373b-a71f-48de-adf8-52804ec92b07 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.085067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d87b1-3640-40fd-b913-82b31ee55115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.085804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d87b1-3640-40fd-b913-82b31ee55115 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.086089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d87b1-3640-40fd-b913-82b31ee55115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.086364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d87b1-3640-40fd-b913-82b31ee55115 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.086672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 801/1562] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:32:47.087018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d87b1-3640-40fd-b913-82b31ee55115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.087582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212d29-1eb6-4b34-8989-e61a2200742c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.088128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-934d87b1-3640-40fd-b913-82b31ee55115 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:32:47.088128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: warnings.warn(msg) Aug 06 01:32:47.088128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: Aug 06 01:32:47.089459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d87b1-3640-40fd-b913-82b31ee55115 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.097739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212d29-1eb6-4b34-8989-e61a2200742c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.101712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:47.102529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36804d-3194-4649-9833-b92f26569809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.103240 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36804d-3194-4649-9833-b92f26569809 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.103558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36804d-3194-4649-9833-b92f26569809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.103846 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36804d-3194-4649-9833-b92f26569809 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.104770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36804d-3194-4649-9833-b92f26569809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:32:47.105187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36804d-3194-4649-9833-b92f26569809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.107068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36804d-3194-4649-9833-b92f26569809 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.114906 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 762/1563] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.116169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d87b1-3640-40fd-b913-82b31ee55115 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.128380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 802/1564] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:32:47.128380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36804d-3194-4649-9833-b92f26569809 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.128652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d87b1-3640-40fd-b913-82b31ee55115 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.130739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf77750-9d57-4e65-9011-8e8360161e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.131284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf77750-9d57-4e65-9011-8e8360161e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.131563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf77750-9d57-4e65-9011-8e8360161e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.131836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf77750-9d57-4e65-9011-8e8360161e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.131940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36804d-3194-4649-9833-b92f26569809 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.132523 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf77750-9d57-4e65-9011-8e8360161e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:32:47.132848 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf77750-9d57-4e65-9011-8e8360161e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.134464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf77750-9d57-4e65-9011-8e8360161e71 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.137197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f9f9e-d352-42ab-b6af-aa32eec5f9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.138033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f9f9e-d352-42ab-b6af-aa32eec5f9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.138329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f9f9e-d352-42ab-b6af-aa32eec5f9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.138604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f9f9e-d352-42ab-b6af-aa32eec5f9f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.139293 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f9f9e-d352-42ab-b6af-aa32eec5f9f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:32:47.139600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f9f9e-d352-42ab-b6af-aa32eec5f9f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.141198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f9f9e-d352-42ab-b6af-aa32eec5f9f8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.147248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 763/1565] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:32:47.156152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf77750-9d57-4e65-9011-8e8360161e71 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.158694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf77750-9d57-4e65-9011-8e8360161e71 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.162234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 803/1566] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:32:47.163207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f9f9e-d352-42ab-b6af-aa32eec5f9f8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.163612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1da48-94b7-473b-9bde-0bf39c135261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.164225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1da48-94b7-473b-9bde-0bf39c135261 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.164513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1da48-94b7-473b-9bde-0bf39c135261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.164793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1da48-94b7-473b-9bde-0bf39c135261 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.165518 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1da48-94b7-473b-9bde-0bf39c135261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:32:47.165957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1da48-94b7-473b-9bde-0bf39c135261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.167556 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1da48-94b7-473b-9bde-0bf39c135261 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.173317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f9f9e-d352-42ab-b6af-aa32eec5f9f8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.177886 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0923f0-eb75-4b38-aea8-aba00d9a23ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.178477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0923f0-eb75-4b38-aea8-aba00d9a23ee admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.178756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0923f0-eb75-4b38-aea8-aba00d9a23ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.179026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0923f0-eb75-4b38-aea8-aba00d9a23ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.179708 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0923f0-eb75-4b38-aea8-aba00d9a23ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.181311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0923f0-eb75-4b38-aea8-aba00d9a23ee admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.186337 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 764/1567] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:32:47.186337 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1da48-94b7-473b-9bde-0bf39c135261 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.192596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1da48-94b7-473b-9bde-0bf39c135261 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.195613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 804/1568] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:47.196266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0923f0-eb75-4b38-aea8-aba00d9a23ee admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.197472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7400-7c41-4af7-95e3-67c937b80332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.198113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7400-7c41-4af7-95e3-67c937b80332 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.198365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7400-7c41-4af7-95e3-67c937b80332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.198633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7400-7c41-4af7-95e3-67c937b80332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.199356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da7400-7c41-4af7-95e3-67c937b80332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.201301 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da7400-7c41-4af7-95e3-67c937b80332 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.207376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0923f0-eb75-4b38-aea8-aba00d9a23ee admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.212145 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc4441-94b3-4529-98fc-975194d12945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.212772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc4441-94b3-4529-98fc-975194d12945 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.213099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc4441-94b3-4529-98fc-975194d12945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.213375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc4441-94b3-4529-98fc-975194d12945 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.214037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc4441-94b3-4529-98fc-975194d12945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.216705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc4441-94b3-4529-98fc-975194d12945 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.228136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 765/1569] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.228970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7400-7c41-4af7-95e3-67c937b80332 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.248199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 805/1570] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.249432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc4441-94b3-4529-98fc-975194d12945 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.296892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7400-7c41-4af7-95e3-67c937b80332 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.314944 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc4441-94b3-4529-98fc-975194d12945 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.319625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0589a-881d-4c98-bc47-007ba4ba87ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.320233 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0589a-881d-4c98-bc47-007ba4ba87ca admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.320514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0589a-881d-4c98-bc47-007ba4ba87ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.320784 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0589a-881d-4c98-bc47-007ba4ba87ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.321499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0589a-881d-4c98-bc47-007ba4ba87ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.323382 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0589a-881d-4c98-bc47-007ba4ba87ca admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.352842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 806/1571] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.354141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0589a-881d-4c98-bc47-007ba4ba87ca admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.357315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e851f6d-9497-481e-8594-95b36798dcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.357947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851f6d-9497-481e-8594-95b36798dcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.358236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851f6d-9497-481e-8594-95b36798dcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.358516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851f6d-9497-481e-8594-95b36798dcb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.359342 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e851f6d-9497-481e-8594-95b36798dcb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.360957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e851f6d-9497-481e-8594-95b36798dcb5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.377557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 766/1572] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:47.378930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e851f6d-9497-481e-8594-95b36798dcb5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.390438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e851f6d-9497-481e-8594-95b36798dcb5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.423966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0589a-881d-4c98-bc47-007ba4ba87ca admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.428986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce36343-dedf-4c0d-b530-7ecd033d6cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.429603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce36343-dedf-4c0d-b530-7ecd033d6cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.429884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce36343-dedf-4c0d-b530-7ecd033d6cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.430157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce36343-dedf-4c0d-b530-7ecd033d6cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.430942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce36343-dedf-4c0d-b530-7ecd033d6cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.432834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce36343-dedf-4c0d-b530-7ecd033d6cdc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.438203 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:47.448180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850eccce-af6c-41b7-8d26-74657c2497cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.448796 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850eccce-af6c-41b7-8d26-74657c2497cf admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.449877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850eccce-af6c-41b7-8d26-74657c2497cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.450273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850eccce-af6c-41b7-8d26-74657c2497cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.450943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850eccce-af6c-41b7-8d26-74657c2497cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.452863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850eccce-af6c-41b7-8d26-74657c2497cf admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.454280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:47.467272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 807/1573] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/projects => generated 357 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.467272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce36343-dedf-4c0d-b530-7ecd033d6cdc admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.485732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 767/1574] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.485732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850eccce-af6c-41b7-8d26-74657c2497cf admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.531993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce36343-dedf-4c0d-b530-7ecd033d6cdc admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.546665 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850eccce-af6c-41b7-8d26-74657c2497cf admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.551272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b51b-1645-4e24-b1d8-ff4516fc5a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.551927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b51b-1645-4e24-b1d8-ff4516fc5a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.552182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b51b-1645-4e24-b1d8-ff4516fc5a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.552457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b51b-1645-4e24-b1d8-ff4516fc5a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.553181 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9b51b-1645-4e24-b1d8-ff4516fc5a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.554751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9b51b-1645-4e24-b1d8-ff4516fc5a74 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.565529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 768/1575] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:47.566305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b51b-1645-4e24-b1d8-ff4516fc5a74 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.576280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b51b-1645-4e24-b1d8-ff4516fc5a74 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.581436 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeecb9-1ef0-4af0-8d5c-8e0a71f3e6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.582024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeecb9-1ef0-4af0-8d5c-8e0a71f3e6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.582306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeecb9-1ef0-4af0-8d5c-8e0a71f3e6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.582579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeecb9-1ef0-4af0-8d5c-8e0a71f3e6e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.583256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eeecb9-1ef0-4af0-8d5c-8e0a71f3e6e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.585141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eeecb9-1ef0-4af0-8d5c-8e0a71f3e6e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.593918 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7c643-3686-4f21-8be3-a43eb4e288bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.594537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7c643-3686-4f21-8be3-a43eb4e288bb admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.594819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7c643-3686-4f21-8be3-a43eb4e288bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.595099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7c643-3686-4f21-8be3-a43eb4e288bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.595761 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7c643-3686-4f21-8be3-a43eb4e288bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.597900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7c643-3686-4f21-8be3-a43eb4e288bb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.606891 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 769/1576] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.609774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeecb9-1ef0-4af0-8d5c-8e0a71f3e6e1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.621735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeecb9-1ef0-4af0-8d5c-8e0a71f3e6e1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.626514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cef3c-f40f-44dc-9f25-b196f2226be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.627143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cef3c-f40f-44dc-9f25-b196f2226be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.627423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cef3c-f40f-44dc-9f25-b196f2226be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.627701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cef3c-f40f-44dc-9f25-b196f2226be4 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.628353 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cef3c-f40f-44dc-9f25-b196f2226be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.628471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 808/1577] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.629296 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7c643-3686-4f21-8be3-a43eb4e288bb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.630556 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cef3c-f40f-44dc-9f25-b196f2226be4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.655734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 770/1578] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.656758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cef3c-f40f-44dc-9f25-b196f2226be4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.666099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cef3c-f40f-44dc-9f25-b196f2226be4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.700022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7c643-3686-4f21-8be3-a43eb4e288bb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.704739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bfe93-bd21-4c2c-a184-18a1adf03031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.705565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bfe93-bd21-4c2c-a184-18a1adf03031 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.705851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bfe93-bd21-4c2c-a184-18a1adf03031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.706128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bfe93-bd21-4c2c-a184-18a1adf03031 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.706791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bfe93-bd21-4c2c-a184-18a1adf03031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.708711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bfe93-bd21-4c2c-a184-18a1adf03031 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.723275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5df1db-79c3-4d78-9dcd-24a8bb506300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.723904 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5df1db-79c3-4d78-9dcd-24a8bb506300 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.724332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5df1db-79c3-4d78-9dcd-24a8bb506300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.724611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5df1db-79c3-4d78-9dcd-24a8bb506300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.725351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5df1db-79c3-4d78-9dcd-24a8bb506300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.726954 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5df1db-79c3-4d78-9dcd-24a8bb506300 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.731527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 809/1579] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.732326 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bfe93-bd21-4c2c-a184-18a1adf03031 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.738351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 771/1580] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:47.739162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5df1db-79c3-4d78-9dcd-24a8bb506300 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.746122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bfe93-bd21-4c2c-a184-18a1adf03031 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.748718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5df1db-79c3-4d78-9dcd-24a8bb506300 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.751018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b729a-7611-4721-8223-2a842cdd00db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.751720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b729a-7611-4721-8223-2a842cdd00db admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.752006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b729a-7611-4721-8223-2a842cdd00db admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.752279 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b729a-7611-4721-8223-2a842cdd00db admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.752997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b729a-7611-4721-8223-2a842cdd00db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.753546 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a92a78-a9d3-4f32-83eb-5741fb3d9839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.754294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a92a78-a9d3-4f32-83eb-5741fb3d9839 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.754679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a92a78-a9d3-4f32-83eb-5741fb3d9839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.754960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a92a78-a9d3-4f32-83eb-5741fb3d9839 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.755079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b729a-7611-4721-8223-2a842cdd00db admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.755613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a92a78-a9d3-4f32-83eb-5741fb3d9839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.757556 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a92a78-a9d3-4f32-83eb-5741fb3d9839 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.779903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 810/1581] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/users => generated 279 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.783589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 772/1582] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.783715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b729a-7611-4721-8223-2a842cdd00db admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.783815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a92a78-a9d3-4f32-83eb-5741fb3d9839 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.787888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:47.791216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a92a78-a9d3-4f32-83eb-5741fb3d9839 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.793801 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b729a-7611-4721-8223-2a842cdd00db admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.796633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066810ec-07d9-4f4f-b479-adc03338fc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.797281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066810ec-07d9-4f4f-b479-adc03338fc0f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.797567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066810ec-07d9-4f4f-b479-adc03338fc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.797871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066810ec-07d9-4f4f-b479-adc03338fc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.798565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066810ec-07d9-4f4f-b479-adc03338fc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.799385 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123c474-803f-4a9f-90f4-f9b768ba8353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.800039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123c474-803f-4a9f-90f4-f9b768ba8353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.800212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066810ec-07d9-4f4f-b479-adc03338fc0f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.800312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123c474-803f-4a9f-90f4-f9b768ba8353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.800577 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123c474-803f-4a9f-90f4-f9b768ba8353 admin admin] PATH_INFO: `/v3/projects/4c4aa6e5eb284cab91e8f62326e2d098/users/b16a5b3496a64add815e9ffc0b7275f8/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.811273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 773/1583] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:47.812068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066810ec-07d9-4f4f-b479-adc03338fc0f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.817412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123c474-803f-4a9f-90f4-f9b768ba8353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4aa6e5eb284cab91e8f62326e2d098, user_id=b16a5b3496a64add815e9ffc0b7275f8, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.818032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:47.818461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: WARNING py.warnings [None req-5123c474-803f-4a9f-90f4-f9b768ba8353 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:32:47.818461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: warnings.warn(msg) Aug 06 01:32:47.818461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: Aug 06 01:32:47.820640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123c474-803f-4a9f-90f4-f9b768ba8353 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.822151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066810ec-07d9-4f4f-b479-adc03338fc0f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.829133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013549f5-82d4-4119-a86b-66f3b89df8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.829930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013549f5-82d4-4119-a86b-66f3b89df8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.830473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013549f5-82d4-4119-a86b-66f3b89df8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.830851 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013549f5-82d4-4119-a86b-66f3b89df8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.831407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013549f5-82d4-4119-a86b-66f3b89df8d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.833319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013549f5-82d4-4119-a86b-66f3b89df8d3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.835980 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 811/1584] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:32:47 2022] PUT /identity/v3/projects/4c4aa6e5eb284cab91e8f62326e2d098/users/b16a5b3496a64add815e9ffc0b7275f8/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:47.836816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123c474-803f-4a9f-90f4-f9b768ba8353 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.860774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 774/1585] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:32:47 2022] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:47.861624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013549f5-82d4-4119-a86b-66f3b89df8d3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.872207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013549f5-82d4-4119-a86b-66f3b89df8d3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.903176 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123c474-803f-4a9f-90f4-f9b768ba8353 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.907952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca42a0-6e29-426f-b644-b39c81a63142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.908507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca42a0-6e29-426f-b644-b39c81a63142 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.908847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca42a0-6e29-426f-b644-b39c81a63142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.909157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca42a0-6e29-426f-b644-b39c81a63142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.912685 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca42a0-6e29-426f-b644-b39c81a63142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.914531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca42a0-6e29-426f-b644-b39c81a63142 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.926563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 812/1586] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:47.927364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca42a0-6e29-426f-b644-b39c81a63142 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.932220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e9d4e-ea32-4a8f-8791-86a278b04340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.932843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e9d4e-ea32-4a8f-8791-86a278b04340 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.933162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e9d4e-ea32-4a8f-8791-86a278b04340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.934221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e9d4e-ea32-4a8f-8791-86a278b04340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.934931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e9d4e-ea32-4a8f-8791-86a278b04340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.936516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e9d4e-ea32-4a8f-8791-86a278b04340 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.937791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca42a0-6e29-426f-b644-b39c81a63142 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.942472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6765d5-71a6-42d7-b672-0ab803baf4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.943100 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6765d5-71a6-42d7-b672-0ab803baf4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.943382 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6765d5-71a6-42d7-b672-0ab803baf4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.943658 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6765d5-71a6-42d7-b672-0ab803baf4ec admin admin] PATH_INFO: `/v3/projects/f2cfad2d066d43cd81682da19288778d/users/1bac0cc0dd9149e4a25c2e1b5a54f1f5/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.946688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 775/1587] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:47.947472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e9d4e-ea32-4a8f-8791-86a278b04340 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.957635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e9d4e-ea32-4a8f-8791-86a278b04340 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:47.961549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6765d5-71a6-42d7-b672-0ab803baf4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2cfad2d066d43cd81682da19288778d, user_id=1bac0cc0dd9149e4a25c2e1b5a54f1f5, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.962919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c159aea-1227-44e7-a816-c06c0a206341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:47.963540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c159aea-1227-44e7-a816-c06c0a206341 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:47.963824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c159aea-1227-44e7-a816-c06c0a206341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:47.964104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c159aea-1227-44e7-a816-c06c0a206341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:47.964201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6765d5-71a6-42d7-b672-0ab803baf4ec admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.965364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c159aea-1227-44e7-a816-c06c0a206341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:47.967047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c159aea-1227-44e7-a816-c06c0a206341 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:47.977907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 813/1588] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:32:47 2022] PUT /identity/v3/projects/f2cfad2d066d43cd81682da19288778d/users/1bac0cc0dd9149e4a25c2e1b5a54f1f5/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:47.978792 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6765d5-71a6-42d7-b672-0ab803baf4ec admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.981051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 776/1589] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:47.983137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c159aea-1227-44e7-a816-c06c0a206341 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:47.992844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c159aea-1227-44e7-a816-c06c0a206341 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.044881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6765d5-71a6-42d7-b672-0ab803baf4ec admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.049537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff3b9f-ea15-44cb-8a8b-f0ea3a89534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.050185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff3b9f-ea15-44cb-8a8b-f0ea3a89534f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.050470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff3b9f-ea15-44cb-8a8b-f0ea3a89534f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.050815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff3b9f-ea15-44cb-8a8b-f0ea3a89534f admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.051354 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4593-015d-4fe0-901e-458158f844b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.051538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff3b9f-ea15-44cb-8a8b-f0ea3a89534f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.051931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4593-015d-4fe0-901e-458158f844b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.052211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4593-015d-4fe0-901e-458158f844b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.052483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4593-015d-4fe0-901e-458158f844b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.053081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff3b9f-ea15-44cb-8a8b-f0ea3a89534f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.053249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c4593-015d-4fe0-901e-458158f844b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.054797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c4593-015d-4fe0-901e-458158f844b7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.063790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 814/1590] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:48.065016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49c85-33fa-4a6b-a6a7-29dcaf43584c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.065211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 777/1591] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:48.065341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49c85-33fa-4a6b-a6a7-29dcaf43584c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.065575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49c85-33fa-4a6b-a6a7-29dcaf43584c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.066052 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4593-015d-4fe0-901e-458158f844b7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.076596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4593-015d-4fe0-901e-458158f844b7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.081531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d1432-97bb-4a59-8c0c-c08b17413e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.082144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d1432-97bb-4a59-8c0c-c08b17413e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.082425 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d1432-97bb-4a59-8c0c-c08b17413e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.082750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d1432-97bb-4a59-8c0c-c08b17413e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.083496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d1432-97bb-4a59-8c0c-c08b17413e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.085098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d1432-97bb-4a59-8c0c-c08b17413e98 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.094331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e6f49c85-33fa-4a6b-a6a7-29dcaf43584c None None] MFA Rules not processed for user `b16a5b3496a64add815e9ffc0b7275f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:48.095577 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e6f49c85-33fa-4a6b-a6a7-29dcaf43584c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:48.096133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 778/1592] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:48.097038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d1432-97bb-4a59-8c0c-c08b17413e98 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.106580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d1432-97bb-4a59-8c0c-c08b17413e98 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.111484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef823aa1-cfd5-4374-a484-2c97645b29c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.112074 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef823aa1-cfd5-4374-a484-2c97645b29c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.112360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef823aa1-cfd5-4374-a484-2c97645b29c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.112639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef823aa1-cfd5-4374-a484-2c97645b29c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.113381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef823aa1-cfd5-4374-a484-2c97645b29c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.114953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef823aa1-cfd5-4374-a484-2c97645b29c4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.125705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 779/1593] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:48.128581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:48.129752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef823aa1-cfd5-4374-a484-2c97645b29c4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.140363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef823aa1-cfd5-4374-a484-2c97645b29c4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.145080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df101e7-33b1-45b1-bbec-76ddbfd72247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.145680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df101e7-33b1-45b1-bbec-76ddbfd72247 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.145964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df101e7-33b1-45b1-bbec-76ddbfd72247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.146242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df101e7-33b1-45b1-bbec-76ddbfd72247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.146935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df101e7-33b1-45b1-bbec-76ddbfd72247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.148501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df101e7-33b1-45b1-bbec-76ddbfd72247 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.158444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 780/1594] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:48.159245 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df101e7-33b1-45b1-bbec-76ddbfd72247 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.164409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 815/1595] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:48.165636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959bfcb-e4ec-45b1-b76b-fb70c391d79e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.165893 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959bfcb-e4ec-45b1-b76b-fb70c391d79e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.166169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959bfcb-e4ec-45b1-b76b-fb70c391d79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.169762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df101e7-33b1-45b1-bbec-76ddbfd72247 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.174393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4042f23-47f7-4e0f-832a-0af79d3c93eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.174996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4042f23-47f7-4e0f-832a-0af79d3c93eb admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.175282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4042f23-47f7-4e0f-832a-0af79d3c93eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.175565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4042f23-47f7-4e0f-832a-0af79d3c93eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.176256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4042f23-47f7-4e0f-832a-0af79d3c93eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.177877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4042f23-47f7-4e0f-832a-0af79d3c93eb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.185400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7959bfcb-e4ec-45b1-b76b-fb70c391d79e None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:48.186616 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7959bfcb-e4ec-45b1-b76b-fb70c391d79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:48.189557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 781/1596] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:48.190453 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4042f23-47f7-4e0f-832a-0af79d3c93eb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.199890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 816/1597] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:48.201213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959bfcb-e4ec-45b1-b76b-fb70c391d79e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.202439 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4042f23-47f7-4e0f-832a-0af79d3c93eb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.208468 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196a392-2402-4a55-88f6-cd1c35cc3792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.209345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196a392-2402-4a55-88f6-cd1c35cc3792 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.209637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196a392-2402-4a55-88f6-cd1c35cc3792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.210179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196a392-2402-4a55-88f6-cd1c35cc3792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.211770 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196a392-2402-4a55-88f6-cd1c35cc3792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.213705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196a392-2402-4a55-88f6-cd1c35cc3792 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.215545 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959bfcb-e4ec-45b1-b76b-fb70c391d79e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.220434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89599e71-d47d-47ca-a1c2-50f0ff4f34ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.221202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89599e71-d47d-47ca-a1c2-50f0ff4f34ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.221519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89599e71-d47d-47ca-a1c2-50f0ff4f34ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.221798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89599e71-d47d-47ca-a1c2-50f0ff4f34ff admin admin] PATH_INFO: `/v3/projects/1f003162585640a5ba04e3e9c1b02d91/users/1694460e56cd4de3b1730bd6aa771fdc/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.225894 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 782/1598] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:48.226877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196a392-2402-4a55-88f6-cd1c35cc3792 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.237067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196a392-2402-4a55-88f6-cd1c35cc3792 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.237297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89599e71-d47d-47ca-a1c2-50f0ff4f34ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f003162585640a5ba04e3e9c1b02d91, user_id=1694460e56cd4de3b1730bd6aa771fdc, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.239948 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89599e71-d47d-47ca-a1c2-50f0ff4f34ff admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.241615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a75cb-6de4-46f4-8100-dcf444023503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.242201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a75cb-6de4-46f4-8100-dcf444023503 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.242476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a75cb-6de4-46f4-8100-dcf444023503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.242752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a75cb-6de4-46f4-8100-dcf444023503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.243427 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a75cb-6de4-46f4-8100-dcf444023503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.245027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a75cb-6de4-46f4-8100-dcf444023503 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.254008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 817/1599] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:32:48 2022] PUT /identity/v3/projects/1f003162585640a5ba04e3e9c1b02d91/users/1694460e56cd4de3b1730bd6aa771fdc/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:48.262590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89599e71-d47d-47ca-a1c2-50f0ff4f34ff admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.262727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 783/1600] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:48.262727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a75cb-6de4-46f4-8100-dcf444023503 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.267176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:48.273475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a75cb-6de4-46f4-8100-dcf444023503 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.323911 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89599e71-d47d-47ca-a1c2-50f0ff4f34ff admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.329246 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d3846-60cf-41ed-8d63-db9d5c00bc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.329922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d3846-60cf-41ed-8d63-db9d5c00bc1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.330267 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d3846-60cf-41ed-8d63-db9d5c00bc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.330380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abca1b6-8d55-4e85-b5b4-e4020b68fa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.330550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d3846-60cf-41ed-8d63-db9d5c00bc1d admin admin] PATH_INFO: `/v3/projects/f7085f6fa1ec425ba90573e70f0108c8/users/e354e99370d64ec3a7624eb3e550021d/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.330982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abca1b6-8d55-4e85-b5b4-e4020b68fa19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.331270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abca1b6-8d55-4e85-b5b4-e4020b68fa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.331551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abca1b6-8d55-4e85-b5b4-e4020b68fa19 admin admin] PATH_INFO: `/v3/projects/65bb2faca6e245e291774205a41a0cf8/users/3a7f87ccbd674c54807786d55eba2a9a/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.345503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d3846-60cf-41ed-8d63-db9d5c00bc1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7085f6fa1ec425ba90573e70f0108c8, user_id=e354e99370d64ec3a7624eb3e550021d, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.347177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abca1b6-8d55-4e85-b5b4-e4020b68fa19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65bb2faca6e245e291774205a41a0cf8, user_id=3a7f87ccbd674c54807786d55eba2a9a, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.348148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d3846-60cf-41ed-8d63-db9d5c00bc1d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.349856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abca1b6-8d55-4e85-b5b4-e4020b68fa19 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.361369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 818/1601] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:32:48 2022] PUT /identity/v3/projects/f7085f6fa1ec425ba90573e70f0108c8/users/e354e99370d64ec3a7624eb3e550021d/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:48.362137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d3846-60cf-41ed-8d63-db9d5c00bc1d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.368016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 784/1602] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:32:48 2022] PUT /identity/v3/projects/65bb2faca6e245e291774205a41a0cf8/users/3a7f87ccbd674c54807786d55eba2a9a/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:48.369442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc26cb-9668-42d5-b3ae-9b24ced6584d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.369805 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc26cb-9668-42d5-b3ae-9b24ced6584d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.370149 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc26cb-9668-42d5-b3ae-9b24ced6584d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.371710 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 785/1603] 10.222.0.15 () {54 vars in 962 bytes} [Sat Aug 6 01:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:32:48.372422 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc26cb-9668-42d5-b3ae-9b24ced6584d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.428243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc26cb-9668-42d5-b3ae-9b24ced6584d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.430899 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d3846-60cf-41ed-8d63-db9d5c00bc1d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.431860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97975614-6b9f-4ea8-8dbe-cb74d432c2e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.432473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97975614-6b9f-4ea8-8dbe-cb74d432c2e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.432745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97975614-6b9f-4ea8-8dbe-cb74d432c2e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.433046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97975614-6b9f-4ea8-8dbe-cb74d432c2e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.464010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:48.488575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440a7c6-7c13-4e00-9c85-ce6fcfa41db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.489275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440a7c6-7c13-4e00-9c85-ce6fcfa41db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.489571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440a7c6-7c13-4e00-9c85-ce6fcfa41db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.489846 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440a7c6-7c13-4e00-9c85-ce6fcfa41db0 admin admin] PATH_INFO: `/v3/projects/25b87d3d012d4f98a059751e7e1ca860/users/d53bdece587249f28f64a8b97d153a99/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.493858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97975614-6b9f-4ea8-8dbe-cb74d432c2e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.495293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97975614-6b9f-4ea8-8dbe-cb74d432c2e8 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.504997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 786/1604] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:48.505240 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440a7c6-7c13-4e00-9c85-ce6fcfa41db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b87d3d012d4f98a059751e7e1ca860, user_id=d53bdece587249f28f64a8b97d153a99, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.505776 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97975614-6b9f-4ea8-8dbe-cb74d432c2e8 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.507895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440a7c6-7c13-4e00-9c85-ce6fcfa41db0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.516123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97975614-6b9f-4ea8-8dbe-cb74d432c2e8 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.524176 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 819/1605] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:32:48 2022] PUT /identity/v3/projects/25b87d3d012d4f98a059751e7e1ca860/users/d53bdece587249f28f64a8b97d153a99/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:48.525038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440a7c6-7c13-4e00-9c85-ce6fcfa41db0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.553254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:48.579992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95a205-5ed2-4014-9a7f-824b2d3e8c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.580674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95a205-5ed2-4014-9a7f-824b2d3e8c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.580988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95a205-5ed2-4014-9a7f-824b2d3e8c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.581273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95a205-5ed2-4014-9a7f-824b2d3e8c16 admin admin] PATH_INFO: `/v3/projects/d193260942ee4b468e236804350116fc/users/02a1682847df4bd99bf09c8216a44850/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.597429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95a205-5ed2-4014-9a7f-824b2d3e8c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d193260942ee4b468e236804350116fc, user_id=02a1682847df4bd99bf09c8216a44850, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.600336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95a205-5ed2-4014-9a7f-824b2d3e8c16 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.603547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440a7c6-7c13-4e00-9c85-ce6fcfa41db0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.608869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26b7bc-12d2-4cbc-8f79-a247de7cb30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.609606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26b7bc-12d2-4cbc-8f79-a247de7cb30f admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.610023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26b7bc-12d2-4cbc-8f79-a247de7cb30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.610308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26b7bc-12d2-4cbc-8f79-a247de7cb30f admin admin] PATH_INFO: `/v3/projects/41e0d82a38794d39a612eac6afda5007/users/e9f545fde2d94e03b9b8336f53122177/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.614202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 787/1606] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:32:48 2022] PUT /identity/v3/projects/d193260942ee4b468e236804350116fc/users/02a1682847df4bd99bf09c8216a44850/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:48.615114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28879fe8-f6eb-48d0-b95e-1d17ae2bfa7e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.615457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28879fe8-f6eb-48d0-b95e-1d17ae2bfa7e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.615934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28879fe8-f6eb-48d0-b95e-1d17ae2bfa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.635496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26b7bc-12d2-4cbc-8f79-a247de7cb30f admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e0d82a38794d39a612eac6afda5007, user_id=e9f545fde2d94e03b9b8336f53122177, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.639123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26b7bc-12d2-4cbc-8f79-a247de7cb30f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.646448 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-28879fe8-f6eb-48d0-b95e-1d17ae2bfa7e None None] MFA Rules not processed for user `1694460e56cd4de3b1730bd6aa771fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:48.647727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-28879fe8-f6eb-48d0-b95e-1d17ae2bfa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:48.657476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 820/1607] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:32:48 2022] PUT /identity/v3/projects/41e0d82a38794d39a612eac6afda5007/users/e9f545fde2d94e03b9b8336f53122177/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:48.657476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64407246-e275-4238-9743-d3a8342ca47f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.657476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64407246-e275-4238-9743-d3a8342ca47f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.657476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64407246-e275-4238-9743-d3a8342ca47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.680222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-64407246-e275-4238-9743-d3a8342ca47f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:48.681525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-64407246-e275-4238-9743-d3a8342ca47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:48.724485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 788/1608] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:48.725937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9513a7-0927-42d7-a8ac-4226b6961f01 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.726234 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9513a7-0927-42d7-a8ac-4226b6961f01 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.726516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9513a7-0927-42d7-a8ac-4226b6961f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.747044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5f9513a7-0927-42d7-a8ac-4226b6961f01 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:48.748721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5f9513a7-0927-42d7-a8ac-4226b6961f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:48.756539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 821/1609] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:48.758024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3e6c-78c1-4fad-a7a8-2420a74f654a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.758391 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3e6c-78c1-4fad-a7a8-2420a74f654a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.758745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3e6c-78c1-4fad-a7a8-2420a74f654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.769562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 789/1610] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:48.770831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d255084-99ab-4849-956b-9e0b307dc252 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.771129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d255084-99ab-4849-956b-9e0b307dc252 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.771393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d255084-99ab-4849-956b-9e0b307dc252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.801760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-10da3e6c-78c1-4fad-a7a8-2420a74f654a None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:48.803621 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-10da3e6c-78c1-4fad-a7a8-2420a74f654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:48.804435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4d255084-99ab-4849-956b-9e0b307dc252 None None] MFA Rules not processed for user `d53bdece587249f28f64a8b97d153a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:48.805666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4d255084-99ab-4849-956b-9e0b307dc252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:48.833283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:48.886275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 790/1611] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:48.888244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bb15c-2c78-49e7-b356-f8302c843fa0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.888760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bb15c-2c78-49e7-b356-f8302c843fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.889335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bb15c-2c78-49e7-b356-f8302c843fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.896743 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 822/1612] 10.222.0.15 () {58 vars in 1059 bytes} [Sat Aug 6 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:48.899562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691f18-003d-4c4d-b2a2-6346c2916593 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.899942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691f18-003d-4c4d-b2a2-6346c2916593 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.900230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691f18-003d-4c4d-b2a2-6346c2916593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.922573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0a691f18-003d-4c4d-b2a2-6346c2916593 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:48.923810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0a691f18-003d-4c4d-b2a2-6346c2916593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:48.927396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-788bb15c-2c78-49e7-b356-f8302c843fa0 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:48.928982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-788bb15c-2c78-49e7-b356-f8302c843fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:48.935032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 823/1613] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:48.935032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a691f18-003d-4c4d-b2a2-6346c2916593 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.942604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 791/1614] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:48.943721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bb15c-2c78-49e7-b356-f8302c843fa0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:48.947950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-788bb15c-2c78-49e7-b356-f8302c843fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:48.949065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a691f18-003d-4c4d-b2a2-6346c2916593 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:48.956219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ad24b-d3c3-4d50-8e8a-ff88ef7e6973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:48.957321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ad24b-d3c3-4d50-8e8a-ff88ef7e6973 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:48.957610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ad24b-d3c3-4d50-8e8a-ff88ef7e6973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:48.957890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ad24b-d3c3-4d50-8e8a-ff88ef7e6973 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:48.958570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ad24b-d3c3-4d50-8e8a-ff88ef7e6973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:48.961167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ad24b-d3c3-4d50-8e8a-ff88ef7e6973 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:48.981556 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:49.001883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 824/1615] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:32:48 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:49.001883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ad24b-d3c3-4d50-8e8a-ff88ef7e6973 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.002506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-de1ad24b-d3c3-4d50-8e8a-ff88ef7e6973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:49.018088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bb15c-2c78-49e7-b356-f8302c843fa0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.071476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ad24b-d3c3-4d50-8e8a-ff88ef7e6973 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.075923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380bf32-bf7c-4463-8bbc-949ce1bcb5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.076577 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380bf32-bf7c-4463-8bbc-949ce1bcb5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.076952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380bf32-bf7c-4463-8bbc-949ce1bcb5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.077150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d306d3-4634-470e-8651-a269bc2c0c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.077281 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380bf32-bf7c-4463-8bbc-949ce1bcb5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.077809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d306d3-4634-470e-8651-a269bc2c0c86 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.078070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d306d3-4634-470e-8651-a269bc2c0c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.078479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d306d3-4634-470e-8651-a269bc2c0c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.146222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380bf32-bf7c-4463-8bbc-949ce1bcb5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.147800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380bf32-bf7c-4463-8bbc-949ce1bcb5d6 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.148131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d306d3-4634-470e-8651-a269bc2c0c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.149656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d306d3-4634-470e-8651-a269bc2c0c86 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.160059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 825/1616] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:49.160879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 792/1617] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:49.161047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380bf32-bf7c-4463-8bbc-949ce1bcb5d6 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.161749 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d306d3-4634-470e-8651-a269bc2c0c86 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.172675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380bf32-bf7c-4463-8bbc-949ce1bcb5d6 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.177952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64ac0b-0191-4e27-9456-42241fa02bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.178653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ac0b-0191-4e27-9456-42241fa02bcc admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.178991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ac0b-0191-4e27-9456-42241fa02bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.179269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64ac0b-0191-4e27-9456-42241fa02bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.180328 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64ac0b-0191-4e27-9456-42241fa02bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.182466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64ac0b-0191-4e27-9456-42241fa02bcc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.217439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 826/1618] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:32:49 2022] POST /identity/v3/projects => generated 355 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:49.218257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64ac0b-0191-4e27-9456-42241fa02bcc admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.243092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d306d3-4634-470e-8651-a269bc2c0c86 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.244563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:49.275328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:49.287334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64ac0b-0191-4e27-9456-42241fa02bcc admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.296245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb14fc-b438-4236-a099-40a9d7178f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.297481 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb14fc-b438-4236-a099-40a9d7178f6c service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.297761 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb14fc-b438-4236-a099-40a9d7178f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.298086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb14fc-b438-4236-a099-40a9d7178f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.321419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04e2f5-0c2d-4660-be89-207d0ca9ead9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.322140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04e2f5-0c2d-4660-be89-207d0ca9ead9 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.322489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04e2f5-0c2d-4660-be89-207d0ca9ead9 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.322838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04e2f5-0c2d-4660-be89-207d0ca9ead9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.393473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb14fc-b438-4236-a099-40a9d7178f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.395395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb14fc-b438-4236-a099-40a9d7178f6c service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.398959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04e2f5-0c2d-4660-be89-207d0ca9ead9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.400691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04e2f5-0c2d-4660-be89-207d0ca9ead9 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.407694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 827/1619] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:49.408590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb14fc-b438-4236-a099-40a9d7178f6c service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.411135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 793/1620] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:49.412010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04e2f5-0c2d-4660-be89-207d0ca9ead9 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.418968 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb14fc-b438-4236-a099-40a9d7178f6c service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.423365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04e2f5-0c2d-4660-be89-207d0ca9ead9 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.429641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e5115-7548-434c-9ce0-5b5fe780205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.429972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e5115-7548-434c-9ce0-5b5fe780205f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.430330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e5115-7548-434c-9ce0-5b5fe780205f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.430679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e5115-7548-434c-9ce0-5b5fe780205f admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.431484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e5115-7548-434c-9ce0-5b5fe780205f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.434419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e5115-7548-434c-9ce0-5b5fe780205f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.440946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b95cc-07cf-484c-a67c-4853b1740bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.443506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b95cc-07cf-484c-a67c-4853b1740bda service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.443800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b95cc-07cf-484c-a67c-4853b1740bda service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.445263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b95cc-07cf-484c-a67c-4853b1740bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.468239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 794/1621] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:32:49 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:49.468239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e5115-7548-434c-9ce0-5b5fe780205f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.470283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b95cc-07cf-484c-a67c-4853b1740bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.471817 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b95cc-07cf-484c-a67c-4853b1740bda service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.482348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e5115-7548-434c-9ce0-5b5fe780205f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.501128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 828/1622] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:49.502050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b95cc-07cf-484c-a67c-4853b1740bda service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.515765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccd5ed-2384-49e4-a7a7-0446077676b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.516383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccd5ed-2384-49e4-a7a7-0446077676b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.518514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccd5ed-2384-49e4-a7a7-0446077676b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.519943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccd5ed-2384-49e4-a7a7-0446077676b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.520853 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccd5ed-2384-49e4-a7a7-0446077676b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.526175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccd5ed-2384-49e4-a7a7-0446077676b4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.526369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b95cc-07cf-484c-a67c-4853b1740bda service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.541532 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba553af6-a008-40b2-a7ad-ae8b5be5f70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.542168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553af6-a008-40b2-a7ad-ae8b5be5f70c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.542455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553af6-a008-40b2-a7ad-ae8b5be5f70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.542834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba553af6-a008-40b2-a7ad-ae8b5be5f70c admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.544668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba553af6-a008-40b2-a7ad-ae8b5be5f70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.546680 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba553af6-a008-40b2-a7ad-ae8b5be5f70c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.577760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 829/1623] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:49.579831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba553af6-a008-40b2-a7ad-ae8b5be5f70c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.582200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 795/1624] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:32:49 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:32:49.585007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccd5ed-2384-49e4-a7a7-0446077676b4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.601310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba553af6-a008-40b2-a7ad-ae8b5be5f70c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.610865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccd5ed-2384-49e4-a7a7-0446077676b4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.613718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e8e8f-2afa-429a-b25d-be35001c7cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.615747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e8e8f-2afa-429a-b25d-be35001c7cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.617165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e8e8f-2afa-429a-b25d-be35001c7cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.617623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e8e8f-2afa-429a-b25d-be35001c7cdc admin admin] PATH_INFO: `/v3/projects/1ffa932859e54fc2bdba60fe5234ca6b/users/281c974d51074a7e81a9a2960481bbf5/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.624838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8132aa-d67c-4c8a-8382-28b74fd09874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.626274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8132aa-d67c-4c8a-8382-28b74fd09874 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.628194 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8132aa-d67c-4c8a-8382-28b74fd09874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.628470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8132aa-d67c-4c8a-8382-28b74fd09874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.631950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8132aa-d67c-4c8a-8382-28b74fd09874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.636170 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8132aa-d67c-4c8a-8382-28b74fd09874 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.656595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e8e8f-2afa-429a-b25d-be35001c7cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffa932859e54fc2bdba60fe5234ca6b, user_id=281c974d51074a7e81a9a2960481bbf5, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.660038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e8e8f-2afa-429a-b25d-be35001c7cdc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.666284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 796/1625] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:49.685100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8132aa-d67c-4c8a-8382-28b74fd09874 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.687681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 830/1626] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:32:49 2022] PUT /identity/v3/projects/1ffa932859e54fc2bdba60fe5234ca6b/users/281c974d51074a7e81a9a2960481bbf5/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:49.691424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e8e8f-2afa-429a-b25d-be35001c7cdc admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.708567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8132aa-d67c-4c8a-8382-28b74fd09874 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.841885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea153d63-1874-477c-a072-06059c60d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.843835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea153d63-1874-477c-a072-06059c60d400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.847114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea153d63-1874-477c-a072-06059c60d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.848035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea153d63-1874-477c-a072-06059c60d400 admin admin] PATH_INFO: `/v3/projects/1cd9835b891e4bcbbc304ed0a7eff70c/users/79c11b53fbb84781b9a0d1224925aabe/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.864379 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e8e8f-2afa-429a-b25d-be35001c7cdc admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.869759 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270873b-9d44-430d-8aa4-a331fbc8b894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:49.870458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270873b-9d44-430d-8aa4-a331fbc8b894 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.871717 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270873b-9d44-430d-8aa4-a331fbc8b894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.872602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270873b-9d44-430d-8aa4-a331fbc8b894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.873412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270873b-9d44-430d-8aa4-a331fbc8b894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.875197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270873b-9d44-430d-8aa4-a331fbc8b894 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.887039 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea153d63-1874-477c-a072-06059c60d400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd9835b891e4bcbbc304ed0a7eff70c, user_id=79c11b53fbb84781b9a0d1224925aabe, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:49.892889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea153d63-1874-477c-a072-06059c60d400 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:49.893077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 831/1627] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:49.893077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95d63f-ed62-4cb6-89e2-bf29c86ebc9b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.893077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95d63f-ed62-4cb6-89e2-bf29c86ebc9b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.893077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95d63f-ed62-4cb6-89e2-bf29c86ebc9b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.901519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 832/1628] 10.222.0.15 () {54 vars in 912 bytes} [Sat Aug 6 01:32:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:32:49.902730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95d63f-ed62-4cb6-89e2-bf29c86ebc9b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:49.918980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 797/1629] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:32:49 2022] PUT /identity/v3/projects/1cd9835b891e4bcbbc304ed0a7eff70c/users/79c11b53fbb84781b9a0d1224925aabe/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:49.922115 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f65fbb-fcc1-4abe-8642-cae0f9f4d3b3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:49.922453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95d63f-ed62-4cb6-89e2-bf29c86ebc9b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:49.923511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f65fbb-fcc1-4abe-8642-cae0f9f4d3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:49.923804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f65fbb-fcc1-4abe-8642-cae0f9f4d3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:49.940553 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:49.946270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:49.973485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e8f65fbb-fcc1-4abe-8642-cae0f9f4d3b3 None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:49.976951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e8f65fbb-fcc1-4abe-8642-cae0f9f4d3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:50.029754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7012a-6c67-41a8-bbce-6fda6e6ae3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:50.031077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7012a-6c67-41a8-bbce-6fda6e6ae3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:50.032499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7012a-6c67-41a8-bbce-6fda6e6ae3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:50.033077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7012a-6c67-41a8-bbce-6fda6e6ae3a5 admin admin] PATH_INFO: `/v3/projects/1ffa932859e54fc2bdba60fe5234ca6b/users/281c974d51074a7e81a9a2960481bbf5/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:50.036795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7012a-6c67-41a8-bbce-6fda6e6ae3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffa932859e54fc2bdba60fe5234ca6b, user_id=281c974d51074a7e81a9a2960481bbf5, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:50.041601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7012a-6c67-41a8-bbce-6fda6e6ae3a5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:50.062480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 833/1630] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:32:49 2022] PUT /identity/v3/projects/1ffa932859e54fc2bdba60fe5234ca6b/users/281c974d51074a7e81a9a2960481bbf5/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:50.064108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7012a-6c67-41a8-bbce-6fda6e6ae3a5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:50.185762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 798/1631] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:32:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:50.187290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b931c-3533-4f25-96c3-7104715307a5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:50.188072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b931c-3533-4f25-96c3-7104715307a5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:50.188481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b931c-3533-4f25-96c3-7104715307a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:50.201170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7012a-6c67-41a8-bbce-6fda6e6ae3a5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:50.215490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa28bc-8dd1-43f3-bc55-0b964569540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:50.219595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa28bc-8dd1-43f3-bc55-0b964569540a admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:50.219888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa28bc-8dd1-43f3-bc55-0b964569540a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:50.220154 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa28bc-8dd1-43f3-bc55-0b964569540a admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:50.220883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa28bc-8dd1-43f3-bc55-0b964569540a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:50.227178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa28bc-8dd1-43f3-bc55-0b964569540a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:50.263372 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-296b931c-3533-4f25-96c3-7104715307a5 None None] MFA Rules not processed for user `281c974d51074a7e81a9a2960481bbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:50.270093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 834/1632] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:32:50.271091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa28bc-8dd1-43f3-bc55-0b964569540a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:50.272412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-296b931c-3533-4f25-96c3-7104715307a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:50.398661 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa28bc-8dd1-43f3-bc55-0b964569540a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:50.414146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63077db5-a043-48e2-bf75-3a97295732a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:50.416775 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63077db5-a043-48e2-bf75-3a97295732a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:50.418568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63077db5-a043-48e2-bf75-3a97295732a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:50.419155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63077db5-a043-48e2-bf75-3a97295732a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:50.444254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 799/1633] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:50.445683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b931c-3533-4f25-96c3-7104715307a5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:50.482078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b931c-3533-4f25-96c3-7104715307a5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:50.492691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1511e-f715-45fb-bb47-6dcb7ee9d402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:50.495326 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1511e-f715-45fb-bb47-6dcb7ee9d402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:50.495619 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1511e-f715-45fb-bb47-6dcb7ee9d402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:50.496642 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1511e-f715-45fb-bb47-6dcb7ee9d402 admin admin] PATH_INFO: `/v3/projects/1cd9835b891e4bcbbc304ed0a7eff70c/users/79c11b53fbb84781b9a0d1224925aabe/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:50.502276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1511e-f715-45fb-bb47-6dcb7ee9d402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd9835b891e4bcbbc304ed0a7eff70c, user_id=79c11b53fbb84781b9a0d1224925aabe, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:50.511120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1511e-f715-45fb-bb47-6dcb7ee9d402 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:50.543302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 800/1634] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:32:50 2022] PUT /identity/v3/projects/1cd9835b891e4bcbbc304ed0a7eff70c/users/79c11b53fbb84781b9a0d1224925aabe/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:50.545128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1511e-f715-45fb-bb47-6dcb7ee9d402 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:50.571352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:50.605927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63077db5-a043-48e2-bf75-3a97295732a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:50.607570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63077db5-a043-48e2-bf75-3a97295732a9 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:50.659872 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 835/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:50.664335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cee3f-ddd6-4d07-8576-3133d23ff8fc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:50.664631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cee3f-ddd6-4d07-8576-3133d23ff8fc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:50.664941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cee3f-ddd6-4d07-8576-3133d23ff8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:50.717151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1511e-f715-45fb-bb47-6dcb7ee9d402 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:50.732477 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd039a8a-1c65-4859-937f-33d9040eaac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:50.733843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd039a8a-1c65-4859-937f-33d9040eaac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:50.736248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd039a8a-1c65-4859-937f-33d9040eaac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:50.736832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd039a8a-1c65-4859-937f-33d9040eaac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:50.802753 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-823cee3f-ddd6-4d07-8576-3133d23ff8fc None None] MFA Rules not processed for user `79c11b53fbb84781b9a0d1224925aabe`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:50.803988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-823cee3f-ddd6-4d07-8576-3133d23ff8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:50.838881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:50.976508 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd039a8a-1c65-4859-937f-33d9040eaac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:50.978334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd039a8a-1c65-4859-937f-33d9040eaac3 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:51.003286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 801/1636] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:51.026523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 836/1637] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:51.123142 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd039a8a-1c65-4859-937f-33d9040eaac3 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:51.134526 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd039a8a-1c65-4859-937f-33d9040eaac3 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:51.144138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dfa91-0671-43d6-a20e-ec89679feb38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:51.145635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dfa91-0671-43d6-a20e-ec89679feb38 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:51.145977 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dfa91-0671-43d6-a20e-ec89679feb38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:51.146202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dfa91-0671-43d6-a20e-ec89679feb38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:51.176618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dfa91-0671-43d6-a20e-ec89679feb38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:51.181052 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dfa91-0671-43d6-a20e-ec89679feb38 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:51.204487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 802/1638] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:51.471967 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cee3f-ddd6-4d07-8576-3133d23ff8fc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:51.490008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cee3f-ddd6-4d07-8576-3133d23ff8fc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:51.495380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd12474-ea7c-400a-96ee-e26a36f298e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:51.496721 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd12474-ea7c-400a-96ee-e26a36f298e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:51.496955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd12474-ea7c-400a-96ee-e26a36f298e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:51.499041 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd12474-ea7c-400a-96ee-e26a36f298e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:51.581629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd12474-ea7c-400a-96ee-e26a36f298e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:51.583177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd12474-ea7c-400a-96ee-e26a36f298e2 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:51.593716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 837/1639] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:51.808947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dfa91-0671-43d6-a20e-ec89679feb38 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:51.825353 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dfa91-0671-43d6-a20e-ec89679feb38 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:51.830106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0456081-69e5-485a-a81d-8753be14a9e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:51.831042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0456081-69e5-485a-a81d-8753be14a9e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:51.831550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0456081-69e5-485a-a81d-8753be14a9e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:51.832504 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0456081-69e5-485a-a81d-8753be14a9e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:51.922187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0456081-69e5-485a-a81d-8753be14a9e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:51.924076 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0456081-69e5-485a-a81d-8753be14a9e7 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:51.947286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 803/1640] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:52.724309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc99c75-a1d4-4c25-a38d-d2288f1282cd None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:52.724879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc99c75-a1d4-4c25-a38d-d2288f1282cd None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:52.725672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc99c75-a1d4-4c25-a38d-d2288f1282cd None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:52.727667 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 838/1641] 10.222.0.15 () {54 vars in 962 bytes} [Sat Aug 6 01:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:32:52.741485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c47d0-faee-484b-8954-4378f016907f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:52.744805 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c47d0-faee-484b-8954-4378f016907f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:52.745389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c47d0-faee-484b-8954-4378f016907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:52.787516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-282c47d0-faee-484b-8954-4378f016907f None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:52.789092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-282c47d0-faee-484b-8954-4378f016907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:52.939236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 804/1642] 10.222.0.15 () {58 vars in 1059 bytes} [Sat Aug 6 01:32:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:52.947028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88955d08-60b5-4cae-a6df-c806b918313d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:52.947799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88955d08-60b5-4cae-a6df-c806b918313d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:52.947799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88955d08-60b5-4cae-a6df-c806b918313d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:52.949945 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 839/1643] 10.222.0.15 () {54 vars in 912 bytes} [Sat Aug 6 01:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:32:52.957031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccaa53-fa02-40b5-be99-f9cddcb8962f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:52.957264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccaa53-fa02-40b5-be99-f9cddcb8962f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:52.957455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccaa53-fa02-40b5-be99-f9cddcb8962f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:52.997320 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-31ccaa53-fa02-40b5-be99-f9cddcb8962f None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:52.999221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-31ccaa53-fa02-40b5-be99-f9cddcb8962f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:53.012342 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 805/1644] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:32:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:32:53.024658 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88955d08-60b5-4cae-a6df-c806b918313d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:53.036261 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88955d08-60b5-4cae-a6df-c806b918313d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:53.040373 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f6c5f-96b2-4878-b725-9e7bd5241255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:53.041097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f6c5f-96b2-4878-b725-9e7bd5241255 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:53.041957 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f6c5f-96b2-4878-b725-9e7bd5241255 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:53.041957 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f6c5f-96b2-4878-b725-9e7bd5241255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:53.055451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f6c5f-96b2-4878-b725-9e7bd5241255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:53.057255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f6c5f-96b2-4878-b725-9e7bd5241255 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:53.080726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 840/1645] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:55.984096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccaa53-fa02-40b5-be99-f9cddcb8962f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:56.023828 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:56.108675 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccaa53-fa02-40b5-be99-f9cddcb8962f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:56.117896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:56.119517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:56.120145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:56.121484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] PATH_INFO: `/v3/users/b16a5b3496a64add815e9ffc0b7275f8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:56.124225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16a5b3496a64add815e9ffc0b7275f8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:56.127690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:56.206242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16a5b3496a64add815e9ffc0b7275f8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:32:56.217719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16a5b3496a64add815e9ffc0b7275f8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:32:56.237946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16a5b3496a64add815e9ffc0b7275f8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:32:56.240466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16a5b3496a64add815e9ffc0b7275f8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:32:56.241341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16a5b3496a64add815e9ffc0b7275f8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:32:56.270309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 806/1646] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:32:55 2022] DELETE /identity/v3/users/b16a5b3496a64add815e9ffc0b7275f8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:32:56.275167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf8242-2dbb-49df-91f6-b259384dfbe7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:56.276109 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf8242-2dbb-49df-91f6-b259384dfbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:56.277890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf8242-2dbb-49df-91f6-b259384dfbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:56.318440 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ebaf8242-2dbb-49df-91f6-b259384dfbe7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:32:56.319950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ebaf8242-2dbb-49df-91f6-b259384dfbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:56.419163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:32:56.434986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 841/1647] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:32:56.453450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:56.455567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:56.588770 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d38a1-452a-46b8-b321-ae48bf57b594 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:32:56.594109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eeaa73-7b21-4c1c-ba34-6496c4deaba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:32:56.595490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeaa73-7b21-4c1c-ba34-6496c4deaba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:32:56.595780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeaa73-7b21-4c1c-ba34-6496c4deaba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:32:56.596056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeaa73-7b21-4c1c-ba34-6496c4deaba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:32:56.617120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eeaa73-7b21-4c1c-ba34-6496c4deaba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:32:56.619639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eeaa73-7b21-4c1c-ba34-6496c4deaba7 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:32:56.650030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 807/1648] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:32:59.945746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf8242-2dbb-49df-91f6-b259384dfbe7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:32:59.947917 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ebaf8242-2dbb-49df-91f6-b259384dfbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:32:59.988476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf8242-2dbb-49df-91f6-b259384dfbe7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:00.003734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead39ad-1f22-45d8-abc7-84e382407196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:00.006261 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead39ad-1f22-45d8-abc7-84e382407196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:00.010218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead39ad-1f22-45d8-abc7-84e382407196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:00.010971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead39ad-1f22-45d8-abc7-84e382407196 admin admin] PATH_INFO: `/v3/projects/4c4aa6e5eb284cab91e8f62326e2d098` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:00.027277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead39ad-1f22-45d8-abc7-84e382407196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4aa6e5eb284cab91e8f62326e2d098)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:00.038225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead39ad-1f22-45d8-abc7-84e382407196 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:00.257238 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-eead39ad-1f22-45d8-abc7-84e382407196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4aa6e5eb284cab91e8f62326e2d098', 'request_id': 'req-eead39ad-1f22-45d8-abc7-84e382407196'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:00.271477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-eead39ad-1f22-45d8-abc7-84e382407196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4aa6e5eb284cab91e8f62326e2d098', 'request_id': 'req-eead39ad-1f22-45d8-abc7-84e382407196'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:00.291504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-eead39ad-1f22-45d8-abc7-84e382407196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4aa6e5eb284cab91e8f62326e2d098', 'request_id': 'req-eead39ad-1f22-45d8-abc7-84e382407196'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:00.315378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-eead39ad-1f22-45d8-abc7-84e382407196 admin admin] The token cache is being invalidate because project 4c4aa6e5eb284cab91e8f62326e2d098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:00.316013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-eead39ad-1f22-45d8-abc7-84e382407196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:00.316923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-eead39ad-1f22-45d8-abc7-84e382407196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:00.318733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 842/1649] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:32:59 2022] DELETE /identity/v3/projects/4c4aa6e5eb284cab91e8f62326e2d098 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:00.324300 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5745-ca3f-46d8-a1ca-2e468821f5c9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:00.325351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5745-ca3f-46d8-a1ca-2e468821f5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:00.325854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5745-ca3f-46d8-a1ca-2e468821f5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:00.372511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1b5b5745-ca3f-46d8-a1ca-2e468821f5c9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:00.374246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1b5b5745-ca3f-46d8-a1ca-2e468821f5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:00.555541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:00.596194 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 808/1650] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:00.603529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301ce44-d162-423c-bc36-6b6bee42df2e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:00.603895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301ce44-d162-423c-bc36-6b6bee42df2e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:00.604249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301ce44-d162-423c-bc36-6b6bee42df2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:00.649032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f301ce44-d162-423c-bc36-6b6bee42df2e None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:00.660952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f301ce44-d162-423c-bc36-6b6bee42df2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:00.682227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 843/1651] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:00.686600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5745-ca3f-46d8-a1ca-2e468821f5c9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:00.705336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5745-ca3f-46d8-a1ca-2e468821f5c9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:00.716949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c08df-7e0e-479c-95b7-51fb5ff8dab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:00.717780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c08df-7e0e-479c-95b7-51fb5ff8dab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:00.718632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c08df-7e0e-479c-95b7-51fb5ff8dab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:00.719092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c08df-7e0e-479c-95b7-51fb5ff8dab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:00.719976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c08df-7e0e-479c-95b7-51fb5ff8dab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:33:00.720428 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c08df-7e0e-479c-95b7-51fb5ff8dab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:00.731531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c08df-7e0e-479c-95b7-51fb5ff8dab1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:00.769968 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 809/1652] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:33:00.774073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301ce44-d162-423c-bc36-6b6bee42df2e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:00.792054 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301ce44-d162-423c-bc36-6b6bee42df2e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:00.806886 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b3104-6892-4f0e-9d52-a109ad9b1076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:00.810276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b3104-6892-4f0e-9d52-a109ad9b1076 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:00.810677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b3104-6892-4f0e-9d52-a109ad9b1076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:00.811022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b3104-6892-4f0e-9d52-a109ad9b1076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:00.817227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b3104-6892-4f0e-9d52-a109ad9b1076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:00.820125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b3104-6892-4f0e-9d52-a109ad9b1076 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:00.908949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 844/1653] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:00 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:00.914065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c08df-7e0e-479c-95b7-51fb5ff8dab1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:00.934685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c08df-7e0e-479c-95b7-51fb5ff8dab1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:01.088485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5b5c5-1f1a-404f-9431-74aa7112e28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:01.090604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5b5c5-1f1a-404f-9431-74aa7112e28c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:01.091173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5b5c5-1f1a-404f-9431-74aa7112e28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:01.092045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5b5c5-1f1a-404f-9431-74aa7112e28c admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:01.094931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5b5c5-1f1a-404f-9431-74aa7112e28c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:01.099319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5b5c5-1f1a-404f-9431-74aa7112e28c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:01.157541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 810/1654] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:00 2022] POST /identity/v3/users => generated 302 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:01.161118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b3104-6892-4f0e-9d52-a109ad9b1076 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:01.177057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b3104-6892-4f0e-9d52-a109ad9b1076 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:01.185872 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd848fae-77ed-4ead-a6e7-e97bc5513a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:01.191764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd848fae-77ed-4ead-a6e7-e97bc5513a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:01.191764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd848fae-77ed-4ead-a6e7-e97bc5513a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:01.191764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd848fae-77ed-4ead-a6e7-e97bc5513a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:01.191764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd848fae-77ed-4ead-a6e7-e97bc5513a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:01.191764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd848fae-77ed-4ead-a6e7-e97bc5513a32 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:01.205939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 845/1655] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:01.210674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5b5c5-1f1a-404f-9431-74aa7112e28c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:01.223069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5b5c5-1f1a-404f-9431-74aa7112e28c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:01.238188 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b62f51-8aaa-4643-86ae-d2254f7a9fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:01.239993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b62f51-8aaa-4643-86ae-d2254f7a9fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:01.240469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b62f51-8aaa-4643-86ae-d2254f7a9fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:01.241953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b62f51-8aaa-4643-86ae-d2254f7a9fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:01.242699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b62f51-8aaa-4643-86ae-d2254f7a9fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:01.248711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b62f51-8aaa-4643-86ae-d2254f7a9fbf admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:01.284443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 811/1656] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:01.288548 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd848fae-77ed-4ead-a6e7-e97bc5513a32 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:01.310192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd848fae-77ed-4ead-a6e7-e97bc5513a32 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:01.322257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f3e2c-9d94-4b7b-971d-ecba5d2d398c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:01.323209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3e2c-9d94-4b7b-971d-ecba5d2d398c admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:01.324380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3e2c-9d94-4b7b-971d-ecba5d2d398c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:01.326429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3e2c-9d94-4b7b-971d-ecba5d2d398c admin admin] PATH_INFO: `/v3/projects/a8a3d4fe8d65454bacdd0f936d795268/users/2c569ce531864b68b06a0dd3dd6e7cdb/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:01.387607 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f3e2c-9d94-4b7b-971d-ecba5d2d398c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a3d4fe8d65454bacdd0f936d795268, user_id=2c569ce531864b68b06a0dd3dd6e7cdb, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:01.394276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f3e2c-9d94-4b7b-971d-ecba5d2d398c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:01.454221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 846/1657] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:01 2022] PUT /identity/v3/projects/a8a3d4fe8d65454bacdd0f936d795268/users/2c569ce531864b68b06a0dd3dd6e7cdb/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:01.460309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d009-1bc9-4bf4-9382-306f47c203f2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:01.461230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d009-1bc9-4bf4-9382-306f47c203f2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:01.461763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d009-1bc9-4bf4-9382-306f47c203f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:01.498265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e8b53-1dae-4886-b25c-96395dff9151 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:01.498644 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e8b53-1dae-4886-b25c-96395dff9151 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:01.498994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e8b53-1dae-4886-b25c-96395dff9151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:01.549896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-79b2d009-1bc9-4bf4-9382-306f47c203f2 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:01.556162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-79b2d009-1bc9-4bf4-9382-306f47c203f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:01.596992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ef1e8b53-1dae-4886-b25c-96395dff9151 None None] MFA Rules not processed for user `1bac0cc0dd9149e4a25c2e1b5a54f1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:01.601475 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ef1e8b53-1dae-4886-b25c-96395dff9151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:01.731849 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 812/1658] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:01.768642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 847/1659] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:01.783996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550df84e-e29e-45d9-8695-9002a4c91b08 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:01.784372 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550df84e-e29e-45d9-8695-9002a4c91b08 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:01.784715 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550df84e-e29e-45d9-8695-9002a4c91b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:01.834951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-550df84e-e29e-45d9-8695-9002a4c91b08 None None] MFA Rules not processed for user `1bac0cc0dd9149e4a25c2e1b5a54f1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:01.835413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e8b53-1dae-4886-b25c-96395dff9151 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:01.837006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ef1e8b53-1dae-4886-b25c-96395dff9151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:01.840353 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-550df84e-e29e-45d9-8695-9002a4c91b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:01.853974 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:01.864379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 813/1660] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:01.879579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550df84e-e29e-45d9-8695-9002a4c91b08 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:01.881628 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-550df84e-e29e-45d9-8695-9002a4c91b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:01.960538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e8b53-1dae-4886-b25c-96395dff9151 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:01.967547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4fc27-ecc5-41af-a6a8-289627b32c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:01.968197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4fc27-ecc5-41af-a6a8-289627b32c95 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:01.968483 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4fc27-ecc5-41af-a6a8-289627b32c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:01.968814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4fc27-ecc5-41af-a6a8-289627b32c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:01.990873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4fc27-ecc5-41af-a6a8-289627b32c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:01.992335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4fc27-ecc5-41af-a6a8-289627b32c95 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:02.019195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 848/1661] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:33:02.031088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:02.120766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550df84e-e29e-45d9-8695-9002a4c91b08 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:02.141157 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93323-c0fd-4af2-80ab-878ff04fc87a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:02.141956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93323-c0fd-4af2-80ab-878ff04fc87a service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:02.142338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93323-c0fd-4af2-80ab-878ff04fc87a service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:02.142732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93323-c0fd-4af2-80ab-878ff04fc87a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:02.173139 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb93323-c0fd-4af2-80ab-878ff04fc87a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:02.175015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb93323-c0fd-4af2-80ab-878ff04fc87a service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:02.207178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 814/1662] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:04.020697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abc23e-f381-484e-a749-691306ee935b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:04.021714 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abc23e-f381-484e-a749-691306ee935b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:04.022799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abc23e-f381-484e-a749-691306ee935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:04.137605 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f8abc23e-f381-484e-a749-691306ee935b None None] MFA Rules not processed for user `02a1682847df4bd99bf09c8216a44850`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:04.144410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f8abc23e-f381-484e-a749-691306ee935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:04.387463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 849/1663] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:04.401120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee464-442e-4cee-ad32-df1cd329ad2d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:04.401727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee464-442e-4cee-ad32-df1cd329ad2d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:04.403910 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee464-442e-4cee-ad32-df1cd329ad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:04.454677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fc4ee464-442e-4cee-ad32-df1cd329ad2d None None] MFA Rules not processed for user `02a1682847df4bd99bf09c8216a44850`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:04.455927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fc4ee464-442e-4cee-ad32-df1cd329ad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:04.488518 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 815/1664] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:04.500029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abc23e-f381-484e-a749-691306ee935b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:04.501670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f8abc23e-f381-484e-a749-691306ee935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:04.543331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abc23e-f381-484e-a749-691306ee935b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:04.563488 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0be29-e555-4faf-aaa6-94b58d33e00a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:04.564143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0be29-e555-4faf-aaa6-94b58d33e00a service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:04.564429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0be29-e555-4faf-aaa6-94b58d33e00a service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:04.564710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0be29-e555-4faf-aaa6-94b58d33e00a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:04.591599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0be29-e555-4faf-aaa6-94b58d33e00a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:04.593274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0be29-e555-4faf-aaa6-94b58d33e00a service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:04.625280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 850/1665] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:05.209006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ca637-9161-480f-a560-44abbd1f1d55 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:05.209302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ca637-9161-480f-a560-44abbd1f1d55 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:05.209572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ca637-9161-480f-a560-44abbd1f1d55 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:05.212446 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 816/1666] 10.222.0.15 () {54 vars in 912 bytes} [Sat Aug 6 01:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:33:05.217644 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6565f5e-49d0-4b3e-a167-527e491c13ce None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:05.218545 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6565f5e-49d0-4b3e-a167-527e491c13ce None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:05.219181 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6565f5e-49d0-4b3e-a167-527e491c13ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:05.300402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b6565f5e-49d0-4b3e-a167-527e491c13ce None None] MFA Rules not processed for user `403beb9eb6c04cc69579361138bea12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:05.301904 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b6565f5e-49d0-4b3e-a167-527e491c13ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:05.314687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 851/1667] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:05.384471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ca637-9161-480f-a560-44abbd1f1d55 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:05.405079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ca637-9161-480f-a560-44abbd1f1d55 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:05.411538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809478e-b65b-4e8c-b0b3-3e4343889359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:05.412288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809478e-b65b-4e8c-b0b3-3e4343889359 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:05.412677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809478e-b65b-4e8c-b0b3-3e4343889359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:05.413084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809478e-b65b-4e8c-b0b3-3e4343889359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:05.435798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809478e-b65b-4e8c-b0b3-3e4343889359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:05.437292 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809478e-b65b-4e8c-b0b3-3e4343889359 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:05.458163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 817/1668] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:05.727625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f117-6060-4d7d-840f-1b490294f007 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:05.728160 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f117-6060-4d7d-840f-1b490294f007 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:05.728597 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2f117-6060-4d7d-840f-1b490294f007 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:05.730710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 852/1669] 10.222.0.15 () {54 vars in 912 bytes} [Sat Aug 6 01:33:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:33:05.737111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b5e8e-632f-4ccb-a6f8-47c5d80c4359 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:05.737666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b5e8e-632f-4ccb-a6f8-47c5d80c4359 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:05.738095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b5e8e-632f-4ccb-a6f8-47c5d80c4359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:05.768178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1b3b5e8e-632f-4ccb-a6f8-47c5d80c4359 None None] MFA Rules not processed for user `403beb9eb6c04cc69579361138bea12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:05.770509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1b3b5e8e-632f-4ccb-a6f8-47c5d80c4359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:05.775121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cf4bc-6e9b-405b-8081-57b1ecc510ba None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:05.775406 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cf4bc-6e9b-405b-8081-57b1ecc510ba None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:05.777303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cf4bc-6e9b-405b-8081-57b1ecc510ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:05.788448 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 818/1670] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:05.807683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b5e8e-632f-4ccb-a6f8-47c5d80c4359 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:05.809618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1b3b5e8e-632f-4ccb-a6f8-47c5d80c4359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:05.824930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-dd5cf4bc-6e9b-405b-8081-57b1ecc510ba None None] MFA Rules not processed for user `3a7f87ccbd674c54807786d55eba2a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:05.826884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b5e8e-632f-4ccb-a6f8-47c5d80c4359 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:05.829838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-dd5cf4bc-6e9b-405b-8081-57b1ecc510ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:05.836675 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a71db-80bd-4a25-ab12-0e06eded6ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:05.837693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a71db-80bd-4a25-ab12-0e06eded6ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:05.838192 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a71db-80bd-4a25-ab12-0e06eded6ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:05.838781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a71db-80bd-4a25-ab12-0e06eded6ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:05.854144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a71db-80bd-4a25-ab12-0e06eded6ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:05.857189 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a71db-80bd-4a25-ab12-0e06eded6ca9 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:05.878112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 819/1671] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:05.977893 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:06.006512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 853/1672] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:06.515398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b1af5-7373-4040-8469-dfe824087d75 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:06.516193 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b1af5-7373-4040-8469-dfe824087d75 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:06.516624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b1af5-7373-4040-8469-dfe824087d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:06.575730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-211b1af5-7373-4040-8469-dfe824087d75 None None] MFA Rules not processed for user `2c569ce531864b68b06a0dd3dd6e7cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:06.599340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-211b1af5-7373-4040-8469-dfe824087d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:06.825195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cf4bc-6e9b-405b-8081-57b1ecc510ba None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:06.826512 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 820/1673] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:06.840258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cf4bc-6e9b-405b-8081-57b1ecc510ba None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:06.866201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cb0ba-6e21-4815-8d7c-8e89c437995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:06.874180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cb0ba-6e21-4815-8d7c-8e89c437995f admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:06.874697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cb0ba-6e21-4815-8d7c-8e89c437995f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:06.875122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cb0ba-6e21-4815-8d7c-8e89c437995f admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:06.877242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550cb0ba-6e21-4815-8d7c-8e89c437995f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:06.881301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550cb0ba-6e21-4815-8d7c-8e89c437995f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:06.948726 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b1af5-7373-4040-8469-dfe824087d75 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:06.986390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b1af5-7373-4040-8469-dfe824087d75 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:07.015783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab947216-0b5c-4378-8233-4b6c5f36f304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:07.018255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab947216-0b5c-4378-8233-4b6c5f36f304 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:07.018863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab947216-0b5c-4378-8233-4b6c5f36f304 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:07.019333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab947216-0b5c-4378-8233-4b6c5f36f304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:07.033778 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 854/1674] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:06 2022] POST /identity/v3/projects => generated 405 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:07.036837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cb0ba-6e21-4815-8d7c-8e89c437995f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:07.060607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab947216-0b5c-4378-8233-4b6c5f36f304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:07.062291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab947216-0b5c-4378-8233-4b6c5f36f304 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:07.123758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 821/1675] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:33:07.196483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468af616-449f-4661-9e08-d583fc879751 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:07.196699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468af616-449f-4661-9e08-d583fc879751 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:07.197670 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468af616-449f-4661-9e08-d583fc879751 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:07.200243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 822/1676] 10.222.0.15 () {54 vars in 961 bytes} [Sat Aug 6 01:33:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:33:07.205671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed46ecf-3b20-4934-bede-d86c89021a13 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:07.205955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed46ecf-3b20-4934-bede-d86c89021a13 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:07.206521 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed46ecf-3b20-4934-bede-d86c89021a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:07.343663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1ed46ecf-3b20-4934-bede-d86c89021a13 None None] MFA Rules not processed for user `fc1bd453c1114da4a5d9aa543bf1ff32`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:07.344951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1ed46ecf-3b20-4934-bede-d86c89021a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:07.407308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cb0ba-6e21-4815-8d7c-8e89c437995f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:07.432962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bab9d-4b54-4c47-9d65-a6c90e6534db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:07.432962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bab9d-4b54-4c47-9d65-a6c90e6534db admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:07.432962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bab9d-4b54-4c47-9d65-a6c90e6534db admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:07.432962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bab9d-4b54-4c47-9d65-a6c90e6534db admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:07.433623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bab9d-4b54-4c47-9d65-a6c90e6534db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:07.439606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bab9d-4b54-4c47-9d65-a6c90e6534db admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:07.540997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 855/1677] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:07 2022] POST /identity/v3/users => generated 309 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:07.543313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bab9d-4b54-4c47-9d65-a6c90e6534db admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:07.550640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3d6bab9d-4b54-4c47-9d65-a6c90e6534db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:07.633344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 823/1678] 10.222.0.15 () {58 vars in 1058 bytes} [Sat Aug 6 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:07.635321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb812c-07c7-42d1-b94a-76b73e1dd8a4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:07.636550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb812c-07c7-42d1-b94a-76b73e1dd8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:07.638233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb812c-07c7-42d1-b94a-76b73e1dd8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:07.679326 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:07.713402 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-febb812c-07c7-42d1-b94a-76b73e1dd8a4 None None] MFA Rules not processed for user `02a1682847df4bd99bf09c8216a44850`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:07.714949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-febb812c-07c7-42d1-b94a-76b73e1dd8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:07.991318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bab9d-4b54-4c47-9d65-a6c90e6534db admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:08.047605 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9608c-3622-4c56-9b36-6a26638287fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:08.058500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9608c-3622-4c56-9b36-6a26638287fa service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:08.059356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9608c-3622-4c56-9b36-6a26638287fa service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:08.060040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9608c-3622-4c56-9b36-6a26638287fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:08.077425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d3e9608c-3622-4c56-9b36-6a26638287fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:08.129410 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 824/1679] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:08.137315 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9608c-3622-4c56-9b36-6a26638287fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:08.148897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9608c-3622-4c56-9b36-6a26638287fa service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:08.155970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb812c-07c7-42d1-b94a-76b73e1dd8a4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:08.249277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 856/1680] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:08.252042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9608c-3622-4c56-9b36-6a26638287fa service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:08.289144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9608c-3622-4c56-9b36-6a26638287fa service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:08.302324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eade9-bac7-4f17-b355-72072f6099a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:08.304977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eade9-bac7-4f17-b355-72072f6099a6 service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:08.305436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eade9-bac7-4f17-b355-72072f6099a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:08.306091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eade9-bac7-4f17-b355-72072f6099a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:08.307196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb812c-07c7-42d1-b94a-76b73e1dd8a4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:08.332564 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485eade9-bac7-4f17-b355-72072f6099a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:08.334567 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485eade9-bac7-4f17-b355-72072f6099a6 service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:08.354227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b80fb3-092b-447b-9d77-b76de8b0b274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:08.356817 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b80fb3-092b-447b-9d77-b76de8b0b274 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:08.365515 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 857/1681] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:08.374591 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b80fb3-092b-447b-9d77-b76de8b0b274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:08.375057 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b80fb3-092b-447b-9d77-b76de8b0b274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:08.376417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b80fb3-092b-447b-9d77-b76de8b0b274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:08.384789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b80fb3-092b-447b-9d77-b76de8b0b274 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:08.433456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 825/1682] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:08.437408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eade9-bac7-4f17-b355-72072f6099a6 service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:08.455924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eade9-bac7-4f17-b355-72072f6099a6 service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:08.485726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b1588-f3b3-4f7e-b4a4-237f19cf998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:08.486777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b1588-f3b3-4f7e-b4a4-237f19cf998d admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:08.487063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b1588-f3b3-4f7e-b4a4-237f19cf998d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:08.487340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b1588-f3b3-4f7e-b4a4-237f19cf998d admin admin] PATH_INFO: `/v3/projects/c0c82141c0a94171988a75da11c76f3c/users/c8643965094b4fefa34456e222139f51/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:08.581194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b1588-f3b3-4f7e-b4a4-237f19cf998d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c82141c0a94171988a75da11c76f3c, user_id=c8643965094b4fefa34456e222139f51, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:08.591052 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b1588-f3b3-4f7e-b4a4-237f19cf998d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:08.619482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 858/1683] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:08 2022] PUT /identity/v3/projects/c0c82141c0a94171988a75da11c76f3c/users/c8643965094b4fefa34456e222139f51/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:08.624188 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b80fb3-092b-447b-9d77-b76de8b0b274 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:08.638173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b80fb3-092b-447b-9d77-b76de8b0b274 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:08.758590 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd95cdf-2dbe-47b4-a47c-741fddb19798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:08.759730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd95cdf-2dbe-47b4-a47c-741fddb19798 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:08.760198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd95cdf-2dbe-47b4-a47c-741fddb19798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:08.762036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd95cdf-2dbe-47b4-a47c-741fddb19798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:08.763734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd95cdf-2dbe-47b4-a47c-741fddb19798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:08.766063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd95cdf-2dbe-47b4-a47c-741fddb19798 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:08.784880 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b1588-f3b3-4f7e-b4a4-237f19cf998d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:08.785078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 826/1684] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:33:08.801313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b1588-f3b3-4f7e-b4a4-237f19cf998d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:08.828696 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1e93-6a71-4250-884f-01623d47fb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:08.830550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1e93-6a71-4250-884f-01623d47fb6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:08.830550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1e93-6a71-4250-884f-01623d47fb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:08.830550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1e93-6a71-4250-884f-01623d47fb6e admin admin] PATH_INFO: `/v3/projects/c0c82141c0a94171988a75da11c76f3c/users/c8643965094b4fefa34456e222139f51/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:08.836964 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b1e93-6a71-4250-884f-01623d47fb6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c82141c0a94171988a75da11c76f3c, user_id=c8643965094b4fefa34456e222139f51, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:08.850131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b1e93-6a71-4250-884f-01623d47fb6e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:08.887458 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 859/1685] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:08 2022] PUT /identity/v3/projects/c0c82141c0a94171988a75da11c76f3c/users/c8643965094b4fefa34456e222139f51/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:11.149714 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a8215-1bc8-4558-a02d-ae71980c7202 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:11.153362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a8215-1bc8-4558-a02d-ae71980c7202 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:11.154059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a8215-1bc8-4558-a02d-ae71980c7202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:11.328278 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4e6a8215-1bc8-4558-a02d-ae71980c7202 None None] MFA Rules not processed for user `e9f545fde2d94e03b9b8336f53122177`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:11.332118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4e6a8215-1bc8-4558-a02d-ae71980c7202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:11.591380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 827/1686] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:11.606535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1e93-6a71-4250-884f-01623d47fb6e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:11.614374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:11.769692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1e93-6a71-4250-884f-01623d47fb6e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:11.829561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd50732-f80c-43cb-91e1-228ab2aaf850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:11.830528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd50732-f80c-43cb-91e1-228ab2aaf850 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:11.831250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd50732-f80c-43cb-91e1-228ab2aaf850 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:11.831675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd50732-f80c-43cb-91e1-228ab2aaf850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:11.844068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b3a3a-5565-406e-a8d8-f728183f9966 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:11.844417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b3a3a-5565-406e-a8d8-f728183f9966 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:11.844640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b3a3a-5565-406e-a8d8-f728183f9966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:11.851537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd50732-f80c-43cb-91e1-228ab2aaf850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:11.854828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd50732-f80c-43cb-91e1-228ab2aaf850 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:11.889534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 860/1687] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:11.930199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-501b3a3a-5565-406e-a8d8-f728183f9966 None None] MFA Rules not processed for user `e354e99370d64ec3a7624eb3e550021d`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:11.934381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-501b3a3a-5565-406e-a8d8-f728183f9966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:11.997598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:12.230882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 828/1688] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:12.246169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd50732-f80c-43cb-91e1-228ab2aaf850 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:12.285563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd50732-f80c-43cb-91e1-228ab2aaf850 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:12.306689 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0880b9-437d-4f58-8447-1e35f5cb097d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:12.308128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0880b9-437d-4f58-8447-1e35f5cb097d service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:12.308566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0880b9-437d-4f58-8447-1e35f5cb097d service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:12.308963 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0880b9-437d-4f58-8447-1e35f5cb097d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:12.320452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0880b9-437d-4f58-8447-1e35f5cb097d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:12.322772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0880b9-437d-4f58-8447-1e35f5cb097d service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:12.341461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 861/1689] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:12.681790 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c685da-f7f2-4a1e-a7a8-07121ad82e42 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:12.682408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c685da-f7f2-4a1e-a7a8-07121ad82e42 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:12.683454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c685da-f7f2-4a1e-a7a8-07121ad82e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:12.747366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-29c685da-f7f2-4a1e-a7a8-07121ad82e42 None None] MFA Rules not processed for user `c8643965094b4fefa34456e222139f51`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:12.750712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-29c685da-f7f2-4a1e-a7a8-07121ad82e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:13.026898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93b613-3cc8-4884-93d5-29d5bb83a7b6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:13.027815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93b613-3cc8-4884-93d5-29d5bb83a7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:13.028303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93b613-3cc8-4884-93d5-29d5bb83a7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:13.064707 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 829/1690] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:13.074315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c685da-f7f2-4a1e-a7a8-07121ad82e42 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:13.076451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-29c685da-f7f2-4a1e-a7a8-07121ad82e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:13.172694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c685da-f7f2-4a1e-a7a8-07121ad82e42 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:13.187460 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefddb77-ab3b-4882-b50f-2cd196477dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:13.189295 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefddb77-ab3b-4882-b50f-2cd196477dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:13.189842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefddb77-ab3b-4882-b50f-2cd196477dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:13.190450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefddb77-ab3b-4882-b50f-2cd196477dff admin admin] PATH_INFO: `/v3/users/d53bdece587249f28f64a8b97d153a99` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:13.193573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefddb77-ab3b-4882-b50f-2cd196477dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53bdece587249f28f64a8b97d153a99)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:13.196424 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefddb77-ab3b-4882-b50f-2cd196477dff admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:13.217937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6a93b613-3cc8-4884-93d5-29d5bb83a7b6 None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:13.219186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6a93b613-3cc8-4884-93d5-29d5bb83a7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:13.348875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:13.357815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eefddb77-ab3b-4882-b50f-2cd196477dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53bdece587249f28f64a8b97d153a99'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.375491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eefddb77-ab3b-4882-b50f-2cd196477dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53bdece587249f28f64a8b97d153a99'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.394717 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eefddb77-ab3b-4882-b50f-2cd196477dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53bdece587249f28f64a8b97d153a99'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.395828 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eefddb77-ab3b-4882-b50f-2cd196477dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53bdece587249f28f64a8b97d153a99'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.399574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eefddb77-ab3b-4882-b50f-2cd196477dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53bdece587249f28f64a8b97d153a99'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.430670 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 830/1691] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:13 2022] DELETE /identity/v3/users/d53bdece587249f28f64a8b97d153a99 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:13.435792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841158b-f30a-4af6-be05-66ec3ef20c78 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:13.436734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841158b-f30a-4af6-be05-66ec3ef20c78 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:13.437065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841158b-f30a-4af6-be05-66ec3ef20c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:13.473062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 862/1692] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:13.512056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7841158b-f30a-4af6-be05-66ec3ef20c78 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:13.513514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7841158b-f30a-4af6-be05-66ec3ef20c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:13.624161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 831/1693] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:13.671995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93b613-3cc8-4884-93d5-29d5bb83a7b6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:13.675226 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6a93b613-3cc8-4884-93d5-29d5bb83a7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:13.752091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841158b-f30a-4af6-be05-66ec3ef20c78 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:13.757791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7841158b-f30a-4af6-be05-66ec3ef20c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:13.911778 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:13.925269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93b613-3cc8-4884-93d5-29d5bb83a7b6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:14.130442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77551126-f646-481c-b844-4c8b943ac5ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:14.131787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77551126-f646-481c-b844-4c8b943ac5ae service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:14.132317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77551126-f646-481c-b844-4c8b943ac5ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:14.132814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77551126-f646-481c-b844-4c8b943ac5ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:14.143241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841158b-f30a-4af6-be05-66ec3ef20c78 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:14.155584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77551126-f646-481c-b844-4c8b943ac5ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:14.157548 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77551126-f646-481c-b844-4c8b943ac5ae service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:14.163218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a22f9-16bc-42fa-bdfc-68e808e0a4ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:14.163659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a22f9-16bc-42fa-bdfc-68e808e0a4ae service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:14.164013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a22f9-16bc-42fa-bdfc-68e808e0a4ae service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:14.164212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a22f9-16bc-42fa-bdfc-68e808e0a4ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:14.182225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 863/1694] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:14.258716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:14.299731 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a22f9-16bc-42fa-bdfc-68e808e0a4ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:14.303150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a22f9-16bc-42fa-bdfc-68e808e0a4ae service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:14.326870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 832/1695] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:33:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:33:16.835228 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d988f-4c08-465c-b01c-1759b2cad8d6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:16.835722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d988f-4c08-465c-b01c-1759b2cad8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:16.835802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d988f-4c08-465c-b01c-1759b2cad8d6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:16.837432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 864/1696] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:33:16.849028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806044f2-e91c-4456-a78f-36074e1e78c4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:16.849558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806044f2-e91c-4456-a78f-36074e1e78c4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:16.849641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806044f2-e91c-4456-a78f-36074e1e78c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:16.929130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-806044f2-e91c-4456-a78f-36074e1e78c4 None None] MFA Rules not processed for user `fc1bd453c1114da4a5d9aa543bf1ff32`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:16.946876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-806044f2-e91c-4456-a78f-36074e1e78c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:17.243412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 833/1697] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:17.315941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d988f-4c08-465c-b01c-1759b2cad8d6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:17.317770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0b7d988f-4c08-465c-b01c-1759b2cad8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:17.352340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d988f-4c08-465c-b01c-1759b2cad8d6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:17.386679 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8c173-c211-4386-afdb-96ba55dde5b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:17.388065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8c173-c211-4386-afdb-96ba55dde5b1 service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:17.388360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8c173-c211-4386-afdb-96ba55dde5b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:17.388646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8c173-c211-4386-afdb-96ba55dde5b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:17.406393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837d1d8-b638-45db-82db-bfd5c8fe5256 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:17.406692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837d1d8-b638-45db-82db-bfd5c8fe5256 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:17.406976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837d1d8-b638-45db-82db-bfd5c8fe5256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:17.410138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8c173-c211-4386-afdb-96ba55dde5b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:17.434868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8c173-c211-4386-afdb-96ba55dde5b1 service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:17.450349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6837d1d8-b638-45db-82db-bfd5c8fe5256 None None] MFA Rules not processed for user `403beb9eb6c04cc69579361138bea12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:17.456108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6837d1d8-b638-45db-82db-bfd5c8fe5256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:17.461875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 865/1698] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:17.491019 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 834/1699] 10.222.0.43 () {58 vars in 1015 bytes} [Sat Aug 6 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:17.587551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8c173-c211-4386-afdb-96ba55dde5b1 service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:17.589983 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4cd8c173-c211-4386-afdb-96ba55dde5b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:17.618619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8c173-c211-4386-afdb-96ba55dde5b1 service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:17.628486 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89ed3-0a86-44ae-89f0-7bb9d3c24156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:17.630840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89ed3-0a86-44ae-89f0-7bb9d3c24156 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:17.631402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89ed3-0a86-44ae-89f0-7bb9d3c24156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:17.632620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89ed3-0a86-44ae-89f0-7bb9d3c24156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:17.659696 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f89ed3-0a86-44ae-89f0-7bb9d3c24156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:17.661338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f89ed3-0a86-44ae-89f0-7bb9d3c24156 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:17.688236 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 866/1700] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:19.224633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e79e3-f5b2-4b47-8220-92db78586cbf None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:19.225615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e79e3-f5b2-4b47-8220-92db78586cbf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:19.226079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e79e3-f5b2-4b47-8220-92db78586cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:19.277960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ba7e79e3-f5b2-4b47-8220-92db78586cbf None None] MFA Rules not processed for user `3a7f87ccbd674c54807786d55eba2a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:19.283950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ba7e79e3-f5b2-4b47-8220-92db78586cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:19.517264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 835/1701] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:19.912647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89ed3-0a86-44ae-89f0-7bb9d3c24156 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:19.915041 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-67f89ed3-0a86-44ae-89f0-7bb9d3c24156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:19.958069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89ed3-0a86-44ae-89f0-7bb9d3c24156 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:19.979005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:19.981210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:19.983083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:19.983894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] PATH_INFO: `/v3/users/2c569ce531864b68b06a0dd3dd6e7cdb` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:19.995321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c569ce531864b68b06a0dd3dd6e7cdb)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:19.997157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: WARNING py.warnings [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:33:19.997157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: warnings.warn(msg) Aug 06 01:33:19.997157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: Aug 06 01:33:19.999840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:20.249997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c569ce531864b68b06a0dd3dd6e7cdb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:20.383140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c569ce531864b68b06a0dd3dd6e7cdb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:20.388468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c569ce531864b68b06a0dd3dd6e7cdb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:20.392222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c569ce531864b68b06a0dd3dd6e7cdb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:20.415038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c569ce531864b68b06a0dd3dd6e7cdb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:20.457005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 867/1702] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:19 2022] DELETE /identity/v3/users/2c569ce531864b68b06a0dd3dd6e7cdb => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:20.572643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e79e3-f5b2-4b47-8220-92db78586cbf None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:20.576119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ba7e79e3-f5b2-4b47-8220-92db78586cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:20.616271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e79e3-f5b2-4b47-8220-92db78586cbf None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:20.802382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:20.804771 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:20.805156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:20.805480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] PATH_INFO: `/v3/projects/25b87d3d012d4f98a059751e7e1ca860` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:20.808968 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b87d3d012d4f98a059751e7e1ca860)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:20.814469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: WARNING py.warnings [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:33:20.814469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: warnings.warn(msg) Aug 06 01:33:20.814469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: Aug 06 01:33:20.816166 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:20.923391 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:21.057900 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b87d3d012d4f98a059751e7e1ca860', 'request_id': 'req-cf5268d7-0618-4f81-aa57-d39c7e294fd3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.061676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:21.063949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:21.080507 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b87d3d012d4f98a059751e7e1ca860', 'request_id': 'req-cf5268d7-0618-4f81-aa57-d39c7e294fd3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.093674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b87d3d012d4f98a059751e7e1ca860', 'request_id': 'req-cf5268d7-0618-4f81-aa57-d39c7e294fd3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.119000 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab2959-594e-43bd-9bed-c79a2089693a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:21.142542 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] The token cache is being invalidate because project 25b87d3d012d4f98a059751e7e1ca860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:21.142965 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.143564 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.145524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 836/1703] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:20 2022] DELETE /identity/v3/projects/25b87d3d012d4f98a059751e7e1ca860 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:21.152620 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:21.153990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:21.270355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5268d7-0618-4f81-aa57-d39c7e294fd3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:21.279286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:21.279945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:21.280241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:21.280531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] PATH_INFO: `/v3/users/79c11b53fbb84781b9a0d1224925aabe` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:21.284354 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c11b53fbb84781b9a0d1224925aabe)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:21.286416 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:21.321135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:21.348312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92a406-dc25-4117-aadd-caf4979e5bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:21.349326 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92a406-dc25-4117-aadd-caf4979e5bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:21.349615 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92a406-dc25-4117-aadd-caf4979e5bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:21.349901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92a406-dc25-4117-aadd-caf4979e5bf1 admin admin] PATH_INFO: `/v3/projects/a8a3d4fe8d65454bacdd0f936d795268` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:21.351527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92a406-dc25-4117-aadd-caf4979e5bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a3d4fe8d65454bacdd0f936d795268)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:21.372670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92a406-dc25-4117-aadd-caf4979e5bf1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:21.378409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c11b53fbb84781b9a0d1224925aabe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.396197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c11b53fbb84781b9a0d1224925aabe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.423114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c11b53fbb84781b9a0d1224925aabe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.423916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c11b53fbb84781b9a0d1224925aabe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.424573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c11b53fbb84781b9a0d1224925aabe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.454029 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 837/1704] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:21 2022] DELETE /identity/v3/users/79c11b53fbb84781b9a0d1224925aabe => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:21.487605 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1c92a406-dc25-4117-aadd-caf4979e5bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a3d4fe8d65454bacdd0f936d795268', 'request_id': 'req-1c92a406-dc25-4117-aadd-caf4979e5bf1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.496332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1c92a406-dc25-4117-aadd-caf4979e5bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a3d4fe8d65454bacdd0f936d795268', 'request_id': 'req-1c92a406-dc25-4117-aadd-caf4979e5bf1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.510156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1c92a406-dc25-4117-aadd-caf4979e5bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a3d4fe8d65454bacdd0f936d795268', 'request_id': 'req-1c92a406-dc25-4117-aadd-caf4979e5bf1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.548535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1c92a406-dc25-4117-aadd-caf4979e5bf1 admin admin] The token cache is being invalidate because project a8a3d4fe8d65454bacdd0f936d795268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:21.551819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1c92a406-dc25-4117-aadd-caf4979e5bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.554653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1c92a406-dc25-4117-aadd-caf4979e5bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:21.562065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 868/1705] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:21 2022] DELETE /identity/v3/projects/a8a3d4fe8d65454bacdd0f936d795268 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:21.565854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:21.567302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:21.658540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:21.771952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff9ad7-087f-4483-b910-53e337dd1ff5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:21.932688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9efac4-9dc8-4eb2-bab1-957c2fddd75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:21.933412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9efac4-9dc8-4eb2-bab1-957c2fddd75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:21.933701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9efac4-9dc8-4eb2-bab1-957c2fddd75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:21.933985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9efac4-9dc8-4eb2-bab1-957c2fddd75c admin admin] PATH_INFO: `/v3/users/c8643965094b4fefa34456e222139f51` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:21.937452 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9efac4-9dc8-4eb2-bab1-957c2fddd75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8643965094b4fefa34456e222139f51)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:21.943810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9efac4-9dc8-4eb2-bab1-957c2fddd75c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:22.065429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7a9efac4-9dc8-4eb2-bab1-957c2fddd75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8643965094b4fefa34456e222139f51'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:22.082164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7a9efac4-9dc8-4eb2-bab1-957c2fddd75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8643965094b4fefa34456e222139f51'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:22.129048 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7a9efac4-9dc8-4eb2-bab1-957c2fddd75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8643965094b4fefa34456e222139f51'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:22.137509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7a9efac4-9dc8-4eb2-bab1-957c2fddd75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8643965094b4fefa34456e222139f51'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:22.138034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7a9efac4-9dc8-4eb2-bab1-957c2fddd75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8643965094b4fefa34456e222139f51'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:22.169252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 838/1706] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:21 2022] DELETE /identity/v3/users/c8643965094b4fefa34456e222139f51 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:23.090742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71324659-1753-4869-a267-721d6255ace2 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:23.091344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71324659-1753-4869-a267-721d6255ace2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:23.091344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71324659-1753-4869-a267-721d6255ace2 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:23.092814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 869/1707] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:33:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:33:23.273155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89613c-29a6-4614-951d-c67c3e192b8d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:23.273736 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89613c-29a6-4614-951d-c67c3e192b8d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:23.273736 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89613c-29a6-4614-951d-c67c3e192b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:23.336549 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ac89613c-29a6-4614-951d-c67c3e192b8d None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:23.343258 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ac89613c-29a6-4614-951d-c67c3e192b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:23.544016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:23.609126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 839/1708] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:24.098104 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71324659-1753-4869-a267-721d6255ace2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:24.101645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-71324659-1753-4869-a267-721d6255ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:24.195996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89613c-29a6-4614-951d-c67c3e192b8d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:24.197510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ac89613c-29a6-4614-951d-c67c3e192b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:24.225583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89613c-29a6-4614-951d-c67c3e192b8d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:24.246345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703c272-c03b-4667-811d-fce96aaadd7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:24.247147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c272-c03b-4667-811d-fce96aaadd7a service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:24.247540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c272-c03b-4667-811d-fce96aaadd7a service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:24.247928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c272-c03b-4667-811d-fce96aaadd7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:24.264484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703c272-c03b-4667-811d-fce96aaadd7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:24.286681 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703c272-c03b-4667-811d-fce96aaadd7a service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:24.306238 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71324659-1753-4869-a267-721d6255ace2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:24.312158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5e025-7c38-432d-b551-ecef8af0a954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:24.313206 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 840/1709] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:24.318289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703c272-c03b-4667-811d-fce96aaadd7a service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:24.323975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e703c272-c03b-4667-811d-fce96aaadd7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:24.331793 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e025-7c38-432d-b551-ecef8af0a954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:24.332343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e025-7c38-432d-b551-ecef8af0a954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:24.332845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e025-7c38-432d-b551-ecef8af0a954 admin admin] PATH_INFO: `/v3/projects/c0c82141c0a94171988a75da11c76f3c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:24.336056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5e025-7c38-432d-b551-ecef8af0a954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c82141c0a94171988a75da11c76f3c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:24.343131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5e025-7c38-432d-b551-ecef8af0a954 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:24.355021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703c272-c03b-4667-811d-fce96aaadd7a service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:24.368644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f4af-489a-46ee-a154-558057efde8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:24.370091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f4af-489a-46ee-a154-558057efde8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:24.370535 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f4af-489a-46ee-a154-558057efde8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:24.371159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f4af-489a-46ee-a154-558057efde8c admin admin] PATH_INFO: `/v3/projects/1cd9835b891e4bcbbc304ed0a7eff70c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:24.372926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f4af-489a-46ee-a154-558057efde8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd9835b891e4bcbbc304ed0a7eff70c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:24.375026 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f4af-489a-46ee-a154-558057efde8c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:24.498975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4fc5e025-7c38-432d-b551-ecef8af0a954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c82141c0a94171988a75da11c76f3c', 'request_id': 'req-4fc5e025-7c38-432d-b551-ecef8af0a954'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:24.509346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4fc5e025-7c38-432d-b551-ecef8af0a954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c82141c0a94171988a75da11c76f3c', 'request_id': 'req-4fc5e025-7c38-432d-b551-ecef8af0a954'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:24.542167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4fc5e025-7c38-432d-b551-ecef8af0a954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c82141c0a94171988a75da11c76f3c', 'request_id': 'req-4fc5e025-7c38-432d-b551-ecef8af0a954'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:24.544002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8944f4af-489a-46ee-a154-558057efde8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd9835b891e4bcbbc304ed0a7eff70c', 'request_id': 'req-8944f4af-489a-46ee-a154-558057efde8c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:24.563795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8944f4af-489a-46ee-a154-558057efde8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd9835b891e4bcbbc304ed0a7eff70c', 'request_id': 'req-8944f4af-489a-46ee-a154-558057efde8c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:24.565781 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4fc5e025-7c38-432d-b551-ecef8af0a954 admin admin] The token cache is being invalidate because project c0c82141c0a94171988a75da11c76f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:24.566324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4fc5e025-7c38-432d-b551-ecef8af0a954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:24.567832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4fc5e025-7c38-432d-b551-ecef8af0a954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:24.570289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 870/1710] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:24 2022] DELETE /identity/v3/projects/c0c82141c0a94171988a75da11c76f3c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:24.572163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499092a-63a8-4178-93e3-33eef95298fb None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:24.572803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499092a-63a8-4178-93e3-33eef95298fb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:24.573367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499092a-63a8-4178-93e3-33eef95298fb None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:24.575583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 871/1711] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:33:24.577276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf7e8f-07d5-43e9-a2e3-8185a9c169ba None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:24.577828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf7e8f-07d5-43e9-a2e3-8185a9c169ba None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:24.578442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf7e8f-07d5-43e9-a2e3-8185a9c169ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:24.587487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8944f4af-489a-46ee-a154-558057efde8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd9835b891e4bcbbc304ed0a7eff70c', 'request_id': 'req-8944f4af-489a-46ee-a154-558057efde8c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:24.622251 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-43cf7e8f-07d5-43e9-a2e3-8185a9c169ba None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:24.623651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-43cf7e8f-07d5-43e9-a2e3-8185a9c169ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:24.637163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:24.638126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8944f4af-489a-46ee-a154-558057efde8c admin admin] The token cache is being invalidate because project 1cd9835b891e4bcbbc304ed0a7eff70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:24.638126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8944f4af-489a-46ee-a154-558057efde8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:24.640579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8944f4af-489a-46ee-a154-558057efde8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:24.644530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 841/1712] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:24 2022] DELETE /identity/v3/projects/1cd9835b891e4bcbbc304ed0a7eff70c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:24.650029 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80298aaa-3eb6-4bd8-8ba0-b0714a0c0489 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:24.650646 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80298aaa-3eb6-4bd8-8ba0-b0714a0c0489 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:24.651152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80298aaa-3eb6-4bd8-8ba0-b0714a0c0489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:24.702888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-80298aaa-3eb6-4bd8-8ba0-b0714a0c0489 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:24.706213 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-80298aaa-3eb6-4bd8-8ba0-b0714a0c0489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:24.758346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 872/1713] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:24.764934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06016d-d1dc-4fa3-863a-318a632fb4f4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:24.765650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06016d-d1dc-4fa3-863a-318a632fb4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:24.766050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06016d-d1dc-4fa3-863a-318a632fb4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:24.781704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 842/1714] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:24.791852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c9684-ed76-40ca-944e-68660c965059 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:24.792514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c9684-ed76-40ca-944e-68660c965059 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:24.792970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c9684-ed76-40ca-944e-68660c965059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:24.812861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6e06016d-d1dc-4fa3-863a-318a632fb4f4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:24.816039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6e06016d-d1dc-4fa3-863a-318a632fb4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:24.836755 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 873/1715] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:24.840365 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06016d-d1dc-4fa3-863a-318a632fb4f4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:24.847598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-315c9684-ed76-40ca-944e-68660c965059 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:24.856950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-315c9684-ed76-40ca-944e-68660c965059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:24.875426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06016d-d1dc-4fa3-863a-318a632fb4f4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:24.896365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 843/1716] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:24.898301 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400689df-b094-4f5d-a0d1-10df0b235986 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:24.898724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400689df-b094-4f5d-a0d1-10df0b235986 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:24.899129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400689df-b094-4f5d-a0d1-10df0b235986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:24.909539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d29ffe-bbf9-433f-ab0c-0a2643586e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:24.912332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d29ffe-bbf9-433f-ab0c-0a2643586e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:24.912740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d29ffe-bbf9-433f-ab0c-0a2643586e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:24.913945 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d29ffe-bbf9-433f-ab0c-0a2643586e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:24.915313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d29ffe-bbf9-433f-ab0c-0a2643586e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:33:24.917150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d29ffe-bbf9-433f-ab0c-0a2643586e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:24.919734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d29ffe-bbf9-433f-ab0c-0a2643586e42 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:24.950280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-400689df-b094-4f5d-a0d1-10df0b235986 None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:24.952849 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-400689df-b094-4f5d-a0d1-10df0b235986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:24.959493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 874/1717] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:33:24.959493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d29ffe-bbf9-433f-ab0c-0a2643586e42 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:24.978255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d29ffe-bbf9-433f-ab0c-0a2643586e42 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:24.990391 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16982579-8296-489d-aa92-3743f9267084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:24.991262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16982579-8296-489d-aa92-3743f9267084 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:24.991716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16982579-8296-489d-aa92-3743f9267084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:24.992171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16982579-8296-489d-aa92-3743f9267084 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:24.993663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16982579-8296-489d-aa92-3743f9267084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:33:24.995269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16982579-8296-489d-aa92-3743f9267084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:24.997692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16982579-8296-489d-aa92-3743f9267084 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:25.017359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:25.034384 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 875/1718] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:33:25.036328 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16982579-8296-489d-aa92-3743f9267084 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:25.063164 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16982579-8296-489d-aa92-3743f9267084 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:25.076594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84497a0c-be9d-4aaa-8fd5-0b75082b4f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:25.077266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84497a0c-be9d-4aaa-8fd5-0b75082b4f09 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:25.077554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84497a0c-be9d-4aaa-8fd5-0b75082b4f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:25.079562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 844/1719] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:33:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:25.080554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84497a0c-be9d-4aaa-8fd5-0b75082b4f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:25.082014 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400689df-b094-4f5d-a0d1-10df0b235986 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:25.082421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84497a0c-be9d-4aaa-8fd5-0b75082b4f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:25.089295 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84497a0c-be9d-4aaa-8fd5-0b75082b4f09 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:25.112655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400689df-b094-4f5d-a0d1-10df0b235986 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:25.126534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf8d28-101f-4a8f-97e7-728eae0e37f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:25.128925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf8d28-101f-4a8f-97e7-728eae0e37f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:25.129221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf8d28-101f-4a8f-97e7-728eae0e37f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:25.129921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf8d28-101f-4a8f-97e7-728eae0e37f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:25.133127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf8d28-101f-4a8f-97e7-728eae0e37f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:25.137712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf8d28-101f-4a8f-97e7-728eae0e37f1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:25.185803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 876/1720] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:25 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:25.186828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84497a0c-be9d-4aaa-8fd5-0b75082b4f09 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:25.294898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 845/1721] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:25 2022] POST /identity/v3/projects => generated 393 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:25.299983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf8d28-101f-4a8f-97e7-728eae0e37f1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:25.422245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84497a0c-be9d-4aaa-8fd5-0b75082b4f09 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:25.500800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a361d-47bb-49c2-817a-890e04cd47d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:25.501549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a361d-47bb-49c2-817a-890e04cd47d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:25.501896 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a361d-47bb-49c2-817a-890e04cd47d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:25.502178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a361d-47bb-49c2-817a-890e04cd47d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:25.502856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a361d-47bb-49c2-817a-890e04cd47d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:25.504920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a361d-47bb-49c2-817a-890e04cd47d0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:25.522554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:25.568526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 877/1722] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:25 2022] POST /identity/v3/users => generated 282 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:25.572148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82ce06-ee81-4d21-91ed-ecf32189b6b5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:25.572513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82ce06-ee81-4d21-91ed-ecf32189b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:25.572824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82ce06-ee81-4d21-91ed-ecf32189b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:25.674639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1f82ce06-ee81-4d21-91ed-ecf32189b6b5 None None] MFA Rules not processed for user `e354e99370d64ec3a7624eb3e550021d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:25.678257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1f82ce06-ee81-4d21-91ed-ecf32189b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:25.695068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf8d28-101f-4a8f-97e7-728eae0e37f1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:25.712573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f51cb3-85ab-4bdf-a102-3d64c68152ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:25.713474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f51cb3-85ab-4bdf-a102-3d64c68152ae admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:25.713757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f51cb3-85ab-4bdf-a102-3d64c68152ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:25.714040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f51cb3-85ab-4bdf-a102-3d64c68152ae admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:25.714735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f51cb3-85ab-4bdf-a102-3d64c68152ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:25.726322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f51cb3-85ab-4bdf-a102-3d64c68152ae admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:25.804416 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 846/1723] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:25 2022] POST /identity/v3/users => generated 297 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:25.805540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f51cb3-85ab-4bdf-a102-3d64c68152ae admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:25.822206 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f51cb3-85ab-4bdf-a102-3d64c68152ae admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:25.830748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ddb40-ca06-41af-99a8-b92cba734b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:25.831741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ddb40-ca06-41af-99a8-b92cba734b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:25.832269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ddb40-ca06-41af-99a8-b92cba734b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:25.832654 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ddb40-ca06-41af-99a8-b92cba734b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:25.833706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ddb40-ca06-41af-99a8-b92cba734b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:25.836000 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ddb40-ca06-41af-99a8-b92cba734b06 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:25.862852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 847/1724] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:25.864675 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ddb40-ca06-41af-99a8-b92cba734b06 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:25.872815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8e8ddb40-ca06-41af-99a8-b92cba734b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:25.899033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 878/1725] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:25.905153 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82ce06-ee81-4d21-91ed-ecf32189b6b5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:25.946518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82ce06-ee81-4d21-91ed-ecf32189b6b5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:25.965144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e426-5601-4417-9f7c-ac56760ff2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:25.965782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e426-5601-4417-9f7c-ac56760ff2fe admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:25.966074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e426-5601-4417-9f7c-ac56760ff2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:25.966355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e426-5601-4417-9f7c-ac56760ff2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:25.969642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971e426-5601-4417-9f7c-ac56760ff2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:25.976950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971e426-5601-4417-9f7c-ac56760ff2fe admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:26.004374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 879/1726] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:26.005599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e426-5601-4417-9f7c-ac56760ff2fe admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:26.054141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e426-5601-4417-9f7c-ac56760ff2fe admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:26.083288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7575fb5-827d-41dd-a21a-2b71adc2edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:26.083288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7575fb5-827d-41dd-a21a-2b71adc2edc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:26.083288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7575fb5-827d-41dd-a21a-2b71adc2edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:26.083288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7575fb5-827d-41dd-a21a-2b71adc2edc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:26.090431 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7575fb5-827d-41dd-a21a-2b71adc2edc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:26.091898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7575fb5-827d-41dd-a21a-2b71adc2edc7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:26.124128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ddb40-ca06-41af-99a8-b92cba734b06 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:26.146145 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 880/1727] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:26.146145 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7575fb5-827d-41dd-a21a-2b71adc2edc7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:26.148673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecefc9-9ae5-4413-9f75-0291fa365976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:26.149413 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecefc9-9ae5-4413-9f75-0291fa365976 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:26.152513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecefc9-9ae5-4413-9f75-0291fa365976 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:26.152513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecefc9-9ae5-4413-9f75-0291fa365976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:26.172644 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7575fb5-827d-41dd-a21a-2b71adc2edc7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:26.178485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecefc9-9ae5-4413-9f75-0291fa365976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:26.184510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecefc9-9ae5-4413-9f75-0291fa365976 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:26.229220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9079b-2757-4323-a617-03d61bf859f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:26.230550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9079b-2757-4323-a617-03d61bf859f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:26.230790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9079b-2757-4323-a617-03d61bf859f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:26.231090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9079b-2757-4323-a617-03d61bf859f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:26.231839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9079b-2757-4323-a617-03d61bf859f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:26.233696 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9079b-2757-4323-a617-03d61bf859f7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:26.235737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 848/1728] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:26.237683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecefc9-9ae5-4413-9f75-0291fa365976 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:26.274163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecefc9-9ae5-4413-9f75-0291fa365976 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:26.284796 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099495ba-591d-4837-ba13-564db243e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:26.285852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099495ba-591d-4837-ba13-564db243e805 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:26.287875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099495ba-591d-4837-ba13-564db243e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:26.288346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099495ba-591d-4837-ba13-564db243e805 admin admin] PATH_INFO: `/v3/projects/d4f20342192046699f6a910781f2e730/users/a7c2cc652e5b48818c20ca1070f5a9d8/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:26.306283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 881/1729] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:26.307119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9079b-2757-4323-a617-03d61bf859f7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:26.326603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099495ba-591d-4837-ba13-564db243e805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f20342192046699f6a910781f2e730, user_id=a7c2cc652e5b48818c20ca1070f5a9d8, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:26.331641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099495ba-591d-4837-ba13-564db243e805 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:26.345491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:26.345799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9079b-2757-4323-a617-03d61bf859f7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:26.372113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 849/1730] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:26 2022] PUT /identity/v3/projects/d4f20342192046699f6a910781f2e730/users/a7c2cc652e5b48818c20ca1070f5a9d8/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:26.384607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a777c48-933d-42d2-894b-418892a42472 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:26.387371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a777c48-933d-42d2-894b-418892a42472 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:26.390437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a777c48-933d-42d2-894b-418892a42472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:26.492477 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8a777c48-933d-42d2-894b-418892a42472 None None] MFA Rules not processed for user `a7c2cc652e5b48818c20ca1070f5a9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:26.500569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8a777c48-933d-42d2-894b-418892a42472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:26.606867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26219cf3-4996-4426-8c66-06e10cc1bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:26.607681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26219cf3-4996-4426-8c66-06e10cc1bbc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:26.608005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26219cf3-4996-4426-8c66-06e10cc1bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:26.608331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26219cf3-4996-4426-8c66-06e10cc1bbc7 admin admin] PATH_INFO: `/v3/projects/96740ab6ef144772bdb5c0ead86198a1/users/2dc58c83d6874695bf45506fd557ba5b/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:26.682635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26219cf3-4996-4426-8c66-06e10cc1bbc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96740ab6ef144772bdb5c0ead86198a1, user_id=2dc58c83d6874695bf45506fd557ba5b, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:26.703619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26219cf3-4996-4426-8c66-06e10cc1bbc7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:26.780040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 882/1731] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:26 2022] PUT /identity/v3/projects/96740ab6ef144772bdb5c0ead86198a1/users/2dc58c83d6874695bf45506fd557ba5b/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:26.793094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754125ae-2dc5-4aa6-921e-35297fda8976 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:26.793382 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754125ae-2dc5-4aa6-921e-35297fda8976 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:26.793654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754125ae-2dc5-4aa6-921e-35297fda8976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:26.804145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 850/1732] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:26.813205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a777c48-933d-42d2-894b-418892a42472 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:26.872588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a777c48-933d-42d2-894b-418892a42472 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:26.943552 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-754125ae-2dc5-4aa6-921e-35297fda8976 None None] MFA Rules not processed for user `2dc58c83d6874695bf45506fd557ba5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:26.944443 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-754125ae-2dc5-4aa6-921e-35297fda8976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:27.094260 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:27.179244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc4ec3-d74a-42d9-b3b1-066525e3569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:27.182085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc4ec3-d74a-42d9-b3b1-066525e3569b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:27.183805 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc4ec3-d74a-42d9-b3b1-066525e3569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:27.193140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc4ec3-d74a-42d9-b3b1-066525e3569b admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:27.194470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc4ec3-d74a-42d9-b3b1-066525e3569b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:27.196633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc4ec3-d74a-42d9-b3b1-066525e3569b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:27.209732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 883/1733] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:27.214208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e608-5c38-4d04-9b13-59241f42731c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:27.214505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e608-5c38-4d04-9b13-59241f42731c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:27.214789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e608-5c38-4d04-9b13-59241f42731c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:27.272194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a635e608-5c38-4d04-9b13-59241f42731c None None] MFA Rules not processed for user `e9f545fde2d94e03b9b8336f53122177`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:27.274500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a635e608-5c38-4d04-9b13-59241f42731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:27.294952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 851/1734] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:26 2022] POST /identity/v3/projects => generated 365 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:27.296271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc4ec3-d74a-42d9-b3b1-066525e3569b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:27.494164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc4ec3-d74a-42d9-b3b1-066525e3569b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:27.497914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 884/1735] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:27.499286 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e608-5c38-4d04-9b13-59241f42731c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:27.501310 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20e17b-0778-415a-a967-f2090bc9dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:27.501956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20e17b-0778-415a-a967-f2090bc9dd89 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:27.502237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20e17b-0778-415a-a967-f2090bc9dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:27.502518 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20e17b-0778-415a-a967-f2090bc9dd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:27.503199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20e17b-0778-415a-a967-f2090bc9dd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:27.505159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20e17b-0778-415a-a967-f2090bc9dd89 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:27.539560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:27.553224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 852/1736] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:27 2022] POST /identity/v3/projects => generated 391 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:27.553410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e608-5c38-4d04-9b13-59241f42731c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:27.558144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20e17b-0778-415a-a967-f2090bc9dd89 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:27.734854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20e17b-0778-415a-a967-f2090bc9dd89 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:27.758957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c4048-7b5f-4593-a887-883c3b544ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:27.761464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c4048-7b5f-4593-a887-883c3b544ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:27.763386 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c4048-7b5f-4593-a887-883c3b544ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:27.765213 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c4048-7b5f-4593-a887-883c3b544ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:27.766822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c4048-7b5f-4593-a887-883c3b544ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:27.781138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c4048-7b5f-4593-a887-883c3b544ce2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:27.818815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755e755-011d-490c-855f-85d62b67bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:27.819693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755e755-011d-490c-855f-85d62b67bf4b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:27.820145 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755e755-011d-490c-855f-85d62b67bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:27.820567 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755e755-011d-490c-855f-85d62b67bf4b admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:27.821477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755e755-011d-490c-855f-85d62b67bf4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:27.843584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755e755-011d-490c-855f-85d62b67bf4b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:27.849926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 853/1737] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:27 2022] POST /identity/v3/users => generated 302 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:27.851070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c4048-7b5f-4593-a887-883c3b544ce2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:27.888770 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c4048-7b5f-4593-a887-883c3b544ce2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:27.908878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0b143-3717-4436-b99d-0f1ff7ba9c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:27.909554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0b143-3717-4436-b99d-0f1ff7ba9c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:27.910215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0b143-3717-4436-b99d-0f1ff7ba9c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:27.910481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0b143-3717-4436-b99d-0f1ff7ba9c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:27.911211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0b143-3717-4436-b99d-0f1ff7ba9c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:27.912825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0b143-3717-4436-b99d-0f1ff7ba9c8c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:27.948199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 854/1738] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:27.957217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0b143-3717-4436-b99d-0f1ff7ba9c8c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:27.966254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 885/1739] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:27 2022] POST /identity/v3/users => generated 289 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:27.967425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755e755-011d-490c-855f-85d62b67bf4b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:27.989733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0b143-3717-4436-b99d-0f1ff7ba9c8c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:28.006429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c4e7f-a56f-4f36-8f62-c6d6a8ec4343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:28.007429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c4e7f-a56f-4f36-8f62-c6d6a8ec4343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:28.007878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c4e7f-a56f-4f36-8f62-c6d6a8ec4343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:28.008319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c4e7f-a56f-4f36-8f62-c6d6a8ec4343 admin admin] PATH_INFO: `/v3/projects/b453a65d1fe0497c9b809ee190ad569a/users/279b93b5fc1c4657906648ebbbb227b4/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:28.009152 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755e755-011d-490c-855f-85d62b67bf4b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:28.031529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4d168-e466-45c5-964b-257c49457926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:28.032499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4d168-e466-45c5-964b-257c49457926 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:28.033076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4d168-e466-45c5-964b-257c49457926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:28.033545 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4d168-e466-45c5-964b-257c49457926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:28.034661 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4d168-e466-45c5-964b-257c49457926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:28.042347 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4d168-e466-45c5-964b-257c49457926 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:28.045495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c4e7f-a56f-4f36-8f62-c6d6a8ec4343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b453a65d1fe0497c9b809ee190ad569a, user_id=279b93b5fc1c4657906648ebbbb227b4, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:28.048633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c4e7f-a56f-4f36-8f62-c6d6a8ec4343 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:28.076289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 855/1740] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:27 2022] PUT /identity/v3/projects/b453a65d1fe0497c9b809ee190ad569a/users/279b93b5fc1c4657906648ebbbb227b4/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:28.080660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c4e7f-a56f-4f36-8f62-c6d6a8ec4343 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:28.090860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 886/1741] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:28.107535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4d168-e466-45c5-964b-257c49457926 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:28.123114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4d168-e466-45c5-964b-257c49457926 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:28.287460 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c4e7f-a56f-4f36-8f62-c6d6a8ec4343 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:28.302837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1417185-ddd2-4f57-bb95-4da26c75e96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:28.303547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1417185-ddd2-4f57-bb95-4da26c75e96e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:28.303835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1417185-ddd2-4f57-bb95-4da26c75e96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:28.304113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1417185-ddd2-4f57-bb95-4da26c75e96e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:28.304828 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1417185-ddd2-4f57-bb95-4da26c75e96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:28.308050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1417185-ddd2-4f57-bb95-4da26c75e96e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:28.315058 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456a17d-cb56-4498-b17b-1848b5b00c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:28.315763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456a17d-cb56-4498-b17b-1848b5b00c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:28.316039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456a17d-cb56-4498-b17b-1848b5b00c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:28.316340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456a17d-cb56-4498-b17b-1848b5b00c32 admin admin] PATH_INFO: `/v3/projects/26a84d4b8fdf41b286b8ca8a10d3c926/users/b35a22d38a9e4ed5853e9687d2e24cd3/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:28.335997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:28.342500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 856/1742] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:28.346279 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1417185-ddd2-4f57-bb95-4da26c75e96e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:28.374237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456a17d-cb56-4498-b17b-1848b5b00c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a84d4b8fdf41b286b8ca8a10d3c926, user_id=b35a22d38a9e4ed5853e9687d2e24cd3, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:28.387617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456a17d-cb56-4498-b17b-1848b5b00c32 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:28.391457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1417185-ddd2-4f57-bb95-4da26c75e96e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:28.412451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0a120-72a6-4d1c-8893-62309ba93364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:28.413047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0a120-72a6-4d1c-8893-62309ba93364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:28.413338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0a120-72a6-4d1c-8893-62309ba93364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:28.413621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0a120-72a6-4d1c-8893-62309ba93364 admin admin] PATH_INFO: `/v3/projects/b453a65d1fe0497c9b809ee190ad569a/users/279b93b5fc1c4657906648ebbbb227b4/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:28.428140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 887/1743] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:28 2022] PUT /identity/v3/projects/26a84d4b8fdf41b286b8ca8a10d3c926/users/b35a22d38a9e4ed5853e9687d2e24cd3/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:28.428333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0a120-72a6-4d1c-8893-62309ba93364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b453a65d1fe0497c9b809ee190ad569a, user_id=279b93b5fc1c4657906648ebbbb227b4, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:28.429191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456a17d-cb56-4498-b17b-1848b5b00c32 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:28.443897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0a120-72a6-4d1c-8893-62309ba93364 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:28.505856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 857/1744] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:28 2022] PUT /identity/v3/projects/b453a65d1fe0497c9b809ee190ad569a/users/279b93b5fc1c4657906648ebbbb227b4/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:28.509038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0035f-11da-4de3-81c5-ca07545860ae None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:28.509369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0035f-11da-4de3-81c5-ca07545860ae None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:28.509656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0035f-11da-4de3-81c5-ca07545860ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:28.587081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-baa0035f-11da-4de3-81c5-ca07545860ae None None] MFA Rules not processed for user `279b93b5fc1c4657906648ebbbb227b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:28.588573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-baa0035f-11da-4de3-81c5-ca07545860ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:28.612101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456a17d-cb56-4498-b17b-1848b5b00c32 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:28.624348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:28.684803 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 858/1745] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:28.697258 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0035f-11da-4de3-81c5-ca07545860ae None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:28.701183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-baa0035f-11da-4de3-81c5-ca07545860ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:28.709222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c6b42-bcd7-4ede-aa08-ac8be22e1042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:28.710843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c6b42-bcd7-4ede-aa08-ac8be22e1042 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:28.711134 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c6b42-bcd7-4ede-aa08-ac8be22e1042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:28.711662 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c6b42-bcd7-4ede-aa08-ac8be22e1042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:28.716182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c6b42-bcd7-4ede-aa08-ac8be22e1042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:28.720687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c6b42-bcd7-4ede-aa08-ac8be22e1042 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:28.753619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 888/1746] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:28.757415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c6b42-bcd7-4ede-aa08-ac8be22e1042 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:28.780927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c6b42-bcd7-4ede-aa08-ac8be22e1042 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:28.785966 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0035f-11da-4de3-81c5-ca07545860ae None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:28.791992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7818080-db55-4ecc-a6ee-91dc955546ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:28.793013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7818080-db55-4ecc-a6ee-91dc955546ed service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:28.793974 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7818080-db55-4ecc-a6ee-91dc955546ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:28.793974 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7818080-db55-4ecc-a6ee-91dc955546ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:28.796637 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd546ac-4ace-4878-80f0-ab5e474de9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:28.797363 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd546ac-4ace-4878-80f0-ab5e474de9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:28.797647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd546ac-4ace-4878-80f0-ab5e474de9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:28.797919 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd546ac-4ace-4878-80f0-ab5e474de9c3 admin admin] PATH_INFO: `/v3/projects/26a84d4b8fdf41b286b8ca8a10d3c926/users/b35a22d38a9e4ed5853e9687d2e24cd3/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:28.802777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd546ac-4ace-4878-80f0-ab5e474de9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a84d4b8fdf41b286b8ca8a10d3c926, user_id=b35a22d38a9e4ed5853e9687d2e24cd3, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:28.805529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd546ac-4ace-4878-80f0-ab5e474de9c3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:28.806252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7818080-db55-4ecc-a6ee-91dc955546ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:28.809255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7818080-db55-4ecc-a6ee-91dc955546ed service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:28.828929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 889/1747] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:28 2022] PUT /identity/v3/projects/26a84d4b8fdf41b286b8ca8a10d3c926/users/b35a22d38a9e4ed5853e9687d2e24cd3/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:28.843559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 859/1748] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:28.843659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168df2a-e490-46fe-9eb3-d40300b97d36 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:28.843659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168df2a-e490-46fe-9eb3-d40300b97d36 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:28.843659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168df2a-e490-46fe-9eb3-d40300b97d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:28.914230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b168df2a-e490-46fe-9eb3-d40300b97d36 None None] MFA Rules not processed for user `b35a22d38a9e4ed5853e9687d2e24cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:28.919156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b168df2a-e490-46fe-9eb3-d40300b97d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:28.980452 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7818080-db55-4ecc-a6ee-91dc955546ed service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:28.992178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7818080-db55-4ecc-a6ee-91dc955546ed service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:29.116991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 890/1749] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:29.123186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4a5f8-163b-4334-8b45-bdb5ba69e06f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:29.124627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4a5f8-163b-4334-8b45-bdb5ba69e06f service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:29.124940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4a5f8-163b-4334-8b45-bdb5ba69e06f service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:29.125219 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4a5f8-163b-4334-8b45-bdb5ba69e06f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:29.141004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168df2a-e490-46fe-9eb3-d40300b97d36 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:29.142832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b168df2a-e490-46fe-9eb3-d40300b97d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:29.151098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:29.168981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168df2a-e490-46fe-9eb3-d40300b97d36 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:29.173392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4732402-d4c5-4eb7-b922-44e0d104fc1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:29.174438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4732402-d4c5-4eb7-b922-44e0d104fc1b service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:29.174868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4732402-d4c5-4eb7-b922-44e0d104fc1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:29.175286 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4732402-d4c5-4eb7-b922-44e0d104fc1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:29.185975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4732402-d4c5-4eb7-b922-44e0d104fc1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:29.188798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4732402-d4c5-4eb7-b922-44e0d104fc1b service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:29.205567 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 891/1750] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:29.273121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4a5f8-163b-4334-8b45-bdb5ba69e06f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:29.274573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4a5f8-163b-4334-8b45-bdb5ba69e06f service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:29.300869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 860/1751] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:33:29.624945 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4732402-d4c5-4eb7-b922-44e0d104fc1b service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:29.636733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4732402-d4c5-4eb7-b922-44e0d104fc1b service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:29.642462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be51d3-94aa-40f4-96b8-7762997a0d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:29.645867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be51d3-94aa-40f4-96b8-7762997a0d2d service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:29.646423 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be51d3-94aa-40f4-96b8-7762997a0d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:29.647053 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be51d3-94aa-40f4-96b8-7762997a0d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:29.836492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be51d3-94aa-40f4-96b8-7762997a0d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:29.838684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be51d3-94aa-40f4-96b8-7762997a0d2d service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:29.849061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 892/1752] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:32.615231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4a5f8-163b-4334-8b45-bdb5ba69e06f service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:32.616641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-abd4a5f8-163b-4334-8b45-bdb5ba69e06f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:32.638719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:32.682786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4a5f8-163b-4334-8b45-bdb5ba69e06f service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:32.687375 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:32.688007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:32.688286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:32.688575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] PATH_INFO: `/v3/users/1694460e56cd4de3b1730bd6aa771fdc` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:32.689739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1694460e56cd4de3b1730bd6aa771fdc)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:32.691649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:32.735863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1694460e56cd4de3b1730bd6aa771fdc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:32.742722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1694460e56cd4de3b1730bd6aa771fdc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:32.754698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1694460e56cd4de3b1730bd6aa771fdc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:32.755371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1694460e56cd4de3b1730bd6aa771fdc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:32.755974 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1694460e56cd4de3b1730bd6aa771fdc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:32.771066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 861/1753] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:32 2022] DELETE /identity/v3/users/1694460e56cd4de3b1730bd6aa771fdc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:32.775870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da5472-3754-41a8-a912-9143dd1b3c13 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:32.776516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da5472-3754-41a8-a912-9143dd1b3c13 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:32.776516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da5472-3754-41a8-a912-9143dd1b3c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:32.797576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-38da5472-3754-41a8-a912-9143dd1b3c13 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:32.798789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-38da5472-3754-41a8-a912-9143dd1b3c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:32.870326 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 893/1754] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:32.880995 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:32.883473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:32.981210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa7c8e-429c-4fc3-b441-47958aad8054 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:32.987578 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5913b-7b35-4ef9-885e-ae3c3399cca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:32.988228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5913b-7b35-4ef9-885e-ae3c3399cca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:32.988518 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5913b-7b35-4ef9-885e-ae3c3399cca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:32.988800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5913b-7b35-4ef9-885e-ae3c3399cca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:33.014365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5913b-7b35-4ef9-885e-ae3c3399cca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:33.015955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5913b-7b35-4ef9-885e-ae3c3399cca8 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:33.030091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 862/1755] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:33.138629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da5472-3754-41a8-a912-9143dd1b3c13 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:33.140561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-38da5472-3754-41a8-a912-9143dd1b3c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:33.158499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da5472-3754-41a8-a912-9143dd1b3c13 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:33.165579 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:33.166568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:33.166926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:33.167285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] PATH_INFO: `/v3/users/2dc58c83d6874695bf45506fd557ba5b` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:33.168711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc58c83d6874695bf45506fd557ba5b)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:33.170767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:33.236764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc58c83d6874695bf45506fd557ba5b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.253864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc58c83d6874695bf45506fd557ba5b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.254602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc58c83d6874695bf45506fd557ba5b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.255215 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc58c83d6874695bf45506fd557ba5b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.266688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc58c83d6874695bf45506fd557ba5b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.277290 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:33.285361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 894/1756] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:33 2022] DELETE /identity/v3/users/2dc58c83d6874695bf45506fd557ba5b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:33.287938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53897014-a3ee-4903-b517-a95d6943ff9b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:33.288278 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53897014-a3ee-4903-b517-a95d6943ff9b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:33.288719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53897014-a3ee-4903-b517-a95d6943ff9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:33.317504 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-53897014-a3ee-4903-b517-a95d6943ff9b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:33.318843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-53897014-a3ee-4903-b517-a95d6943ff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:33.364755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:33.387187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:33.389062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:33.406374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 863/1757] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:33.408542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c431a3-ccb4-4a7e-b5cd-aaa8b33deb27 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:33.415884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:33.417471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:33.417832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:33.418360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] PATH_INFO: `/v3/projects/1f003162585640a5ba04e3e9c1b02d91` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:33.418908 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53897014-a3ee-4903-b517-a95d6943ff9b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:33.419891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f003162585640a5ba04e3e9c1b02d91)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:33.422016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-53897014-a3ee-4903-b517-a95d6943ff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:33.422135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:33.483057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f003162585640a5ba04e3e9c1b02d91', 'request_id': 'req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.486138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53897014-a3ee-4903-b517-a95d6943ff9b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:33.489610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f003162585640a5ba04e3e9c1b02d91', 'request_id': 'req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.497845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f003162585640a5ba04e3e9c1b02d91', 'request_id': 'req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.509848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] The token cache is being invalidate because project 1f003162585640a5ba04e3e9c1b02d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:33.510081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.511004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.512695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 895/1758] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:33 2022] DELETE /identity/v3/projects/1f003162585640a5ba04e3e9c1b02d91 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:33.516343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:33.517686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:33.566200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255512-9129-4be6-8e0e-eae978f844ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:33.567102 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255512-9129-4be6-8e0e-eae978f844ff service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:33.567536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255512-9129-4be6-8e0e-eae978f844ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:33.567999 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255512-9129-4be6-8e0e-eae978f844ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:33.570025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-83255512-9129-4be6-8e0e-eae978f844ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:33.591556 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac587ef-cb8f-4544-9c6f-98f2a7b5ae34 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:33.597533 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:33.598447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:33.598943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:33.599902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] PATH_INFO: `/v3/users/281c974d51074a7e81a9a2960481bbf5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:33.601239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281c974d51074a7e81a9a2960481bbf5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:33.603442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:33.658774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83255512-9129-4be6-8e0e-eae978f844ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:33.660234 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83255512-9129-4be6-8e0e-eae978f844ff service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:33.667074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281c974d51074a7e81a9a2960481bbf5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.673553 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 864/1759] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:33.693782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281c974d51074a7e81a9a2960481bbf5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.694512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281c974d51074a7e81a9a2960481bbf5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.695269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281c974d51074a7e81a9a2960481bbf5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.705737 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281c974d51074a7e81a9a2960481bbf5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:33.727453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 896/1760] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:33 2022] DELETE /identity/v3/users/281c974d51074a7e81a9a2960481bbf5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:34.168641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255512-9129-4be6-8e0e-eae978f844ff service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:34.170210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-83255512-9129-4be6-8e0e-eae978f844ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:34.174477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:34.175942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:34.183461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:34.185862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255512-9129-4be6-8e0e-eae978f844ff service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:34.261276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:34.276879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:34.277718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:34.278102 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:34.279004 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] PATH_INFO: `/v3/projects/96740ab6ef144772bdb5c0ead86198a1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:34.280069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96740ab6ef144772bdb5c0ead86198a1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:34.282164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:34.284941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446e0c9-9912-45b8-a492-c201100dd348 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:34.289868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1357e3-9bd4-467d-b6e6-0afbc9445384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:34.290648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1357e3-9bd4-467d-b6e6-0afbc9445384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:34.290756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1357e3-9bd4-467d-b6e6-0afbc9445384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:34.291055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1357e3-9bd4-467d-b6e6-0afbc9445384 admin admin] PATH_INFO: `/v3/projects/1ffa932859e54fc2bdba60fe5234ca6b` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:34.292373 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1357e3-9bd4-467d-b6e6-0afbc9445384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ffa932859e54fc2bdba60fe5234ca6b)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:34.294314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1357e3-9bd4-467d-b6e6-0afbc9445384 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:34.339346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96740ab6ef144772bdb5c0ead86198a1', 'request_id': 'req-0bbc0a75-76d3-4fd7-bab7-edb690666e82'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.345311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96740ab6ef144772bdb5c0ead86198a1', 'request_id': 'req-0bbc0a75-76d3-4fd7-bab7-edb690666e82'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.345661 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3f1357e3-9bd4-467d-b6e6-0afbc9445384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ffa932859e54fc2bdba60fe5234ca6b', 'request_id': 'req-3f1357e3-9bd4-467d-b6e6-0afbc9445384'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.351438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3f1357e3-9bd4-467d-b6e6-0afbc9445384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ffa932859e54fc2bdba60fe5234ca6b', 'request_id': 'req-3f1357e3-9bd4-467d-b6e6-0afbc9445384'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.352867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96740ab6ef144772bdb5c0ead86198a1', 'request_id': 'req-0bbc0a75-76d3-4fd7-bab7-edb690666e82'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.359487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3f1357e3-9bd4-467d-b6e6-0afbc9445384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ffa932859e54fc2bdba60fe5234ca6b', 'request_id': 'req-3f1357e3-9bd4-467d-b6e6-0afbc9445384'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.365566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] The token cache is being invalidate because project 96740ab6ef144772bdb5c0ead86198a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:34.365857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.367875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.369266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 865/1761] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:34 2022] DELETE /identity/v3/projects/96740ab6ef144772bdb5c0ead86198a1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:34.372734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:34.374112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:34.379722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3f1357e3-9bd4-467d-b6e6-0afbc9445384 admin admin] The token cache is being invalidate because project 1ffa932859e54fc2bdba60fe5234ca6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:34.380015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3f1357e3-9bd4-467d-b6e6-0afbc9445384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.380778 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3f1357e3-9bd4-467d-b6e6-0afbc9445384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.382352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 897/1762] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:34 2022] DELETE /identity/v3/projects/1ffa932859e54fc2bdba60fe5234ca6b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:34.387773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abea5bf-bba9-4d67-a301-2da7e1019b00 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:34.388068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abea5bf-bba9-4d67-a301-2da7e1019b00 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:34.388365 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abea5bf-bba9-4d67-a301-2da7e1019b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:34.408148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2abea5bf-bba9-4d67-a301-2da7e1019b00 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:34.409380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2abea5bf-bba9-4d67-a301-2da7e1019b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:34.439259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc0a75-76d3-4fd7-bab7-edb690666e82 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:34.470312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 898/1763] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:34.477762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a75e2f-e3a1-4676-a02a-181b6944218f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:34.478049 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a75e2f-e3a1-4676-a02a-181b6944218f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:34.478883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a75e2f-e3a1-4676-a02a-181b6944218f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:34.498288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-16a75e2f-e3a1-4676-a02a-181b6944218f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:34.499498 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-16a75e2f-e3a1-4676-a02a-181b6944218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:34.502607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:34.503264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:34.503545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:34.503818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] PATH_INFO: `/v3/users/279b93b5fc1c4657906648ebbbb227b4` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:34.505001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=279b93b5fc1c4657906648ebbbb227b4)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:34.506894 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:34.508930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 899/1764] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:34.514503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a75e2f-e3a1-4676-a02a-181b6944218f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:34.523332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a75e2f-e3a1-4676-a02a-181b6944218f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:34.528520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d3b5d-ef82-4fdd-b639-7dc8d10111eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:34.529083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d3b5d-ef82-4fdd-b639-7dc8d10111eb admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:34.529368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d3b5d-ef82-4fdd-b639-7dc8d10111eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:34.529642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d3b5d-ef82-4fdd-b639-7dc8d10111eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:34.530340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d3b5d-ef82-4fdd-b639-7dc8d10111eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:33:34.530645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d3b5d-ef82-4fdd-b639-7dc8d10111eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:34.532343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d3b5d-ef82-4fdd-b639-7dc8d10111eb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:34.538668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:34.548260 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 900/1765] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:33:34.549114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d3b5d-ef82-4fdd-b639-7dc8d10111eb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:34.559133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d3b5d-ef82-4fdd-b639-7dc8d10111eb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:34.559921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279b93b5fc1c4657906648ebbbb227b4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.567022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279b93b5fc1c4657906648ebbbb227b4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.567988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0dbb3-9c94-477b-9fd0-839ba82a37c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:34.568591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0dbb3-9c94-477b-9fd0-839ba82a37c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:34.568910 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0dbb3-9c94-477b-9fd0-839ba82a37c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:34.569378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0dbb3-9c94-477b-9fd0-839ba82a37c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:34.570094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0dbb3-9c94-477b-9fd0-839ba82a37c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:34.572724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0dbb3-9c94-477b-9fd0-839ba82a37c0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:34.580338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279b93b5fc1c4657906648ebbbb227b4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.581089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279b93b5fc1c4657906648ebbbb227b4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.581750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279b93b5fc1c4657906648ebbbb227b4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:34.584326 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:34.602798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 866/1766] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:34 2022] DELETE /identity/v3/users/279b93b5fc1c4657906648ebbbb227b4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:34.602937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 901/1767] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:34 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:33:34.607735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:34.609302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:34.694420 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8bb21-d750-45bc-a781-5ed01fbf4c16 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:34.780445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a67a7d-e76c-413c-98e3-6f04337ecee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:34.781173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a67a7d-e76c-413c-98e3-6f04337ecee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:34.781460 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a67a7d-e76c-413c-98e3-6f04337ecee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:34.781737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a67a7d-e76c-413c-98e3-6f04337ecee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:34.782418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a67a7d-e76c-413c-98e3-6f04337ecee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:34.784357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a67a7d-e76c-413c-98e3-6f04337ecee1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:34.820623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 867/1768] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:34 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:33:34.821941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0dbb3-9c94-477b-9fd0-839ba82a37c0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:34.844397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0dbb3-9c94-477b-9fd0-839ba82a37c0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:34.861381 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecdd48-7839-43dc-a81f-c1283662e37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:34.864329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecdd48-7839-43dc-a81f-c1283662e37b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:34.864793 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecdd48-7839-43dc-a81f-c1283662e37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:34.866168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecdd48-7839-43dc-a81f-c1283662e37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:34.867318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecdd48-7839-43dc-a81f-c1283662e37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:34.875129 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdecdd48-7839-43dc-a81f-c1283662e37b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:34.921862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 902/1769] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:34.926435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a67a7d-e76c-413c-98e3-6f04337ecee1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:34.943473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a67a7d-e76c-413c-98e3-6f04337ecee1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:34.952872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc833d-8e00-4f32-acbb-b51244b23c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:34.953812 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc833d-8e00-4f32-acbb-b51244b23c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:34.954422 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc833d-8e00-4f32-acbb-b51244b23c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:34.955288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc833d-8e00-4f32-acbb-b51244b23c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:34.956386 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc833d-8e00-4f32-acbb-b51244b23c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:34.958379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc833d-8e00-4f32-acbb-b51244b23c0e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:34.979928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 868/1770] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:34.981278 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecdd48-7839-43dc-a81f-c1283662e37b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:34.995472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecdd48-7839-43dc-a81f-c1283662e37b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:35.005012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21166cb3-d9db-4401-941e-f4da8a05c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:35.006096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21166cb3-d9db-4401-941e-f4da8a05c85e admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:35.006899 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21166cb3-d9db-4401-941e-f4da8a05c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:35.007491 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21166cb3-d9db-4401-941e-f4da8a05c85e admin admin] PATH_INFO: `/v3/projects/125d8be3e80c40069355fc3f1373a9ed/users/6c8188605f20440b8db4eda1c04ba450/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:35.037733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21166cb3-d9db-4401-941e-f4da8a05c85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=125d8be3e80c40069355fc3f1373a9ed, user_id=6c8188605f20440b8db4eda1c04ba450, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:35.042621 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21166cb3-d9db-4401-941e-f4da8a05c85e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:35.086802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 903/1771] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:34 2022] PUT /identity/v3/projects/125d8be3e80c40069355fc3f1373a9ed/users/6c8188605f20440b8db4eda1c04ba450/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:35.098379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33273161-7cd7-4579-973d-f94df5b6b813 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:35.099239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33273161-7cd7-4579-973d-f94df5b6b813 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:35.099846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33273161-7cd7-4579-973d-f94df5b6b813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:35.155171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-33273161-7cd7-4579-973d-f94df5b6b813 None None] MFA Rules not processed for user `6c8188605f20440b8db4eda1c04ba450`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:35.156955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-33273161-7cd7-4579-973d-f94df5b6b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:35.218601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:35.293850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 869/1772] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:35.298726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21166cb3-d9db-4401-941e-f4da8a05c85e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:35.403639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21166cb3-d9db-4401-941e-f4da8a05c85e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:35.409536 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ee1e8-d70c-4f0b-ba71-7441d721d8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:35.410199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ee1e8-d70c-4f0b-ba71-7441d721d8bb admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:35.410694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ee1e8-d70c-4f0b-ba71-7441d721d8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:35.410983 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ee1e8-d70c-4f0b-ba71-7441d721d8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:35.411722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ee1e8-d70c-4f0b-ba71-7441d721d8bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:35.414522 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ee1e8-d70c-4f0b-ba71-7441d721d8bb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:35.452844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 904/1773] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:35 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:35.457859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33273161-7cd7-4579-973d-f94df5b6b813 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:35.477388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33273161-7cd7-4579-973d-f94df5b6b813 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:35.536709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ee1e8-d70c-4f0b-ba71-7441d721d8bb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:35.538896 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-535ee1e8-d70c-4f0b-ba71-7441d721d8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:35.564200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f997172-b65c-4fc2-b198-4fe2ff82dcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:35.564839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f997172-b65c-4fc2-b198-4fe2ff82dcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:35.565656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f997172-b65c-4fc2-b198-4fe2ff82dcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:35.566083 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f997172-b65c-4fc2-b198-4fe2ff82dcd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:35.566772 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f997172-b65c-4fc2-b198-4fe2ff82dcd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:35.569679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f997172-b65c-4fc2-b198-4fe2ff82dcd1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:35.614094 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 870/1774] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:35 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:35.614452 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f997172-b65c-4fc2-b198-4fe2ff82dcd1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:35.630112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f997172-b65c-4fc2-b198-4fe2ff82dcd1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:35.637263 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f4160-a1f0-4835-b3ff-57ecff509046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:35.638055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f4160-a1f0-4835-b3ff-57ecff509046 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:35.638342 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f4160-a1f0-4835-b3ff-57ecff509046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:35.638617 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f4160-a1f0-4835-b3ff-57ecff509046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:35.639319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f4160-a1f0-4835-b3ff-57ecff509046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:35.640897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f4160-a1f0-4835-b3ff-57ecff509046 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:35.651797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 871/1775] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:33:35.655978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f4160-a1f0-4835-b3ff-57ecff509046 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:35.659171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ee1e8-d70c-4f0b-ba71-7441d721d8bb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:35.665126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90695be-8d9b-4fb2-a666-b6adb48fbe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:35.666057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90695be-8d9b-4fb2-a666-b6adb48fbe24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:35.666302 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90695be-8d9b-4fb2-a666-b6adb48fbe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:35.666751 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90695be-8d9b-4fb2-a666-b6adb48fbe24 admin admin] PATH_INFO: `/v3/projects/b453a65d1fe0497c9b809ee190ad569a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:35.667620 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f4160-a1f0-4835-b3ff-57ecff509046 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:35.667985 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90695be-8d9b-4fb2-a666-b6adb48fbe24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b453a65d1fe0497c9b809ee190ad569a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:35.670069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90695be-8d9b-4fb2-a666-b6adb48fbe24 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:35.672610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4d009-e5fa-4043-a6d0-89c814018403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:35.673432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d009-e5fa-4043-a6d0-89c814018403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:35.673713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d009-e5fa-4043-a6d0-89c814018403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:35.673995 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d009-e5fa-4043-a6d0-89c814018403 admin admin] PATH_INFO: `/v3/projects/f1a6fb12fdcd44dea20f3969da5fd20c/users/611fefbd1dc043488d347497fb480b6d/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:35.698793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4d009-e5fa-4043-a6d0-89c814018403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a6fb12fdcd44dea20f3969da5fd20c, user_id=611fefbd1dc043488d347497fb480b6d, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:35.702795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4d009-e5fa-4043-a6d0-89c814018403 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:35.723073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 872/1776] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:35 2022] PUT /identity/v3/projects/f1a6fb12fdcd44dea20f3969da5fd20c/users/611fefbd1dc043488d347497fb480b6d/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:35.726370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4d009-e5fa-4043-a6d0-89c814018403 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:35.736114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:35.743178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b90695be-8d9b-4fb2-a666-b6adb48fbe24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b453a65d1fe0497c9b809ee190ad569a', 'request_id': 'req-b90695be-8d9b-4fb2-a666-b6adb48fbe24'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:35.753327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b90695be-8d9b-4fb2-a666-b6adb48fbe24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b453a65d1fe0497c9b809ee190ad569a', 'request_id': 'req-b90695be-8d9b-4fb2-a666-b6adb48fbe24'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:35.765096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b90695be-8d9b-4fb2-a666-b6adb48fbe24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b453a65d1fe0497c9b809ee190ad569a', 'request_id': 'req-b90695be-8d9b-4fb2-a666-b6adb48fbe24'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:35.779329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b90695be-8d9b-4fb2-a666-b6adb48fbe24 admin admin] The token cache is being invalidate because project b453a65d1fe0497c9b809ee190ad569a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:35.779754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b90695be-8d9b-4fb2-a666-b6adb48fbe24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:35.780445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b90695be-8d9b-4fb2-a666-b6adb48fbe24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:35.782806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 905/1777] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:35 2022] DELETE /identity/v3/projects/b453a65d1fe0497c9b809ee190ad569a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:35.788665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd5e4-8c43-40d7-81f1-b260d1e3c39b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:35.788973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd5e4-8c43-40d7-81f1-b260d1e3c39b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:35.789261 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd5e4-8c43-40d7-81f1-b260d1e3c39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:35.813052 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8cbcd5e4-8c43-40d7-81f1-b260d1e3c39b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:35.814384 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8cbcd5e4-8c43-40d7-81f1-b260d1e3c39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:35.819690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4d009-e5fa-4043-a6d0-89c814018403 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:35.846143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:35.902614 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4ae46-3925-414a-8dcf-cf5ce0f1d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:35.903629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4ae46-3925-414a-8dcf-cf5ce0f1d247 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:35.904122 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4ae46-3925-414a-8dcf-cf5ce0f1d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:35.904459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4ae46-3925-414a-8dcf-cf5ce0f1d247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:35.905398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4ae46-3925-414a-8dcf-cf5ce0f1d247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:35.907394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4ae46-3925-414a-8dcf-cf5ce0f1d247 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:35.913971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 906/1778] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:35.920293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 873/1779] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:33:35.921705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91919630-8b05-4994-a1c3-a5531c47f19b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:35.921997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91919630-8b05-4994-a1c3-a5531c47f19b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:35.922278 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91919630-8b05-4994-a1c3-a5531c47f19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:35.925857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4ae46-3925-414a-8dcf-cf5ce0f1d247 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:35.929370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d8a4ae46-3925-414a-8dcf-cf5ce0f1d247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:35.945856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-91919630-8b05-4994-a1c3-a5531c47f19b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:35.946928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-91919630-8b05-4994-a1c3-a5531c47f19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:35.960213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 907/1780] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:35.965252 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91919630-8b05-4994-a1c3-a5531c47f19b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:35.971119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4ae46-3925-414a-8dcf-cf5ce0f1d247 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:35.977298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2324cc1-a39b-44f8-b722-3a1a128c85e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:35.978060 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2324cc1-a39b-44f8-b722-3a1a128c85e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:35.978927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2324cc1-a39b-44f8-b722-3a1a128c85e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:35.979577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2324cc1-a39b-44f8-b722-3a1a128c85e4 admin admin] PATH_INFO: `/v3/projects/f1a6fb12fdcd44dea20f3969da5fd20c/users/611fefbd1dc043488d347497fb480b6d/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:35.983022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2324cc1-a39b-44f8-b722-3a1a128c85e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a6fb12fdcd44dea20f3969da5fd20c, user_id=611fefbd1dc043488d347497fb480b6d, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:35.987928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2324cc1-a39b-44f8-b722-3a1a128c85e4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:35.989119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91919630-8b05-4994-a1c3-a5531c47f19b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:35.995831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839d165-54c2-48f8-8dcd-de13e0e409b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:35.996993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839d165-54c2-48f8-8dcd-de13e0e409b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:35.997475 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839d165-54c2-48f8-8dcd-de13e0e409b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:35.997923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839d165-54c2-48f8-8dcd-de13e0e409b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:35.998825 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839d165-54c2-48f8-8dcd-de13e0e409b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:33:35.999334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839d165-54c2-48f8-8dcd-de13e0e409b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:36.001046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839d165-54c2-48f8-8dcd-de13e0e409b8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:36.004033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 874/1781] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:35 2022] PUT /identity/v3/projects/f1a6fb12fdcd44dea20f3969da5fd20c/users/611fefbd1dc043488d347497fb480b6d/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:36.016278 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55566cad-4dec-46b5-915e-19df329638f8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:36.023107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55566cad-4dec-46b5-915e-19df329638f8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:36.023501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55566cad-4dec-46b5-915e-19df329638f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:36.027890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 908/1782] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:33:36.029250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839d165-54c2-48f8-8dcd-de13e0e409b8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:36.039677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839d165-54c2-48f8-8dcd-de13e0e409b8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:36.058298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-55566cad-4dec-46b5-915e-19df329638f8 None None] MFA Rules not processed for user `611fefbd1dc043488d347497fb480b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:36.059516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-55566cad-4dec-46b5-915e-19df329638f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:36.104419 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97372f9a-b62b-40f7-ab20-467434aa76c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:36.105205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97372f9a-b62b-40f7-ab20-467434aa76c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:36.105494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97372f9a-b62b-40f7-ab20-467434aa76c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:36.105780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97372f9a-b62b-40f7-ab20-467434aa76c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:36.106950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97372f9a-b62b-40f7-ab20-467434aa76c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:36.109902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97372f9a-b62b-40f7-ab20-467434aa76c2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:36.143989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 875/1783] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:36.153320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 909/1784] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:36 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:33:36.156765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55566cad-4dec-46b5-915e-19df329638f8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:36.157503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97372f9a-b62b-40f7-ab20-467434aa76c2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:36.158436 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-55566cad-4dec-46b5-915e-19df329638f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:36.214817 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:36.242255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55566cad-4dec-46b5-915e-19df329638f8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:36.258789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97372f9a-b62b-40f7-ab20-467434aa76c2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:36.269308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61feaff1-bcfb-4d59-9cb2-60784608df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:36.269968 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feaff1-bcfb-4d59-9cb2-60784608df73 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:36.270248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feaff1-bcfb-4d59-9cb2-60784608df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:36.271292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feaff1-bcfb-4d59-9cb2-60784608df73 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:36.271995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61feaff1-bcfb-4d59-9cb2-60784608df73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:36.274418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61feaff1-bcfb-4d59-9cb2-60784608df73 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:36.295890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:36.304948 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 910/1785] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:36 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:33:36.311631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61feaff1-bcfb-4d59-9cb2-60784608df73 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:36.318072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b1079-2eb4-4278-9f69-f1f718b4094c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:36.318636 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b1079-2eb4-4278-9f69-f1f718b4094c service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:36.319112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b1079-2eb4-4278-9f69-f1f718b4094c service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:36.319404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b1079-2eb4-4278-9f69-f1f718b4094c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:36.330131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61feaff1-bcfb-4d59-9cb2-60784608df73 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:36.339383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559c112-5d5e-4a15-bcd2-d548c9cdc576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:36.340026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559c112-5d5e-4a15-bcd2-d548c9cdc576 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:36.340316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559c112-5d5e-4a15-bcd2-d548c9cdc576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:36.340599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559c112-5d5e-4a15-bcd2-d548c9cdc576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:36.341358 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559c112-5d5e-4a15-bcd2-d548c9cdc576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:36.343017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559c112-5d5e-4a15-bcd2-d548c9cdc576 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:36.354769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 911/1786] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:33:36.358763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559c112-5d5e-4a15-bcd2-d548c9cdc576 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:36.388334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559c112-5d5e-4a15-bcd2-d548c9cdc576 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:36.394464 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3152c-849a-4fe6-bbaf-657f73631bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:36.395107 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3152c-849a-4fe6-bbaf-657f73631bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:36.395394 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3152c-849a-4fe6-bbaf-657f73631bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:36.395669 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3152c-849a-4fe6-bbaf-657f73631bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:36.396380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3152c-849a-4fe6-bbaf-657f73631bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:36.398010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3152c-849a-4fe6-bbaf-657f73631bd4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:36.416538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 912/1787] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:36.422111 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3152c-849a-4fe6-bbaf-657f73631bd4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:36.438947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3152c-849a-4fe6-bbaf-657f73631bd4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:36.445591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97a8ea-79da-4b17-b688-c9b4fe06af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:36.446279 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97a8ea-79da-4b17-b688-c9b4fe06af20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:36.446560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97a8ea-79da-4b17-b688-c9b4fe06af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:36.447916 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97a8ea-79da-4b17-b688-c9b4fe06af20 admin admin] PATH_INFO: `/v3/projects/3254221cba0a4f069c3446901f9a5658/users/d333614852da442cb9af657c03d267c8/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:36.460437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b1079-2eb4-4278-9f69-f1f718b4094c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:36.461923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b1079-2eb4-4278-9f69-f1f718b4094c service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:36.474770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97a8ea-79da-4b17-b688-c9b4fe06af20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3254221cba0a4f069c3446901f9a5658, user_id=d333614852da442cb9af657c03d267c8, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:36.478731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97a8ea-79da-4b17-b688-c9b4fe06af20 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:36.488357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 876/1788] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:33:36.501838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 913/1789] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:36 2022] PUT /identity/v3/projects/3254221cba0a4f069c3446901f9a5658/users/d333614852da442cb9af657c03d267c8/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:36.513521 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027e38-0d80-4c9c-90fb-67013b95d7e9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:36.513810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027e38-0d80-4c9c-90fb-67013b95d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:36.514203 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027e38-0d80-4c9c-90fb-67013b95d7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:36.594025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ab027e38-0d80-4c9c-90fb-67013b95d7e9 None None] MFA Rules not processed for user `d333614852da442cb9af657c03d267c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:36.595287 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ab027e38-0d80-4c9c-90fb-67013b95d7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:36.642546 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97a8ea-79da-4b17-b688-c9b4fe06af20 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:36.721011 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97a8ea-79da-4b17-b688-c9b4fe06af20 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:36.725802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942e7a0-edf4-42ad-8967-f29ae2e931ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:36.726664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e7a0-edf4-42ad-8967-f29ae2e931ca service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:36.726885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e7a0-edf4-42ad-8967-f29ae2e931ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:36.727291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e7a0-edf4-42ad-8967-f29ae2e931ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:36.741259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 877/1790] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:36.742389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0942e7a0-edf4-42ad-8967-f29ae2e931ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:36.743407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027e38-0d80-4c9c-90fb-67013b95d7e9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:36.848129 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942e7a0-edf4-42ad-8967-f29ae2e931ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:36.850630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942e7a0-edf4-42ad-8967-f29ae2e931ca service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:36.866920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 914/1791] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:33:36.868224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027e38-0d80-4c9c-90fb-67013b95d7e9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:36.874630 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872cd37-120e-4c2e-a399-cf26d3f292ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:36.875364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872cd37-120e-4c2e-a399-cf26d3f292ac admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:36.875770 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872cd37-120e-4c2e-a399-cf26d3f292ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:36.876217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872cd37-120e-4c2e-a399-cf26d3f292ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:36.877233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872cd37-120e-4c2e-a399-cf26d3f292ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:36.879281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872cd37-120e-4c2e-a399-cf26d3f292ac admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:36.916430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 878/1792] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:36 2022] POST /identity/v3/projects => generated 389 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:33:36.920642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942e7a0-edf4-42ad-8967-f29ae2e931ca service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:36.937490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942e7a0-edf4-42ad-8967-f29ae2e931ca service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:36.974026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:37.005684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb912657-f31e-45ea-922d-56b9fa6cbbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:37.006484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb912657-f31e-45ea-922d-56b9fa6cbbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:37.006777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb912657-f31e-45ea-922d-56b9fa6cbbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:37.007044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb912657-f31e-45ea-922d-56b9fa6cbbc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:37.007792 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb912657-f31e-45ea-922d-56b9fa6cbbc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:37.010101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb912657-f31e-45ea-922d-56b9fa6cbbc5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:37.034352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 915/1793] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:36 2022] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:33:37.038452 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872cd37-120e-4c2e-a399-cf26d3f292ac admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:37.049111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872cd37-120e-4c2e-a399-cf26d3f292ac admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:37.053835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07c62a-7e4b-44e0-98dd-29d1fee89cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:37.054446 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07c62a-7e4b-44e0-98dd-29d1fee89cef admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:37.054727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07c62a-7e4b-44e0-98dd-29d1fee89cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:37.055001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07c62a-7e4b-44e0-98dd-29d1fee89cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:37.055736 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07c62a-7e4b-44e0-98dd-29d1fee89cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:37.057487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07c62a-7e4b-44e0-98dd-29d1fee89cef admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:37.059611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:37.073069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 879/1794] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:37.074468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb912657-f31e-45ea-922d-56b9fa6cbbc5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:37.084667 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb912657-f31e-45ea-922d-56b9fa6cbbc5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:37.090422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887201-3d8f-46c4-9fb1-fbbb1d9ae35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:37.091088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887201-3d8f-46c4-9fb1-fbbb1d9ae35d admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:37.091369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887201-3d8f-46c4-9fb1-fbbb1d9ae35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:37.091644 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887201-3d8f-46c4-9fb1-fbbb1d9ae35d admin admin] PATH_INFO: `/v3/projects/74574b2c683a4911bff50474c669aaa4/users/14c77935c0a243569a81a22540c50f94/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:37.107861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85887201-3d8f-46c4-9fb1-fbbb1d9ae35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74574b2c683a4911bff50474c669aaa4, user_id=14c77935c0a243569a81a22540c50f94, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:37.110535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85887201-3d8f-46c4-9fb1-fbbb1d9ae35d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:37.123348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 916/1795] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:37 2022] PUT /identity/v3/projects/74574b2c683a4911bff50474c669aaa4/users/14c77935c0a243569a81a22540c50f94/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:37.127509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07c62a-7e4b-44e0-98dd-29d1fee89cef admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:37.138138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07c62a-7e4b-44e0-98dd-29d1fee89cef admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:37.197412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc4641-adab-46da-949e-30fc6375e5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:37.198038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc4641-adab-46da-949e-30fc6375e5df admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:37.198317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc4641-adab-46da-949e-30fc6375e5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:37.198591 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc4641-adab-46da-949e-30fc6375e5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:37.199311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc4641-adab-46da-949e-30fc6375e5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:37.200895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc4641-adab-46da-949e-30fc6375e5df admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:37.211959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 880/1796] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:37.216691 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887201-3d8f-46c4-9fb1-fbbb1d9ae35d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:37.227095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887201-3d8f-46c4-9fb1-fbbb1d9ae35d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:37.232392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08839d1d-f04e-40e9-84a3-3c19aaee0779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:37.233083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08839d1d-f04e-40e9-84a3-3c19aaee0779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:37.233370 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08839d1d-f04e-40e9-84a3-3c19aaee0779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:37.233678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08839d1d-f04e-40e9-84a3-3c19aaee0779 admin admin] PATH_INFO: `/v3/projects/74574b2c683a4911bff50474c669aaa4/users/14c77935c0a243569a81a22540c50f94/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:37.235632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08839d1d-f04e-40e9-84a3-3c19aaee0779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74574b2c683a4911bff50474c669aaa4, user_id=14c77935c0a243569a81a22540c50f94, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:37.238325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08839d1d-f04e-40e9-84a3-3c19aaee0779 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:37.248493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 917/1797] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:37 2022] PUT /identity/v3/projects/74574b2c683a4911bff50474c669aaa4/users/14c77935c0a243569a81a22540c50f94/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:37.259273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0dc5c-0048-43f0-85ae-4b666fdab599 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:37.259733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0dc5c-0048-43f0-85ae-4b666fdab599 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:37.260017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0dc5c-0048-43f0-85ae-4b666fdab599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:37.287484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-67a0dc5c-0048-43f0-85ae-4b666fdab599 None None] MFA Rules not processed for user `14c77935c0a243569a81a22540c50f94`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:37.288670 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-67a0dc5c-0048-43f0-85ae-4b666fdab599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:37.356741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 881/1798] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:37 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:37.367802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08839d1d-f04e-40e9-84a3-3c19aaee0779 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:37.428530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08839d1d-f04e-40e9-84a3-3c19aaee0779 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:37.432738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc0fa6-264f-4d6e-84b7-5282578e53d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:37.433312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc0fa6-264f-4d6e-84b7-5282578e53d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:37.433593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc0fa6-264f-4d6e-84b7-5282578e53d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:37.436295 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc0fa6-264f-4d6e-84b7-5282578e53d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:37.450613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc0fa6-264f-4d6e-84b7-5282578e53d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:37.452040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc0fa6-264f-4d6e-84b7-5282578e53d1 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:37.461961 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 918/1799] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:37 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:37.615817 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0dc5c-0048-43f0-85ae-4b666fdab599 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:37.752541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0dc5c-0048-43f0-85ae-4b666fdab599 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:37.758543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:37.759368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:37.760021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:37.760779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] PATH_INFO: `/v3/users/d333614852da442cb9af657c03d267c8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:37.762156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d333614852da442cb9af657c03d267c8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:37.764494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:37.807460 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:37.869796 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd333614852da442cb9af657c03d267c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:37.883413 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd333614852da442cb9af657c03d267c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:37.910778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd333614852da442cb9af657c03d267c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:37.912123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd333614852da442cb9af657c03d267c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:37.913143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd333614852da442cb9af657c03d267c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:37.962762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 882/1800] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:37 2022] DELETE /identity/v3/users/d333614852da442cb9af657c03d267c8 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:37.976924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25760853-6905-409c-8eb4-1108664025cc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:37.976924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25760853-6905-409c-8eb4-1108664025cc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:37.976924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25760853-6905-409c-8eb4-1108664025cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:38.003956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-25760853-6905-409c-8eb4-1108664025cc None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:38.008750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-25760853-6905-409c-8eb4-1108664025cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:38.114706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:38.116451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:38.196706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 919/1801] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:38.257207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25760853-6905-409c-8eb4-1108664025cc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:38.264729 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-25760853-6905-409c-8eb4-1108664025cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:38.308459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8dcf3-0ca1-4a94-ab30-f06c7c1bc0f8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:38.318776 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721fd40-f09d-4bed-95e7-979d12332357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:38.319570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721fd40-f09d-4bed-95e7-979d12332357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:38.319930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721fd40-f09d-4bed-95e7-979d12332357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:38.320283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721fd40-f09d-4bed-95e7-979d12332357 admin admin] PATH_INFO: `/v3/users/a7c2cc652e5b48818c20ca1070f5a9d8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:38.323111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721fd40-f09d-4bed-95e7-979d12332357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c2cc652e5b48818c20ca1070f5a9d8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:38.325216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721fd40-f09d-4bed-95e7-979d12332357 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:38.385857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:38.426517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c721fd40-f09d-4bed-95e7-979d12332357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c2cc652e5b48818c20ca1070f5a9d8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:38.444714 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c721fd40-f09d-4bed-95e7-979d12332357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c2cc652e5b48818c20ca1070f5a9d8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:38.465240 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25760853-6905-409c-8eb4-1108664025cc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:38.476653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c721fd40-f09d-4bed-95e7-979d12332357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c2cc652e5b48818c20ca1070f5a9d8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:38.477117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c721fd40-f09d-4bed-95e7-979d12332357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c2cc652e5b48818c20ca1070f5a9d8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:38.477944 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a420a-f55f-42e4-accb-195a7144f8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:38.478074 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c721fd40-f09d-4bed-95e7-979d12332357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c2cc652e5b48818c20ca1070f5a9d8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:38.495350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a420a-f55f-42e4-accb-195a7144f8ab service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:38.495974 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a420a-f55f-42e4-accb-195a7144f8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:38.497725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a420a-f55f-42e4-accb-195a7144f8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:38.502280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 883/1802] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:38 2022] DELETE /identity/v3/users/a7c2cc652e5b48818c20ca1070f5a9d8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:38.503517 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5d3a420a-f55f-42e4-accb-195a7144f8ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:38.506896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722b09b-dda2-439a-abb4-1875408a9cce None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:38.507344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722b09b-dda2-439a-abb4-1875408a9cce None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:38.508447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722b09b-dda2-439a-abb4-1875408a9cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:38.534589 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a420a-f55f-42e4-accb-195a7144f8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:38.539253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a420a-f55f-42e4-accb-195a7144f8ab service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:38.569177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e722b09b-dda2-439a-abb4-1875408a9cce None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:38.571068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e722b09b-dda2-439a-abb4-1875408a9cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:38.578966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 920/1803] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:33:38.604442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:38.682584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9f382-f222-4eea-8c91-ae19342c008d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:38.682901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9f382-f222-4eea-8c91-ae19342c008d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:38.683191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9f382-f222-4eea-8c91-ae19342c008d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:38.685374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 921/1804] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:33:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:33:38.706024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa474945-cfed-490e-9f6e-626842b366e2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:38.706206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa474945-cfed-490e-9f6e-626842b366e2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:38.706390 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa474945-cfed-490e-9f6e-626842b366e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:38.747646 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 884/1805] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:38.765210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fa474945-cfed-490e-9f6e-626842b366e2 None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:38.766312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fa474945-cfed-490e-9f6e-626842b366e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:38.878061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722b09b-dda2-439a-abb4-1875408a9cce None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:38.881376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e722b09b-dda2-439a-abb4-1875408a9cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:38.919626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 922/1806] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:38.935566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa474945-cfed-490e-9f6e-626842b366e2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:38.937572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fa474945-cfed-490e-9f6e-626842b366e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:38.956067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa474945-cfed-490e-9f6e-626842b366e2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:38.966091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6608d-8c44-4e14-8001-5072979ecccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:38.966750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6608d-8c44-4e14-8001-5072979ecccf service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:38.967035 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6608d-8c44-4e14-8001-5072979ecccf service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:38.967345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6608d-8c44-4e14-8001-5072979ecccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:38.976718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722b09b-dda2-439a-abb4-1875408a9cce None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:38.978650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6608d-8c44-4e14-8001-5072979ecccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:38.980646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6608d-8c44-4e14-8001-5072979ecccf service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:38.988019 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194b0e0-e856-47f0-8947-8d5ae32680ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:38.988675 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194b0e0-e856-47f0-8947-8d5ae32680ca service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:38.988990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194b0e0-e856-47f0-8947-8d5ae32680ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:38.989276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194b0e0-e856-47f0-8947-8d5ae32680ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:39.008319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 923/1807] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:39.017626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194b0e0-e856-47f0-8947-8d5ae32680ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:39.019106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194b0e0-e856-47f0-8947-8d5ae32680ca service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:39.037827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 885/1808] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:40.210108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6608d-8c44-4e14-8001-5072979ecccf service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:40.212142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-01d6608d-8c44-4e14-8001-5072979ecccf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:40.246558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6608d-8c44-4e14-8001-5072979ecccf service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:40.256526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:40.257230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:40.257518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:40.257801 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] PATH_INFO: `/v3/projects/3254221cba0a4f069c3446901f9a5658` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:40.266789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3254221cba0a4f069c3446901f9a5658)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:40.269317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:40.390484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3254221cba0a4f069c3446901f9a5658', 'request_id': 'req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:40.416523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3254221cba0a4f069c3446901f9a5658', 'request_id': 'req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:40.447515 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3254221cba0a4f069c3446901f9a5658', 'request_id': 'req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:40.481427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] The token cache is being invalidate because project 3254221cba0a4f069c3446901f9a5658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:40.481733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:40.482471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:40.484785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 924/1809] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:40 2022] DELETE /identity/v3/projects/3254221cba0a4f069c3446901f9a5658 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:40.488792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194b0e0-e856-47f0-8947-8d5ae32680ca service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:40.506073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194b0e0-e856-47f0-8947-8d5ae32680ca service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:40.630079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:40.630748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:40.631964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:40.632344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] PATH_INFO: `/v3/users/14c77935c0a243569a81a22540c50f94` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:40.635785 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c77935c0a243569a81a22540c50f94)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:40.638465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:40.742171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c77935c0a243569a81a22540c50f94'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:40.766935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c77935c0a243569a81a22540c50f94'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:40.778580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:40.794048 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c77935c0a243569a81a22540c50f94'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:40.794890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c77935c0a243569a81a22540c50f94'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:40.795706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c77935c0a243569a81a22540c50f94'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:40.799931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:40.801452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:40.825516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1e26e-2b3f-42f0-b00d-ac2a4d174e17 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:40.828443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 886/1810] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:40 2022] DELETE /identity/v3/users/14c77935c0a243569a81a22540c50f94 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:40.889422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:40.930085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:40.931042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:40.932213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:40.932599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] PATH_INFO: `/v3/projects/d4f20342192046699f6a910781f2e730` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:40.934496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f20342192046699f6a910781f2e730)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:40.938194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:41.029117 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f20342192046699f6a910781f2e730', 'request_id': 'req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:41.039809 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f20342192046699f6a910781f2e730', 'request_id': 'req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:41.052760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f20342192046699f6a910781f2e730', 'request_id': 'req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:41.071549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] The token cache is being invalidate because project d4f20342192046699f6a910781f2e730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:41.072935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:41.099489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:41.107254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 925/1811] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:40 2022] DELETE /identity/v3/projects/d4f20342192046699f6a910781f2e730 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:41.112048 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:41.115038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:41.150667 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69ea51-0fb7-4b75-8c56-38eda44b2783 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:41.304869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39718e-d8cd-4ebc-919c-8d9c011f65a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:41.307834 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39718e-d8cd-4ebc-919c-8d9c011f65a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:41.308376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39718e-d8cd-4ebc-919c-8d9c011f65a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:41.310062 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39718e-d8cd-4ebc-919c-8d9c011f65a7 admin admin] PATH_INFO: `/v3/users/b35a22d38a9e4ed5853e9687d2e24cd3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:41.312241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39718e-d8cd-4ebc-919c-8d9c011f65a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35a22d38a9e4ed5853e9687d2e24cd3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:41.319255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39718e-d8cd-4ebc-919c-8d9c011f65a7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:41.407985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7e39718e-d8cd-4ebc-919c-8d9c011f65a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35a22d38a9e4ed5853e9687d2e24cd3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:41.427669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7e39718e-d8cd-4ebc-919c-8d9c011f65a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35a22d38a9e4ed5853e9687d2e24cd3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:41.485575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7e39718e-d8cd-4ebc-919c-8d9c011f65a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35a22d38a9e4ed5853e9687d2e24cd3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:41.486613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7e39718e-d8cd-4ebc-919c-8d9c011f65a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35a22d38a9e4ed5853e9687d2e24cd3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:41.488498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7e39718e-d8cd-4ebc-919c-8d9c011f65a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35a22d38a9e4ed5853e9687d2e24cd3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:41.516777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 887/1812] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:41 2022] DELETE /identity/v3/users/b35a22d38a9e4ed5853e9687d2e24cd3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:41.901690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:41.903873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:41.918771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522d075-5bab-4a0d-b9ca-e76caf7a20fa admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:42.034933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:42.036046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.037788 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.038276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] PATH_INFO: `/v3/projects/74574b2c683a4911bff50474c669aaa4` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.043832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=74574b2c683a4911bff50474c669aaa4)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:42.049772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:42.147342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74574b2c683a4911bff50474c669aaa4', 'request_id': 'req-219b84ad-634b-4702-85bc-2f62c0d1cb1c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:42.156946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74574b2c683a4911bff50474c669aaa4', 'request_id': 'req-219b84ad-634b-4702-85bc-2f62c0d1cb1c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:42.169895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74574b2c683a4911bff50474c669aaa4', 'request_id': 'req-219b84ad-634b-4702-85bc-2f62c0d1cb1c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:42.172185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:42.193124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] The token cache is being invalidate because project 74574b2c683a4911bff50474c669aaa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:42.193433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:42.194841 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:42.196701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 926/1813] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:41 2022] DELETE /identity/v3/projects/74574b2c683a4911bff50474c669aaa4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:42.201924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12238cb5-ee2d-4efb-b4b6-7ed366c2cf10 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.202412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12238cb5-ee2d-4efb-b4b6-7ed366c2cf10 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.202986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12238cb5-ee2d-4efb-b4b6-7ed366c2cf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.227313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-12238cb5-ee2d-4efb-b4b6-7ed366c2cf10 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:42.229430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-12238cb5-ee2d-4efb-b4b6-7ed366c2cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:42.296335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:42.315178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 888/1814] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:42.318477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:42.322070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f0c71-58ca-4bbd-a124-782467a2b704 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.322428 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f0c71-58ca-4bbd-a124-782467a2b704 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.322647 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f0c71-58ca-4bbd-a124-782467a2b704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.323099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:42.342161 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b84ad-634b-4702-85bc-2f62c0d1cb1c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:42.344832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bc8f0c71-58ca-4bbd-a124-782467a2b704 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:42.346205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bc8f0c71-58ca-4bbd-a124-782467a2b704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:42.348245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067403a4-67b4-4b79-95f3-0910a5e1da8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:42.349245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067403a4-67b4-4b79-95f3-0910a5e1da8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.350464 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067403a4-67b4-4b79-95f3-0910a5e1da8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.351084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067403a4-67b4-4b79-95f3-0910a5e1da8a admin admin] PATH_INFO: `/v3/projects/26a84d4b8fdf41b286b8ca8a10d3c926` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.362236 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067403a4-67b4-4b79-95f3-0910a5e1da8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a84d4b8fdf41b286b8ca8a10d3c926)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:42.374093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 889/1815] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:42.374755 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067403a4-67b4-4b79-95f3-0910a5e1da8a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:42.376640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f0c71-58ca-4bbd-a124-782467a2b704 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:42.395372 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f0c71-58ca-4bbd-a124-782467a2b704 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:42.403997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154192-9d2b-4d82-8247-1e8a60d5de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:42.406222 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154192-9d2b-4d82-8247-1e8a60d5de52 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.407009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154192-9d2b-4d82-8247-1e8a60d5de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.407494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154192-9d2b-4d82-8247-1e8a60d5de52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.408714 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f154192-9d2b-4d82-8247-1e8a60d5de52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:33:42.409366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f154192-9d2b-4d82-8247-1e8a60d5de52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:42.424130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f154192-9d2b-4d82-8247-1e8a60d5de52 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:42.449067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 890/1816] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:33:42.454461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154192-9d2b-4d82-8247-1e8a60d5de52 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:42.471807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154192-9d2b-4d82-8247-1e8a60d5de52 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:42.479954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-067403a4-67b4-4b79-95f3-0910a5e1da8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a84d4b8fdf41b286b8ca8a10d3c926', 'request_id': 'req-067403a4-67b4-4b79-95f3-0910a5e1da8a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:42.495085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-067403a4-67b4-4b79-95f3-0910a5e1da8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a84d4b8fdf41b286b8ca8a10d3c926', 'request_id': 'req-067403a4-67b4-4b79-95f3-0910a5e1da8a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:42.508080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-067403a4-67b4-4b79-95f3-0910a5e1da8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a84d4b8fdf41b286b8ca8a10d3c926', 'request_id': 'req-067403a4-67b4-4b79-95f3-0910a5e1da8a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:42.536481 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-067403a4-67b4-4b79-95f3-0910a5e1da8a admin admin] The token cache is being invalidate because project 26a84d4b8fdf41b286b8ca8a10d3c926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:42.536773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-067403a4-67b4-4b79-95f3-0910a5e1da8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:42.540385 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-067403a4-67b4-4b79-95f3-0910a5e1da8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:42.546074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 927/1817] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:42 2022] DELETE /identity/v3/projects/26a84d4b8fdf41b286b8ca8a10d3c926 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:42.551143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ac3be-2c3c-46ec-b98b-c3e8528cf236 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.551543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ac3be-2c3c-46ec-b98b-c3e8528cf236 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.552845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ac3be-2c3c-46ec-b98b-c3e8528cf236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.589299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0b2ac3be-2c3c-46ec-b98b-c3e8528cf236 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:42.590950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0b2ac3be-2c3c-46ec-b98b-c3e8528cf236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:42.603117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f57fd-210b-49d3-9685-c3aaf775e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:42.603917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f57fd-210b-49d3-9685-c3aaf775e706 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.604191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f57fd-210b-49d3-9685-c3aaf775e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.604640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f57fd-210b-49d3-9685-c3aaf775e706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.605617 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f57fd-210b-49d3-9685-c3aaf775e706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:42.608044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f57fd-210b-49d3-9685-c3aaf775e706 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:42.652659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 891/1818] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:42 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:42.654064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f57fd-210b-49d3-9685-c3aaf775e706 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:42.656051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7a9f57fd-210b-49d3-9685-c3aaf775e706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:42.681106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 928/1819] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:42.685441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205831f-9edf-4046-b214-7bdac760cc30 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.685922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205831f-9edf-4046-b214-7bdac760cc30 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.686466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205831f-9edf-4046-b214-7bdac760cc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.713634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a205831f-9edf-4046-b214-7bdac760cc30 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:42.715009 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a205831f-9edf-4046-b214-7bdac760cc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:42.726880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f57fd-210b-49d3-9685-c3aaf775e706 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:42.729506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 929/1820] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:42.733815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205831f-9edf-4046-b214-7bdac760cc30 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:42.737516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3d280-cc20-41a8-980e-83af90684e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:42.738165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d280-cc20-41a8-980e-83af90684e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.738449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d280-cc20-41a8-980e-83af90684e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.738729 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d280-cc20-41a8-980e-83af90684e20 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.739570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3d280-cc20-41a8-980e-83af90684e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:42.741555 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3d280-cc20-41a8-980e-83af90684e20 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:42.745673 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205831f-9edf-4046-b214-7bdac760cc30 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:42.751209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc20d56-1257-40cb-9751-46d6983cd84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:42.752028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc20d56-1257-40cb-9751-46d6983cd84b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.752434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc20d56-1257-40cb-9751-46d6983cd84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.752856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc20d56-1257-40cb-9751-46d6983cd84b admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.753813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc20d56-1257-40cb-9751-46d6983cd84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:33:42.754163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc20d56-1257-40cb-9751-46d6983cd84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:42.756173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc20d56-1257-40cb-9751-46d6983cd84b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:42.765110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 892/1821] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:42 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:42.769370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3d280-cc20-41a8-980e-83af90684e20 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:42.777927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 930/1822] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:33:42.779064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc20d56-1257-40cb-9751-46d6983cd84b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:42.782124 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3d280-cc20-41a8-980e-83af90684e20 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:42.788137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfd272-0d12-4560-871a-80a50a10c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:42.788701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfd272-0d12-4560-871a-80a50a10c47b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.789031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfd272-0d12-4560-871a-80a50a10c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.789306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfd272-0d12-4560-871a-80a50a10c47b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.790015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfd272-0d12-4560-871a-80a50a10c47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:42.790305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc20d56-1257-40cb-9751-46d6983cd84b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:42.791662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfd272-0d12-4560-871a-80a50a10c47b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:42.797421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afd1ce-375b-486b-bce9-3af583764a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:42.798617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afd1ce-375b-486b-bce9-3af583764a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.798617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afd1ce-375b-486b-bce9-3af583764a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.798811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afd1ce-375b-486b-bce9-3af583764a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.799360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afd1ce-375b-486b-bce9-3af583764a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:42.801311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afd1ce-375b-486b-bce9-3af583764a92 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:42.807480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 893/1823] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:33:42.809228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfd272-0d12-4560-871a-80a50a10c47b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:42.821211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfd272-0d12-4560-871a-80a50a10c47b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:42.830163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a8ca1-3d7a-428a-bd26-20afc8df0f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:42.830807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a8ca1-3d7a-428a-bd26-20afc8df0f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.831118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a8ca1-3d7a-428a-bd26-20afc8df0f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.831391 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a8ca1-3d7a-428a-bd26-20afc8df0f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.832090 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a8ca1-3d7a-428a-bd26-20afc8df0f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:42.834417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a8ca1-3d7a-428a-bd26-20afc8df0f6a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:42.839124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 931/1824] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:42 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:42.843467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afd1ce-375b-486b-bce9-3af583764a92 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:42.871538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 894/1825] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:42.873469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a8ca1-3d7a-428a-bd26-20afc8df0f6a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:42.894133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a8ca1-3d7a-428a-bd26-20afc8df0f6a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:42.920091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:42.945241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:42.963679 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afd1ce-375b-486b-bce9-3af583764a92 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:42.972221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bef2f-d9a0-4d39-b6ee-7f4c522855b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:42.973475 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bef2f-d9a0-4d39-b6ee-7f4c522855b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.974413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bef2f-d9a0-4d39-b6ee-7f4c522855b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.976139 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bef2f-d9a0-4d39-b6ee-7f4c522855b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:42.977155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bef2f-d9a0-4d39-b6ee-7f4c522855b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:42.981589 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bef2f-d9a0-4d39-b6ee-7f4c522855b1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:42.982824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf65ffb-a781-4177-a683-55a5801f1264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:42.983799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf65ffb-a781-4177-a683-55a5801f1264 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:42.984163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf65ffb-a781-4177-a683-55a5801f1264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:42.984518 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf65ffb-a781-4177-a683-55a5801f1264 admin admin] PATH_INFO: `/v3/projects/4591fa59eaae46749bb89ae4e1956e02/users/1c4b2654fa2b4e50910e67bc119ddff3/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:43.006588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf65ffb-a781-4177-a683-55a5801f1264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4591fa59eaae46749bb89ae4e1956e02, user_id=1c4b2654fa2b4e50910e67bc119ddff3, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:43.009867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf65ffb-a781-4177-a683-55a5801f1264 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:43.021476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 932/1826] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:42 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:33:43.026399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bef2f-d9a0-4d39-b6ee-7f4c522855b1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:43.028784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 895/1827] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:42 2022] PUT /identity/v3/projects/4591fa59eaae46749bb89ae4e1956e02/users/1c4b2654fa2b4e50910e67bc119ddff3/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:43.038415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bef2f-d9a0-4d39-b6ee-7f4c522855b1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:43.040108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe25a00-091b-4fd6-bcee-853cb673a41b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:43.041216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe25a00-091b-4fd6-bcee-853cb673a41b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:43.041765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe25a00-091b-4fd6-bcee-853cb673a41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:43.080794 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6fe25a00-091b-4fd6-bcee-853cb673a41b None None] MFA Rules not processed for user `1c4b2654fa2b4e50910e67bc119ddff3`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:43.082260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6fe25a00-091b-4fd6-bcee-853cb673a41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:43.117498 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ac186-2774-4cd4-ad6e-cdfd969c7877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:43.118146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ac186-2774-4cd4-ad6e-cdfd969c7877 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:43.119331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ac186-2774-4cd4-ad6e-cdfd969c7877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:43.119845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ac186-2774-4cd4-ad6e-cdfd969c7877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:43.120681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ac186-2774-4cd4-ad6e-cdfd969c7877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:43.122414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ac186-2774-4cd4-ad6e-cdfd969c7877 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:43.136147 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 933/1828] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:43.154887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ac186-2774-4cd4-ad6e-cdfd969c7877 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:43.180089 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ac186-2774-4cd4-ad6e-cdfd969c7877 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:43.202709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911c211-285d-4080-a7bd-e830ea7f5408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:43.203349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911c211-285d-4080-a7bd-e830ea7f5408 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:43.203709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911c211-285d-4080-a7bd-e830ea7f5408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:43.203994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911c211-285d-4080-a7bd-e830ea7f5408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:43.204706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911c211-285d-4080-a7bd-e830ea7f5408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:43.206409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911c211-285d-4080-a7bd-e830ea7f5408 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:43.210581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 896/1829] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:43.213116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe25a00-091b-4fd6-bcee-853cb673a41b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:43.229534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 934/1830] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:43.233659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911c211-285d-4080-a7bd-e830ea7f5408 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:43.240837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe25a00-091b-4fd6-bcee-853cb673a41b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:43.253487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911c211-285d-4080-a7bd-e830ea7f5408 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:43.264722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfc73e-6797-4720-b058-f05109344056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:43.268581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfc73e-6797-4720-b058-f05109344056 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:43.269337 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfc73e-6797-4720-b058-f05109344056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:43.270414 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfc73e-6797-4720-b058-f05109344056 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:43.271373 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfc73e-6797-4720-b058-f05109344056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:43.272143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea31945-bead-4eb1-9d1a-996ddb997bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:43.274336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfc73e-6797-4720-b058-f05109344056 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:43.276091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31945-bead-4eb1-9d1a-996ddb997bec admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:43.276475 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31945-bead-4eb1-9d1a-996ddb997bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:43.276855 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31945-bead-4eb1-9d1a-996ddb997bec admin admin] PATH_INFO: `/v3/projects/c3a4070d23f1410f8ce5d1930750d091/users/e02f449354af45a9a89349306245620e/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:43.323633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea31945-bead-4eb1-9d1a-996ddb997bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a4070d23f1410f8ce5d1930750d091, user_id=e02f449354af45a9a89349306245620e, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:43.329844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea31945-bead-4eb1-9d1a-996ddb997bec admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:43.355248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 897/1831] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:43 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:43.363588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfc73e-6797-4720-b058-f05109344056 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:43.380015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 935/1832] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:43 2022] PUT /identity/v3/projects/c3a4070d23f1410f8ce5d1930750d091/users/e02f449354af45a9a89349306245620e/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:43.392798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f061-c79b-4c13-ad19-3c69dfcd2d64 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:43.393866 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f061-c79b-4c13-ad19-3c69dfcd2d64 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:43.394531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f061-c79b-4c13-ad19-3c69dfcd2d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:43.535120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-75c2f061-c79b-4c13-ad19-3c69dfcd2d64 None None] MFA Rules not processed for user `e02f449354af45a9a89349306245620e`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:43.539525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-75c2f061-c79b-4c13-ad19-3c69dfcd2d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:43.606701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfc73e-6797-4720-b058-f05109344056 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:43.629050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef336c87-339f-4a9c-ab7b-5cbfd2eee758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:43.629683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef336c87-339f-4a9c-ab7b-5cbfd2eee758 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:43.629962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef336c87-339f-4a9c-ab7b-5cbfd2eee758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:43.630238 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef336c87-339f-4a9c-ab7b-5cbfd2eee758 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:43.630919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef336c87-339f-4a9c-ab7b-5cbfd2eee758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:43.639890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef336c87-339f-4a9c-ab7b-5cbfd2eee758 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:43.721956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 898/1833] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:43 2022] POST /identity/v3/users => generated 297 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:43.730819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef336c87-339f-4a9c-ab7b-5cbfd2eee758 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:43.747549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 936/1834] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:43.749968 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2f061-c79b-4c13-ad19-3c69dfcd2d64 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:43.770205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2f061-c79b-4c13-ad19-3c69dfcd2d64 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:43.787250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af4b8b-e41b-4c1c-8005-aa3803c3d7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:43.788080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af4b8b-e41b-4c1c-8005-aa3803c3d7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:43.788524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af4b8b-e41b-4c1c-8005-aa3803c3d7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:43.789113 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af4b8b-e41b-4c1c-8005-aa3803c3d7f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:43.790185 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef336c87-339f-4a9c-ab7b-5cbfd2eee758 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:43.792439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af4b8b-e41b-4c1c-8005-aa3803c3d7f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:43.794578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af4b8b-e41b-4c1c-8005-aa3803c3d7f5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:43.802999 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849b3cb-711b-42e3-b240-082d6696f80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:43.805052 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849b3cb-711b-42e3-b240-082d6696f80b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:43.805697 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849b3cb-711b-42e3-b240-082d6696f80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:43.807820 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849b3cb-711b-42e3-b240-082d6696f80b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:43.809230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849b3cb-711b-42e3-b240-082d6696f80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:43.813176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849b3cb-711b-42e3-b240-082d6696f80b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:43.830516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 899/1835] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:43.838840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849b3cb-711b-42e3-b240-082d6696f80b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:43.866539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:43.874930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:43.883338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849b3cb-711b-42e3-b240-082d6696f80b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:43.897769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51857374-2647-4b51-a9ee-8cd97cc1f666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:43.898563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51857374-2647-4b51-a9ee-8cd97cc1f666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:43.898848 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51857374-2647-4b51-a9ee-8cd97cc1f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:43.899130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51857374-2647-4b51-a9ee-8cd97cc1f666 admin admin] PATH_INFO: `/v3/projects/c042754c880f4dc68c08c2a2ef814408/users/7cc7c25e4d134735867f3a41eafa8c41/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:43.927352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 937/1836] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:43 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:43.928846 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af4b8b-e41b-4c1c-8005-aa3803c3d7f5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:43.975028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51857374-2647-4b51-a9ee-8cd97cc1f666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c042754c880f4dc68c08c2a2ef814408, user_id=7cc7c25e4d134735867f3a41eafa8c41, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:43.977923 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51857374-2647-4b51-a9ee-8cd97cc1f666 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:44.028858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 900/1837] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:43 2022] PUT /identity/v3/projects/c042754c880f4dc68c08c2a2ef814408/users/7cc7c25e4d134735867f3a41eafa8c41/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:44.033077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51857374-2647-4b51-a9ee-8cd97cc1f666 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:44.062811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af4b8b-e41b-4c1c-8005-aa3803c3d7f5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:44.184357 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6db74-775d-4e5d-a7ee-af96520777f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:44.185333 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6db74-775d-4e5d-a7ee-af96520777f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:44.185653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6db74-775d-4e5d-a7ee-af96520777f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:44.185891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6db74-775d-4e5d-a7ee-af96520777f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:44.186572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6db74-775d-4e5d-a7ee-af96520777f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:44.188514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6db74-775d-4e5d-a7ee-af96520777f8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:44.221822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 938/1838] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:43 2022] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:44.224297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51857374-2647-4b51-a9ee-8cd97cc1f666 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:44.226342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6db74-775d-4e5d-a7ee-af96520777f8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:44.232895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677c345-015d-40a8-a473-e95cb847b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:44.233946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677c345-015d-40a8-a473-e95cb847b6dd admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:44.234456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677c345-015d-40a8-a473-e95cb847b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:44.234894 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677c345-015d-40a8-a473-e95cb847b6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:44.235764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677c345-015d-40a8-a473-e95cb847b6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:44.239810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677c345-015d-40a8-a473-e95cb847b6dd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:44.245119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6db74-775d-4e5d-a7ee-af96520777f8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:44.254253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecd317-9db9-4b0d-b56b-e4695d200657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:44.254253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecd317-9db9-4b0d-b56b-e4695d200657 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:44.254253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecd317-9db9-4b0d-b56b-e4695d200657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:44.255128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecd317-9db9-4b0d-b56b-e4695d200657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:44.256018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecd317-9db9-4b0d-b56b-e4695d200657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:44.265997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecd317-9db9-4b0d-b56b-e4695d200657 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:44.266807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 901/1839] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:33:44.271742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677c345-015d-40a8-a473-e95cb847b6dd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:44.279524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 939/1840] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:44.289234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecd317-9db9-4b0d-b56b-e4695d200657 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:44.291953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677c345-015d-40a8-a473-e95cb847b6dd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:44.301008 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00908461-9562-4287-a793-e688ac65be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:44.303994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00908461-9562-4287-a793-e688ac65be7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:44.304866 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecd317-9db9-4b0d-b56b-e4695d200657 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:44.306839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00908461-9562-4287-a793-e688ac65be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:44.308145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00908461-9562-4287-a793-e688ac65be7a admin admin] PATH_INFO: `/v3/projects/c042754c880f4dc68c08c2a2ef814408/users/7cc7c25e4d134735867f3a41eafa8c41/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:44.311688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8fd9-8370-4beb-a38c-52b9ddaf8a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:44.312671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00908461-9562-4287-a793-e688ac65be7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c042754c880f4dc68c08c2a2ef814408, user_id=7cc7c25e4d134735867f3a41eafa8c41, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:44.313863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8fd9-8370-4beb-a38c-52b9ddaf8a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:44.314696 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8fd9-8370-4beb-a38c-52b9ddaf8a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:44.315193 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8fd9-8370-4beb-a38c-52b9ddaf8a6d admin admin] PATH_INFO: `/v3/projects/683c932b65914b1481f63b953c7a9ae9/users/4d28cee4bd5d481891ededc996fee54d/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:44.323322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00908461-9562-4287-a793-e688ac65be7a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:44.340080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 902/1841] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:44 2022] PUT /identity/v3/projects/c042754c880f4dc68c08c2a2ef814408/users/7cc7c25e4d134735867f3a41eafa8c41/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:44.340408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da8fd9-8370-4beb-a38c-52b9ddaf8a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=683c932b65914b1481f63b953c7a9ae9, user_id=4d28cee4bd5d481891ededc996fee54d, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:44.351257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da8fd9-8370-4beb-a38c-52b9ddaf8a6d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:44.354143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f11200-2357-4f8d-8f65-6d7e2e158688 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:44.354751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f11200-2357-4f8d-8f65-6d7e2e158688 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:44.354862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f11200-2357-4f8d-8f65-6d7e2e158688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:44.364499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 940/1842] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:44 2022] PUT /identity/v3/projects/683c932b65914b1481f63b953c7a9ae9/users/4d28cee4bd5d481891ededc996fee54d/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:44.369063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8fd9-8370-4beb-a38c-52b9ddaf8a6d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:44.450844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-81f11200-2357-4f8d-8f65-6d7e2e158688 None None] MFA Rules not processed for user `7cc7c25e4d134735867f3a41eafa8c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:44.453760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-81f11200-2357-4f8d-8f65-6d7e2e158688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:44.482275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:44.488179 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8fd9-8370-4beb-a38c-52b9ddaf8a6d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:44.495454 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b92fc-7b47-4692-8107-7d2ef16efa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:44.497076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b92fc-7b47-4692-8107-7d2ef16efa49 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:44.497569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b92fc-7b47-4692-8107-7d2ef16efa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:44.498060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b92fc-7b47-4692-8107-7d2ef16efa49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:44.499192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b92fc-7b47-4692-8107-7d2ef16efa49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:44.501726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b92fc-7b47-4692-8107-7d2ef16efa49 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:44.521720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 941/1843] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:44.522835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b92fc-7b47-4692-8107-7d2ef16efa49 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:44.538742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b92fc-7b47-4692-8107-7d2ef16efa49 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:44.545034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a9a03-6962-41f5-9630-f56123862898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:44.545902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a9a03-6962-41f5-9630-f56123862898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:44.546291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a9a03-6962-41f5-9630-f56123862898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:44.546676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a9a03-6962-41f5-9630-f56123862898 admin admin] PATH_INFO: `/v3/projects/683c932b65914b1481f63b953c7a9ae9/users/4d28cee4bd5d481891ededc996fee54d/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:44.549273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a9a03-6962-41f5-9630-f56123862898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683c932b65914b1481f63b953c7a9ae9, user_id=4d28cee4bd5d481891ededc996fee54d, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:44.552323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a9a03-6962-41f5-9630-f56123862898 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:44.570652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 942/1844] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:44 2022] PUT /identity/v3/projects/683c932b65914b1481f63b953c7a9ae9/users/4d28cee4bd5d481891ededc996fee54d/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:44.577087 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 903/1845] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:44.582979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642e1c5-43fd-4528-abe2-4d456a55edcc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:44.583290 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642e1c5-43fd-4528-abe2-4d456a55edcc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:44.583991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642e1c5-43fd-4528-abe2-4d456a55edcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:44.592931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f11200-2357-4f8d-8f65-6d7e2e158688 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:44.594612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-81f11200-2357-4f8d-8f65-6d7e2e158688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:44.633798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8642e1c5-43fd-4528-abe2-4d456a55edcc None None] MFA Rules not processed for user `4d28cee4bd5d481891ededc996fee54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:44.636318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8642e1c5-43fd-4528-abe2-4d456a55edcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:44.689370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:44.698046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f11200-2357-4f8d-8f65-6d7e2e158688 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:44.730586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 943/1846] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:44.741481 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642e1c5-43fd-4528-abe2-4d456a55edcc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:44.742837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8642e1c5-43fd-4528-abe2-4d456a55edcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:44.767724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5221df7-5a07-48ab-af8c-8c80535c6d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:44.768363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5221df7-5a07-48ab-af8c-8c80535c6d34 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:44.768645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5221df7-5a07-48ab-af8c-8c80535c6d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:44.768947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5221df7-5a07-48ab-af8c-8c80535c6d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:44.802403 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642e1c5-43fd-4528-abe2-4d456a55edcc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:44.806137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8ff00-536b-4b9d-90db-a18a16ec5c2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:44.806910 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8ff00-536b-4b9d-90db-a18a16ec5c2e service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:44.807198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8ff00-536b-4b9d-90db-a18a16ec5c2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:44.807473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8ff00-536b-4b9d-90db-a18a16ec5c2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:44.830382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5221df7-5a07-48ab-af8c-8c80535c6d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:44.831787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5221df7-5a07-48ab-af8c-8c80535c6d34 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:44.842750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 904/1847] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:33:44.869301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8ff00-536b-4b9d-90db-a18a16ec5c2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:44.871151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8ff00-536b-4b9d-90db-a18a16ec5c2e service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:44.890555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 944/1848] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:33:45.304235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5221df7-5a07-48ab-af8c-8c80535c6d34 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:45.305935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e5221df7-5a07-48ab-af8c-8c80535c6d34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:45.413782 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5221df7-5a07-48ab-af8c-8c80535c6d34 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:45.418808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:45.419470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:45.419758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:45.420042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] PATH_INFO: `/v3/users/6c8188605f20440b8db4eda1c04ba450` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:45.421292 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8188605f20440b8db4eda1c04ba450)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:45.423220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:45.481058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8188605f20440b8db4eda1c04ba450'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:45.486920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:45.492605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8188605f20440b8db4eda1c04ba450'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:45.508739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8188605f20440b8db4eda1c04ba450'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:45.509792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8188605f20440b8db4eda1c04ba450'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:45.511217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8188605f20440b8db4eda1c04ba450'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:45.528662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 905/1849] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:45 2022] DELETE /identity/v3/users/6c8188605f20440b8db4eda1c04ba450 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:45.533712 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9c5f9-8f8e-4ace-b933-85ff84e42b39 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:45.534262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9c5f9-8f8e-4ace-b933-85ff84e42b39 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:45.534262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9c5f9-8f8e-4ace-b933-85ff84e42b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:45.568283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f4b9c5f9-8f8e-4ace-b933-85ff84e42b39 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:45.568921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:45.569822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f4b9c5f9-8f8e-4ace-b933-85ff84e42b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:45.570551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:45.586112 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:45.644820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 945/1850] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:45.652617 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dd3df-8522-4493-a8cf-9544c7eb8696 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:45.655057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9c5f9-8f8e-4ace-b933-85ff84e42b39 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:45.656146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f4b9c5f9-8f8e-4ace-b933-85ff84e42b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:45.658138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:45.659376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:45.659795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:45.660080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] PATH_INFO: `/v3/users/1c4b2654fa2b4e50910e67bc119ddff3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:45.661464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4b2654fa2b4e50910e67bc119ddff3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:45.664527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:45.720012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9c5f9-8f8e-4ace-b933-85ff84e42b39 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:45.724298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686e074-6c26-4df3-b2e2-f03fe5628998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:45.724949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686e074-6c26-4df3-b2e2-f03fe5628998 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:45.725239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686e074-6c26-4df3-b2e2-f03fe5628998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:45.725520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686e074-6c26-4df3-b2e2-f03fe5628998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:45.726282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4b2654fa2b4e50910e67bc119ddff3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:45.734776 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4b2654fa2b4e50910e67bc119ddff3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:45.740957 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686e074-6c26-4df3-b2e2-f03fe5628998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:45.744800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686e074-6c26-4df3-b2e2-f03fe5628998 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:45.751245 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4b2654fa2b4e50910e67bc119ddff3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:45.752079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4b2654fa2b4e50910e67bc119ddff3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:45.752893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4b2654fa2b4e50910e67bc119ddff3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:45.757615 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 946/1851] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:33:45.769333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 906/1852] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:45 2022] DELETE /identity/v3/users/1c4b2654fa2b4e50910e67bc119ddff3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:45.774164 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dd5a9-fcb7-479d-937e-b21dc5aaf9cb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:45.774629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dd5a9-fcb7-479d-937e-b21dc5aaf9cb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:45.774968 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dd5a9-fcb7-479d-937e-b21dc5aaf9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:45.795078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4d5dd5a9-fcb7-479d-937e-b21dc5aaf9cb None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:45.796462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4d5dd5a9-fcb7-479d-937e-b21dc5aaf9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:45.867164 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 947/1853] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:45.884594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:45.886811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:45.957637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df738a2a-e323-4c20-86dd-a3ff8efca8e5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:45.961304 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caecf3d-54f6-4bee-bd63-ba83d58f624a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:45.961936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caecf3d-54f6-4bee-bd63-ba83d58f624a service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:45.962268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caecf3d-54f6-4bee-bd63-ba83d58f624a service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:45.962561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caecf3d-54f6-4bee-bd63-ba83d58f624a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:45.969225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:45.973089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caecf3d-54f6-4bee-bd63-ba83d58f624a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:45.975538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caecf3d-54f6-4bee-bd63-ba83d58f624a service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:45.988948 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 907/1854] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:46.100703 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dd5a9-fcb7-479d-937e-b21dc5aaf9cb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:46.102251 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4d5dd5a9-fcb7-479d-937e-b21dc5aaf9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:46.115199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dd5a9-fcb7-479d-937e-b21dc5aaf9cb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:46.130546 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:46.131404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:46.131890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:46.132976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] PATH_INFO: `/v3/projects/125d8be3e80c40069355fc3f1373a9ed` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:46.135219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=125d8be3e80c40069355fc3f1373a9ed)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:46.137533 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:46.188067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125d8be3e80c40069355fc3f1373a9ed', 'request_id': 'req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.195095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125d8be3e80c40069355fc3f1373a9ed', 'request_id': 'req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.196739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:46.204477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125d8be3e80c40069355fc3f1373a9ed', 'request_id': 'req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.216763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] The token cache is being invalidate because project 125d8be3e80c40069355fc3f1373a9ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:46.217193 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.217899 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.219429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 948/1855] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:46 2022] DELETE /identity/v3/projects/125d8be3e80c40069355fc3f1373a9ed => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:46.223433 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caecf3d-54f6-4bee-bd63-ba83d58f624a service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:46.234725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caecf3d-54f6-4bee-bd63-ba83d58f624a service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:46.326585 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:46.327454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:46.327868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:46.328339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] PATH_INFO: `/v3/users/611fefbd1dc043488d347497fb480b6d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:46.330377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=611fefbd1dc043488d347497fb480b6d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:46.333308 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:46.334237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:46.336891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:46.390227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0ec70-f2ff-4e4d-9240-f1eb04d908ae admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:46.399057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:46.400617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:46.401110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:46.401655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] PATH_INFO: `/v3/projects/4591fa59eaae46749bb89ae4e1956e02` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:46.403785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4591fa59eaae46749bb89ae4e1956e02)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:46.406197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:46.424357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611fefbd1dc043488d347497fb480b6d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.435438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611fefbd1dc043488d347497fb480b6d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.454317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611fefbd1dc043488d347497fb480b6d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.455440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611fefbd1dc043488d347497fb480b6d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.456597 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611fefbd1dc043488d347497fb480b6d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.474025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4591fa59eaae46749bb89ae4e1956e02', 'request_id': 'req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.474961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 908/1856] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:46 2022] DELETE /identity/v3/users/611fefbd1dc043488d347497fb480b6d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:46.481087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4591fa59eaae46749bb89ae4e1956e02', 'request_id': 'req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.490110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4591fa59eaae46749bb89ae4e1956e02', 'request_id': 'req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.502356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] The token cache is being invalidate because project 4591fa59eaae46749bb89ae4e1956e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:46.502726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.503441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.505339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 949/1857] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:46 2022] DELETE /identity/v3/projects/4591fa59eaae46749bb89ae4e1956e02 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:46.510119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:46.512031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:46.583937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9352a0-dfab-4674-bf7a-f6e4082d87e4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:46.590468 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39067dee-b479-4b08-92bf-e2153af35e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:46.591054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39067dee-b479-4b08-92bf-e2153af35e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:46.591392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39067dee-b479-4b08-92bf-e2153af35e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:46.591671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39067dee-b479-4b08-92bf-e2153af35e73 admin admin] PATH_INFO: `/v3/users/7cc7c25e4d134735867f3a41eafa8c41` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:46.592990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39067dee-b479-4b08-92bf-e2153af35e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc7c25e4d134735867f3a41eafa8c41)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:46.594893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39067dee-b479-4b08-92bf-e2153af35e73 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:46.612726 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:46.666920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39067dee-b479-4b08-92bf-e2153af35e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc7c25e4d134735867f3a41eafa8c41'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.685882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39067dee-b479-4b08-92bf-e2153af35e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc7c25e4d134735867f3a41eafa8c41'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.701874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39067dee-b479-4b08-92bf-e2153af35e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc7c25e4d134735867f3a41eafa8c41'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.702900 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39067dee-b479-4b08-92bf-e2153af35e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc7c25e4d134735867f3a41eafa8c41'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.703548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39067dee-b479-4b08-92bf-e2153af35e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc7c25e4d134735867f3a41eafa8c41'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:46.721767 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 909/1858] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:46 2022] DELETE /identity/v3/users/7cc7c25e4d134735867f3a41eafa8c41 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:46.805796 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:46.808229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:46.885607 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dcacb-0e9d-4e5c-b35d-c9506a564007 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:46.947212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:46.947870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:46.948150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:46.948512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] PATH_INFO: `/v3/projects/f1a6fb12fdcd44dea20f3969da5fd20c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:46.949859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a6fb12fdcd44dea20f3969da5fd20c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:46.951852 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:46.976566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:47.013021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a6fb12fdcd44dea20f3969da5fd20c', 'request_id': 'req-55350573-633c-4a40-9e81-7243c7cf65fb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:47.020976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a6fb12fdcd44dea20f3969da5fd20c', 'request_id': 'req-55350573-633c-4a40-9e81-7243c7cf65fb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:47.033138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a6fb12fdcd44dea20f3969da5fd20c', 'request_id': 'req-55350573-633c-4a40-9e81-7243c7cf65fb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:47.047727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] The token cache is being invalidate because project f1a6fb12fdcd44dea20f3969da5fd20c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:47.047907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:47.048544 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:47.050395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 950/1859] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:46 2022] DELETE /identity/v3/projects/f1a6fb12fdcd44dea20f3969da5fd20c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:47.055369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63904a3f-f2a1-4d88-8bc2-41b627658782 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.055835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63904a3f-f2a1-4d88-8bc2-41b627658782 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.056798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63904a3f-f2a1-4d88-8bc2-41b627658782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.079816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-63904a3f-f2a1-4d88-8bc2-41b627658782 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:47.081335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-63904a3f-f2a1-4d88-8bc2-41b627658782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:47.141638 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.143426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:47.163553 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 910/1860] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:47.171863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11656098-271c-4b43-b158-0197fa688501 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.172155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11656098-271c-4b43-b158-0197fa688501 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.172609 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11656098-271c-4b43-b158-0197fa688501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.193528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-11656098-271c-4b43-b158-0197fa688501 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:47.194441 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-11656098-271c-4b43-b158-0197fa688501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:47.205028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 911/1861] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:47.208510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11656098-271c-4b43-b158-0197fa688501 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.219945 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55350573-633c-4a40-9e81-7243c7cf65fb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.220600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11656098-271c-4b43-b158-0197fa688501 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.224732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.225524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.225835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.226143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c admin admin] PATH_INFO: `/v3/projects/c042754c880f4dc68c08c2a2ef814408` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.227074 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4335f4-0805-49e7-9728-27121b2eb13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.227560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c042754c880f4dc68c08c2a2ef814408)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.228573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4335f4-0805-49e7-9728-27121b2eb13d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.228933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4335f4-0805-49e7-9728-27121b2eb13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.229203 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4335f4-0805-49e7-9728-27121b2eb13d admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.229908 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4335f4-0805-49e7-9728-27121b2eb13d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:33:47.230216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4335f4-0805-49e7-9728-27121b2eb13d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.230410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.231828 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4335f4-0805-49e7-9728-27121b2eb13d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.251898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 912/1862] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:33:47.252930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4335f4-0805-49e7-9728-27121b2eb13d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.263587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4335f4-0805-49e7-9728-27121b2eb13d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.268471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dde413-5bac-4bf0-b3cd-2c7402e4aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.269100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dde413-5bac-4bf0-b3cd-2c7402e4aacd admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.269384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dde413-5bac-4bf0-b3cd-2c7402e4aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.269661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dde413-5bac-4bf0-b3cd-2c7402e4aacd admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.270470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dde413-5bac-4bf0-b3cd-2c7402e4aacd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.272431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dde413-5bac-4bf0-b3cd-2c7402e4aacd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.285186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c042754c880f4dc68c08c2a2ef814408', 'request_id': 'req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:47.290906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c042754c880f4dc68c08c2a2ef814408', 'request_id': 'req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:47.298310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c042754c880f4dc68c08c2a2ef814408', 'request_id': 'req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:47.300418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 913/1863] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:47 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:33:47.304658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dde413-5bac-4bf0-b3cd-2c7402e4aacd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.313209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c admin admin] The token cache is being invalidate because project c042754c880f4dc68c08c2a2ef814408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:47.313505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:47.314195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0e9e7b11-93ca-4252-aeb3-285cc63fbb4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:47.315745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 951/1864] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:47 2022] DELETE /identity/v3/projects/c042754c880f4dc68c08c2a2ef814408 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:47.320280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3f07-7d24-48c3-93f3-2464b21993f7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.320571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3f07-7d24-48c3-93f3-2464b21993f7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.320852 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3f07-7d24-48c3-93f3-2464b21993f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.341287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1c7b3f07-7d24-48c3-93f3-2464b21993f7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:47.343494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1c7b3f07-7d24-48c3-93f3-2464b21993f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:47.360141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:47.371661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dde413-5bac-4bf0-b3cd-2c7402e4aacd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.379176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc89d4c-2791-43a6-a9c3-3bcb1b053490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.379810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc89d4c-2791-43a6-a9c3-3bcb1b053490 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.380100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc89d4c-2791-43a6-a9c3-3bcb1b053490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.380380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc89d4c-2791-43a6-a9c3-3bcb1b053490 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.381084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc89d4c-2791-43a6-a9c3-3bcb1b053490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.382997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc89d4c-2791-43a6-a9c3-3bcb1b053490 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.383467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:47.408978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 914/1865] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:47 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:33:47.409954 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc89d4c-2791-43a6-a9c3-3bcb1b053490 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.411550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cfc89d4c-2791-43a6-a9c3-3bcb1b053490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:47.414103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 952/1866] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:47.422642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82243a-bb3a-4ce1-ad18-56b78d74d181 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.422931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82243a-bb3a-4ce1-ad18-56b78d74d181 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.423210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82243a-bb3a-4ce1-ad18-56b78d74d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.425322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc89d4c-2791-43a6-a9c3-3bcb1b053490 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.429900 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d61bfa-f1eb-4ff6-8c7d-901e7e94830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.430514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d61bfa-f1eb-4ff6-8c7d-901e7e94830c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.430984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d61bfa-f1eb-4ff6-8c7d-901e7e94830c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.431272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d61bfa-f1eb-4ff6-8c7d-901e7e94830c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.431999 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d61bfa-f1eb-4ff6-8c7d-901e7e94830c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.433631 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d61bfa-f1eb-4ff6-8c7d-901e7e94830c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.443148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3e82243a-bb3a-4ce1-ad18-56b78d74d181 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:47.443594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 915/1867] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:33:47.445823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3e82243a-bb3a-4ce1-ad18-56b78d74d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:47.448147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d61bfa-f1eb-4ff6-8c7d-901e7e94830c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.455635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 953/1868] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:47.458055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d61bfa-f1eb-4ff6-8c7d-901e7e94830c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.459622 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82243a-bb3a-4ce1-ad18-56b78d74d181 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.463659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11774d-0f77-48a1-913d-c3860fb06036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.464299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11774d-0f77-48a1-913d-c3860fb06036 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.464730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11774d-0f77-48a1-913d-c3860fb06036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.465058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11774d-0f77-48a1-913d-c3860fb06036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.465806 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11774d-0f77-48a1-913d-c3860fb06036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.467438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11774d-0f77-48a1-913d-c3860fb06036 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.470269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82243a-bb3a-4ce1-ad18-56b78d74d181 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.475060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375723d-ce97-40ce-b4af-0f8ef12d0bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.475680 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375723d-ce97-40ce-b4af-0f8ef12d0bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.476235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375723d-ce97-40ce-b4af-0f8ef12d0bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.476522 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375723d-ce97-40ce-b4af-0f8ef12d0bbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.477524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375723d-ce97-40ce-b4af-0f8ef12d0bbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:33:47.477897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375723d-ce97-40ce-b4af-0f8ef12d0bbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.481848 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 916/1869] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:33:47.482281 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375723d-ce97-40ce-b4af-0f8ef12d0bbb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.482984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11774d-0f77-48a1-913d-c3860fb06036 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.492641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11774d-0f77-48a1-913d-c3860fb06036 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.497612 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 954/1870] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:33:47.498384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd851d3-f29a-49ba-8c65-7f30734478b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.498580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375723d-ce97-40ce-b4af-0f8ef12d0bbb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.498738 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd851d3-f29a-49ba-8c65-7f30734478b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.499089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd851d3-f29a-49ba-8c65-7f30734478b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.499431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd851d3-f29a-49ba-8c65-7f30734478b9 admin admin] PATH_INFO: `/v3/projects/081f83edbf894f75aacc64025253e99f/users/d0d269025a1b4cb78cb4f81be8c17634/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.508493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375723d-ce97-40ce-b4af-0f8ef12d0bbb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.514586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e4b4-a777-48af-b7d3-d0adbe132742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.515346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e4b4-a777-48af-b7d3-d0adbe132742 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.515702 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e4b4-a777-48af-b7d3-d0adbe132742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.516137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6e4b4-a777-48af-b7d3-d0adbe132742 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.516888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6e4b4-a777-48af-b7d3-d0adbe132742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.518898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6e4b4-a777-48af-b7d3-d0adbe132742 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.519438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd851d3-f29a-49ba-8c65-7f30734478b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=081f83edbf894f75aacc64025253e99f, user_id=d0d269025a1b4cb78cb4f81be8c17634, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.522284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd851d3-f29a-49ba-8c65-7f30734478b9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.542942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 917/1871] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:47 2022] PUT /identity/v3/projects/081f83edbf894f75aacc64025253e99f/users/d0d269025a1b4cb78cb4f81be8c17634/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:47.549141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eed09-e056-4003-9f2c-629589e939f0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.549421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eed09-e056-4003-9f2c-629589e939f0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.549808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eed09-e056-4003-9f2c-629589e939f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.557850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 955/1872] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:47 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:33:47.562222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e4b4-a777-48af-b7d3-d0adbe132742 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.580880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1e7eed09-e056-4003-9f2c-629589e939f0 None None] MFA Rules not processed for user `d0d269025a1b4cb78cb4f81be8c17634`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:47.581748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1e7eed09-e056-4003-9f2c-629589e939f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:47.646923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6e4b4-a777-48af-b7d3-d0adbe132742 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.654074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb55b7-d279-4581-89ef-af4e272e16c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.654705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb55b7-d279-4581-89ef-af4e272e16c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.654988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb55b7-d279-4581-89ef-af4e272e16c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.655260 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb55b7-d279-4581-89ef-af4e272e16c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.655928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb55b7-d279-4581-89ef-af4e272e16c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.657925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb55b7-d279-4581-89ef-af4e272e16c7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.684150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 956/1873] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:47 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:47.684318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 918/1874] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:47.684400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb55b7-d279-4581-89ef-af4e272e16c7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.684400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0cbb55b7-d279-4581-89ef-af4e272e16c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:47.688567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eed09-e056-4003-9f2c-629589e939f0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.699706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eed09-e056-4003-9f2c-629589e939f0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.704361 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b964d-3d43-4dcd-ac41-ac48260008f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.705006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b964d-3d43-4dcd-ac41-ac48260008f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.705316 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b964d-3d43-4dcd-ac41-ac48260008f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.705593 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b964d-3d43-4dcd-ac41-ac48260008f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.706289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b964d-3d43-4dcd-ac41-ac48260008f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.707876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b964d-3d43-4dcd-ac41-ac48260008f4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.718763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 919/1875] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:33:47.719656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b964d-3d43-4dcd-ac41-ac48260008f4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.730318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b964d-3d43-4dcd-ac41-ac48260008f4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.736398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a7c5f-0aae-4915-bdea-cad4aa978b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.737126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a7c5f-0aae-4915-bdea-cad4aa978b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.737474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a7c5f-0aae-4915-bdea-cad4aa978b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.737851 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a7c5f-0aae-4915-bdea-cad4aa978b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.738523 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a7c5f-0aae-4915-bdea-cad4aa978b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.740513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a7c5f-0aae-4915-bdea-cad4aa978b89 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.747564 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb55b7-d279-4581-89ef-af4e272e16c7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.751336 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d40f7e-a1d5-4499-8b48-5afbd67024b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.751966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d40f7e-a1d5-4499-8b48-5afbd67024b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.753237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d40f7e-a1d5-4499-8b48-5afbd67024b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.753762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d40f7e-a1d5-4499-8b48-5afbd67024b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.756409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b2d40f7e-a1d5-4499-8b48-5afbd67024b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:47.774869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 920/1876] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:47 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:47.774869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a7c5f-0aae-4915-bdea-cad4aa978b89 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.808258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:47.826704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:47.837138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d40f7e-a1d5-4499-8b48-5afbd67024b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.838967 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d40f7e-a1d5-4499-8b48-5afbd67024b0 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.839563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a7c5f-0aae-4915-bdea-cad4aa978b89 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.844356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f1e8f-c788-45fe-a942-7fe3ff6c14b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.845016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f1e8f-c788-45fe-a942-7fe3ff6c14b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.845301 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f1e8f-c788-45fe-a942-7fe3ff6c14b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.845575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f1e8f-c788-45fe-a942-7fe3ff6c14b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.846408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f1e8f-c788-45fe-a942-7fe3ff6c14b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.848186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f1e8f-c788-45fe-a942-7fe3ff6c14b9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.851728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 957/1877] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:47.852743 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d40f7e-a1d5-4499-8b48-5afbd67024b0 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.859325 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 921/1878] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:47.864917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f1e8f-c788-45fe-a942-7fe3ff6c14b9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.865387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d40f7e-a1d5-4499-8b48-5afbd67024b0 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.871017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35858f-9b9d-4f0f-9fea-e6c3ca041799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.871835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35858f-9b9d-4f0f-9fea-e6c3ca041799 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.872122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35858f-9b9d-4f0f-9fea-e6c3ca041799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.872392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35858f-9b9d-4f0f-9fea-e6c3ca041799 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.873108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35858f-9b9d-4f0f-9fea-e6c3ca041799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.875352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35858f-9b9d-4f0f-9fea-e6c3ca041799 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.881125 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f1e8f-c788-45fe-a942-7fe3ff6c14b9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.888260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da22121-1076-4a8c-bedd-85c5db4f8c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:47.889007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da22121-1076-4a8c-bedd-85c5db4f8c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.889403 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da22121-1076-4a8c-bedd-85c5db4f8c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.889781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da22121-1076-4a8c-bedd-85c5db4f8c5a admin admin] PATH_INFO: `/v3/projects/c5e59200c4514774845500bb3090fa74/users/859e9f17950c4320a72a066bf6d64165/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.904354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 958/1879] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:47 2022] POST /identity/v3/users => generated 295 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:47.908133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35858f-9b9d-4f0f-9fea-e6c3ca041799 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:47.908596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da22121-1076-4a8c-bedd-85c5db4f8c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e59200c4514774845500bb3090fa74, user_id=859e9f17950c4320a72a066bf6d64165, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:47.911632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da22121-1076-4a8c-bedd-85c5db4f8c5a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:47.924583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35858f-9b9d-4f0f-9fea-e6c3ca041799 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:47.932950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 922/1880] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:47 2022] PUT /identity/v3/projects/c5e59200c4514774845500bb3090fa74/users/859e9f17950c4320a72a066bf6d64165/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:47.942660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef21884-5fbb-46c9-aec0-a8a4c0a2c5f8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:47.943069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef21884-5fbb-46c9-aec0-a8a4c0a2c5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:47.943446 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef21884-5fbb-46c9-aec0-a8a4c0a2c5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:47.979036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cef21884-5fbb-46c9-aec0-a8a4c0a2c5f8 None None] MFA Rules not processed for user `859e9f17950c4320a72a066bf6d64165`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:47.980634 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cef21884-5fbb-46c9-aec0-a8a4c0a2c5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:48.024136 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aef772-0910-4932-afcd-e955c5766185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:48.025746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aef772-0910-4932-afcd-e955c5766185 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:48.026275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aef772-0910-4932-afcd-e955c5766185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:48.026584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aef772-0910-4932-afcd-e955c5766185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:48.027392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aef772-0910-4932-afcd-e955c5766185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:48.029257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aef772-0910-4932-afcd-e955c5766185 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:48.054396 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 959/1881] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:33:48.055442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aef772-0910-4932-afcd-e955c5766185 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:48.070386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aef772-0910-4932-afcd-e955c5766185 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:48.083397 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 923/1882] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:48.084103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa286e0-c674-4836-89d6-ae36eb947f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:48.084103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa286e0-c674-4836-89d6-ae36eb947f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:48.084103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa286e0-c674-4836-89d6-ae36eb947f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:48.084103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa286e0-c674-4836-89d6-ae36eb947f6b admin admin] PATH_INFO: `/v3/projects/f25b0409a0c5444cb348033ee44246c1/users/89c9781e42654e19b6aa1412b2b53b3d/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:48.084521 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef21884-5fbb-46c9-aec0-a8a4c0a2c5f8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:48.105010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa286e0-c674-4836-89d6-ae36eb947f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25b0409a0c5444cb348033ee44246c1, user_id=89c9781e42654e19b6aa1412b2b53b3d, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:48.109555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa286e0-c674-4836-89d6-ae36eb947f6b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:48.132891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 960/1883] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:48 2022] PUT /identity/v3/projects/f25b0409a0c5444cb348033ee44246c1/users/89c9781e42654e19b6aa1412b2b53b3d/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:48.137524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa286e0-c674-4836-89d6-ae36eb947f6b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:48.163186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef21884-5fbb-46c9-aec0-a8a4c0a2c5f8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:48.226451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa286e0-c674-4836-89d6-ae36eb947f6b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:48.232493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d4712-eed3-4fc9-8230-17646b821d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:48.233357 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d4712-eed3-4fc9-8230-17646b821d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:48.233801 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d4712-eed3-4fc9-8230-17646b821d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:48.234249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d4712-eed3-4fc9-8230-17646b821d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:48.235105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d4712-eed3-4fc9-8230-17646b821d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:48.237410 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d4712-eed3-4fc9-8230-17646b821d05 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:48.238622 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c481e3-a82f-470b-9f28-3e36aed9bcd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:48.239353 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c481e3-a82f-470b-9f28-3e36aed9bcd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:48.239760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c481e3-a82f-470b-9f28-3e36aed9bcd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:48.240121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c481e3-a82f-470b-9f28-3e36aed9bcd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:48.253153 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 961/1884] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:48.256745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d4712-eed3-4fc9-8230-17646b821d05 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:48.269058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:48.273711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d4712-eed3-4fc9-8230-17646b821d05 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:48.279655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8f2e7-a39a-4a52-aee0-fc49728501b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:48.280340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8f2e7-a39a-4a52-aee0-fc49728501b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:48.282055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8f2e7-a39a-4a52-aee0-fc49728501b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:48.282055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8f2e7-a39a-4a52-aee0-fc49728501b4 admin admin] PATH_INFO: `/v3/projects/f25b0409a0c5444cb348033ee44246c1/users/89c9781e42654e19b6aa1412b2b53b3d/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:48.284411 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8f2e7-a39a-4a52-aee0-fc49728501b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25b0409a0c5444cb348033ee44246c1, user_id=89c9781e42654e19b6aa1412b2b53b3d, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:48.287232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8f2e7-a39a-4a52-aee0-fc49728501b4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:48.304986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 962/1885] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:48 2022] PUT /identity/v3/projects/f25b0409a0c5444cb348033ee44246c1/users/89c9781e42654e19b6aa1412b2b53b3d/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:48.312507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5f951-2771-4dfa-b253-aa818c8532cf None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:48.312876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5f951-2771-4dfa-b253-aa818c8532cf None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:48.313098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5f951-2771-4dfa-b253-aa818c8532cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:48.334922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c481e3-a82f-470b-9f28-3e36aed9bcd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:48.336426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c481e3-a82f-470b-9f28-3e36aed9bcd9 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:48.356453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:48.357177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 924/1886] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:33:48.365460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-09b5f951-2771-4dfa-b253-aa818c8532cf None None] MFA Rules not processed for user `89c9781e42654e19b6aa1412b2b53b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:48.365460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-09b5f951-2771-4dfa-b253-aa818c8532cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:48.456323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 963/1887] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:48.468749 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c481e3-a82f-470b-9f28-3e36aed9bcd9 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:48.470724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-84c481e3-a82f-470b-9f28-3e36aed9bcd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:48.488793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c481e3-a82f-470b-9f28-3e36aed9bcd9 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:48.559107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a528ccc-45f6-48cf-a198-95cf26770cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:48.559813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a528ccc-45f6-48cf-a198-95cf26770cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:48.560163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a528ccc-45f6-48cf-a198-95cf26770cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:48.560897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a528ccc-45f6-48cf-a198-95cf26770cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:48.626540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a528ccc-45f6-48cf-a198-95cf26770cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:48.627982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a528ccc-45f6-48cf-a198-95cf26770cd4 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:48.645744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 925/1888] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:50.031313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5f951-2771-4dfa-b253-aa818c8532cf None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:50.041205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5f951-2771-4dfa-b253-aa818c8532cf None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:50.044756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bea9e-c562-4259-8940-58145d1420a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:50.045396 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bea9e-c562-4259-8940-58145d1420a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:50.045682 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bea9e-c562-4259-8940-58145d1420a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:50.045954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bea9e-c562-4259-8940-58145d1420a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:50.055963 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bea9e-c562-4259-8940-58145d1420a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:50.057418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bea9e-c562-4259-8940-58145d1420a8 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:50.066712 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 964/1889] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:33:50.961686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a528ccc-45f6-48cf-a198-95cf26770cd4 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:51.057676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a528ccc-45f6-48cf-a198-95cf26770cd4 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:51.065087 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:51.065954 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:51.066093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:51.066421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] PATH_INFO: `/v3/users/859e9f17950c4320a72a066bf6d64165` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:51.068315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=859e9f17950c4320a72a066bf6d64165)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:51.072943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:51.109972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:51.148670 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859e9f17950c4320a72a066bf6d64165'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:51.157426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859e9f17950c4320a72a066bf6d64165'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:51.175461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859e9f17950c4320a72a066bf6d64165'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:51.176290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859e9f17950c4320a72a066bf6d64165'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:51.177067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859e9f17950c4320a72a066bf6d64165'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:51.202663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 926/1890] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:50 2022] DELETE /identity/v3/users/859e9f17950c4320a72a066bf6d64165 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:51.204229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639d5f8-30f6-4a39-b650-a714419499ee None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:51.204713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639d5f8-30f6-4a39-b650-a714419499ee None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:51.204791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639d5f8-30f6-4a39-b650-a714419499ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:51.235469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a639d5f8-30f6-4a39-b650-a714419499ee None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:51.237724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a639d5f8-30f6-4a39-b650-a714419499ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:51.335554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 965/1891] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:51.398192 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:51.400731 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:51.476559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1124c-0fb6-4097-a80d-1c9ad08940f4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:51.481321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486153a-1933-48b3-98af-2cc119289d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:51.482093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486153a-1933-48b3-98af-2cc119289d56 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:51.482502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486153a-1933-48b3-98af-2cc119289d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:51.482847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486153a-1933-48b3-98af-2cc119289d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:51.492647 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486153a-1933-48b3-98af-2cc119289d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:51.494739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486153a-1933-48b3-98af-2cc119289d56 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:51.505154 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 927/1892] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:52.024332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639d5f8-30f6-4a39-b650-a714419499ee None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:52.027060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a639d5f8-30f6-4a39-b650-a714419499ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:52.044009 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639d5f8-30f6-4a39-b650-a714419499ee None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:52.068199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:52.068919 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:52.069219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:52.069529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f admin admin] PATH_INFO: `/v3/projects/c5e59200c4514774845500bb3090fa74` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:52.070792 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e59200c4514774845500bb3090fa74)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:52.074323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:52.131284 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e59200c4514774845500bb3090fa74', 'request_id': 'req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:52.138275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e59200c4514774845500bb3090fa74', 'request_id': 'req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:52.146202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e59200c4514774845500bb3090fa74', 'request_id': 'req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:52.159699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f admin admin] The token cache is being invalidate because project c5e59200c4514774845500bb3090fa74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:52.160030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:52.160654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-46d8a40a-4d19-4b36-bda7-90b15ecf9a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:52.162889 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 966/1893] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:52 2022] DELETE /identity/v3/projects/c5e59200c4514774845500bb3090fa74 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:52.168141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc727c4-d3b9-4a83-8235-d288e7700422 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:52.169727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc727c4-d3b9-4a83-8235-d288e7700422 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:52.170080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc727c4-d3b9-4a83-8235-d288e7700422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:52.193536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2cc727c4-d3b9-4a83-8235-d288e7700422 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:52.195210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2cc727c4-d3b9-4a83-8235-d288e7700422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:52.266852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 928/1894] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:52.275069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42e388-0597-4d2b-ab43-3630afb8bbc6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:52.275650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42e388-0597-4d2b-ab43-3630afb8bbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:52.275650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42e388-0597-4d2b-ab43-3630afb8bbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:52.300331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5d42e388-0597-4d2b-ab43-3630afb8bbc6 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:52.301572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5d42e388-0597-4d2b-ab43-3630afb8bbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:52.309592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 967/1895] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:52.313885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc727c4-d3b9-4a83-8235-d288e7700422 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:52.323849 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc727c4-d3b9-4a83-8235-d288e7700422 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:52.328671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1cbf2-ca94-4469-9e98-357095babb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:52.329348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1cbf2-ca94-4469-9e98-357095babb52 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:52.329635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1cbf2-ca94-4469-9e98-357095babb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:52.329915 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1cbf2-ca94-4469-9e98-357095babb52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:52.330618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1cbf2-ca94-4469-9e98-357095babb52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:33:52.330932 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1cbf2-ca94-4469-9e98-357095babb52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:52.332610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1cbf2-ca94-4469-9e98-357095babb52 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:52.345142 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 929/1896] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:33:52.349668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42e388-0597-4d2b-ab43-3630afb8bbc6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:52.355408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:52.361954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42e388-0597-4d2b-ab43-3630afb8bbc6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:52.368257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54722043-1a1a-4f62-a765-6348ccdd1023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:52.368925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54722043-1a1a-4f62-a765-6348ccdd1023 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:52.369289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54722043-1a1a-4f62-a765-6348ccdd1023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:52.369593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54722043-1a1a-4f62-a765-6348ccdd1023 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:52.370280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54722043-1a1a-4f62-a765-6348ccdd1023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:52.372213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54722043-1a1a-4f62-a765-6348ccdd1023 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:52.401599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 968/1897] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:52 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:52.405892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1cbf2-ca94-4469-9e98-357095babb52 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:52.416487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1cbf2-ca94-4469-9e98-357095babb52 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:52.444589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:52.483431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597dcd6-4ba9-4164-b9f9-9048f4523e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:52.484060 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597dcd6-4ba9-4164-b9f9-9048f4523e96 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:52.484344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597dcd6-4ba9-4164-b9f9-9048f4523e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:52.484623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597dcd6-4ba9-4164-b9f9-9048f4523e96 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:52.485364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597dcd6-4ba9-4164-b9f9-9048f4523e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:52.487284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597dcd6-4ba9-4164-b9f9-9048f4523e96 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:52.513398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 930/1898] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:52 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:33:52.514586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54722043-1a1a-4f62-a765-6348ccdd1023 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:52.525800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54722043-1a1a-4f62-a765-6348ccdd1023 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:52.533936 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9156e-df1a-4915-b9ff-0c2c3317182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:52.534570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9156e-df1a-4915-b9ff-0c2c3317182d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:52.534856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9156e-df1a-4915-b9ff-0c2c3317182d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:52.535132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9156e-df1a-4915-b9ff-0c2c3317182d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:52.535839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9156e-df1a-4915-b9ff-0c2c3317182d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:52.537466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9156e-df1a-4915-b9ff-0c2c3317182d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:52.549200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 969/1899] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:52.553230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597dcd6-4ba9-4164-b9f9-9048f4523e96 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:52.563771 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597dcd6-4ba9-4164-b9f9-9048f4523e96 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:52.568449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801aa8e-7d53-4cb6-8950-257848d3fdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:52.569192 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801aa8e-7d53-4cb6-8950-257848d3fdde admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:52.569477 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801aa8e-7d53-4cb6-8950-257848d3fdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:52.569751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801aa8e-7d53-4cb6-8950-257848d3fdde admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:52.570442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801aa8e-7d53-4cb6-8950-257848d3fdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:52.572999 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801aa8e-7d53-4cb6-8950-257848d3fdde admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:52.584009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 931/1900] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:52.589012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9156e-df1a-4915-b9ff-0c2c3317182d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:52.599215 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9156e-df1a-4915-b9ff-0c2c3317182d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:52.604018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a54d64-ff24-4077-a3c8-7c39d9fbdd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:52.604764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a54d64-ff24-4077-a3c8-7c39d9fbdd40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:52.605166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a54d64-ff24-4077-a3c8-7c39d9fbdd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:52.605521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a54d64-ff24-4077-a3c8-7c39d9fbdd40 admin admin] PATH_INFO: `/v3/projects/d939aa7b827940a68092e84307f191c2/users/e28d4d9ef461467ebc57df98078d2085/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:52.621932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a54d64-ff24-4077-a3c8-7c39d9fbdd40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d939aa7b827940a68092e84307f191c2, user_id=e28d4d9ef461467ebc57df98078d2085, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:52.624725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a54d64-ff24-4077-a3c8-7c39d9fbdd40 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:52.640627 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 970/1901] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:52 2022] PUT /identity/v3/projects/d939aa7b827940a68092e84307f191c2/users/e28d4d9ef461467ebc57df98078d2085/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:52.652264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74355971-4516-4d67-b9a3-f274c291215a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:52.652555 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74355971-4516-4d67-b9a3-f274c291215a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:52.652857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74355971-4516-4d67-b9a3-f274c291215a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:52.681716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-74355971-4516-4d67-b9a3-f274c291215a None None] MFA Rules not processed for user `e28d4d9ef461467ebc57df98078d2085`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:52.682964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-74355971-4516-4d67-b9a3-f274c291215a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:52.753148 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 932/1902] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:52.765118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a54d64-ff24-4077-a3c8-7c39d9fbdd40 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:52.767044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-48a54d64-ff24-4077-a3c8-7c39d9fbdd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:52.849117 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a54d64-ff24-4077-a3c8-7c39d9fbdd40 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:52.853255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95495767-f2a4-4d36-9543-e94548691135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:52.853888 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95495767-f2a4-4d36-9543-e94548691135 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:52.854166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95495767-f2a4-4d36-9543-e94548691135 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:52.854462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95495767-f2a4-4d36-9543-e94548691135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:52.866321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95495767-f2a4-4d36-9543-e94548691135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:52.867952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95495767-f2a4-4d36-9543-e94548691135 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:52.881114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 971/1903] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:52.910427 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74355971-4516-4d67-b9a3-f274c291215a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:52.992670 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74355971-4516-4d67-b9a3-f274c291215a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:52.998034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:52.998682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:52.998960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:52.999232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] PATH_INFO: `/v3/users/e28d4d9ef461467ebc57df98078d2085` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:53.000396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28d4d9ef461467ebc57df98078d2085)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:53.002837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:53.048202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:53.060455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28d4d9ef461467ebc57df98078d2085'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:53.069193 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28d4d9ef461467ebc57df98078d2085'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:53.088992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28d4d9ef461467ebc57df98078d2085'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:53.090013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28d4d9ef461467ebc57df98078d2085'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:53.090734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28d4d9ef461467ebc57df98078d2085'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:53.110955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb24e5f-8bb6-4326-9a62-9600ef2af43e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:53.111246 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb24e5f-8bb6-4326-9a62-9600ef2af43e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:53.111550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb24e5f-8bb6-4326-9a62-9600ef2af43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:53.116950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 933/1904] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:52 2022] DELETE /identity/v3/users/e28d4d9ef461467ebc57df98078d2085 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:53.136247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0eb24e5f-8bb6-4326-9a62-9600ef2af43e None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:53.137867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0eb24e5f-8bb6-4326-9a62-9600ef2af43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:53.203616 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 972/1905] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:53.213697 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:53.215341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:53.275834 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4bc2b-7fd4-4036-9d60-978dc704a2c9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:53.279638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1064c08-20aa-4a02-935b-0b007e194fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:53.280262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064c08-20aa-4a02-935b-0b007e194fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:53.280542 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064c08-20aa-4a02-935b-0b007e194fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:53.280815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064c08-20aa-4a02-935b-0b007e194fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:53.292053 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1064c08-20aa-4a02-935b-0b007e194fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:53.293553 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1064c08-20aa-4a02-935b-0b007e194fc9 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:53.303593 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 934/1906] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:53.689627 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb24e5f-8bb6-4326-9a62-9600ef2af43e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:53.691135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0eb24e5f-8bb6-4326-9a62-9600ef2af43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:53.704291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb24e5f-8bb6-4326-9a62-9600ef2af43e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:53.708943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:53.709587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:53.709873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:53.710156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2 admin admin] PATH_INFO: `/v3/projects/d939aa7b827940a68092e84307f191c2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:53.711306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d939aa7b827940a68092e84307f191c2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:53.713901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:53.756705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:53.761421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd939aa7b827940a68092e84307f191c2', 'request_id': 'req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:53.767697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd939aa7b827940a68092e84307f191c2', 'request_id': 'req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:53.775309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd939aa7b827940a68092e84307f191c2', 'request_id': 'req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:53.786227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2 admin admin] The token cache is being invalidate because project d939aa7b827940a68092e84307f191c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:53.786515 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:53.787141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4c03b2d8-2d45-4a98-98c0-a54f72d84ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:53.788630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 973/1907] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:53 2022] DELETE /identity/v3/projects/d939aa7b827940a68092e84307f191c2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:53.794355 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd574aa4-0398-4da4-a3b9-4ea8cd551c5e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:53.794639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd574aa4-0398-4da4-a3b9-4ea8cd551c5e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:53.794936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd574aa4-0398-4da4-a3b9-4ea8cd551c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:53.815676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-dd574aa4-0398-4da4-a3b9-4ea8cd551c5e None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:53.817105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dd574aa4-0398-4da4-a3b9-4ea8cd551c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:53.876644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 935/1908] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:53.886102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20292e7c-51c3-4a67-97a5-d1a1267bd73f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:53.886395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20292e7c-51c3-4a67-97a5-d1a1267bd73f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:53.886676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20292e7c-51c3-4a67-97a5-d1a1267bd73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:53.906719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-20292e7c-51c3-4a67-97a5-d1a1267bd73f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:53.907913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-20292e7c-51c3-4a67-97a5-d1a1267bd73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:53.916699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 974/1909] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:53.920783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd574aa4-0398-4da4-a3b9-4ea8cd551c5e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:53.930302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd574aa4-0398-4da4-a3b9-4ea8cd551c5e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:53.934998 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafe8b8-5a91-4316-bef9-fd9b2a201b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:53.935578 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafe8b8-5a91-4316-bef9-fd9b2a201b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:53.935852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafe8b8-5a91-4316-bef9-fd9b2a201b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:53.936141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafe8b8-5a91-4316-bef9-fd9b2a201b22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:53.936845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafe8b8-5a91-4316-bef9-fd9b2a201b22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:33:53.937177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafe8b8-5a91-4316-bef9-fd9b2a201b22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:53.938994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafe8b8-5a91-4316-bef9-fd9b2a201b22 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:53.951975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 936/1910] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:33:53.956287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20292e7c-51c3-4a67-97a5-d1a1267bd73f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:53.967415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20292e7c-51c3-4a67-97a5-d1a1267bd73f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:53.972025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c23853-2e0a-412d-aeac-b79fd3e73f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:53.972635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c23853-2e0a-412d-aeac-b79fd3e73f44 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:53.972948 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c23853-2e0a-412d-aeac-b79fd3e73f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:53.973232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c23853-2e0a-412d-aeac-b79fd3e73f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:53.973898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c23853-2e0a-412d-aeac-b79fd3e73f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:53.975777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c23853-2e0a-412d-aeac-b79fd3e73f44 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:54.010056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 975/1911] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:53 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:54.010894 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafe8b8-5a91-4316-bef9-fd9b2a201b22 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:54.022152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafe8b8-5a91-4316-bef9-fd9b2a201b22 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:54.059751 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c23853-2e0a-412d-aeac-b79fd3e73f44 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:54.061820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-99c23853-2e0a-412d-aeac-b79fd3e73f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:54.077625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:54.098478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a441e3e-7b58-464c-9ca4-7deb511ea11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:54.099224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a441e3e-7b58-464c-9ca4-7deb511ea11b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:54.099573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a441e3e-7b58-464c-9ca4-7deb511ea11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:54.099913 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a441e3e-7b58-464c-9ca4-7deb511ea11b admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:54.100682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a441e3e-7b58-464c-9ca4-7deb511ea11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:54.102707 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a441e3e-7b58-464c-9ca4-7deb511ea11b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:54.127813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 937/1912] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:54 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:54.131629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a441e3e-7b58-464c-9ca4-7deb511ea11b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:54.147171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a441e3e-7b58-464c-9ca4-7deb511ea11b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:54.150825 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c23853-2e0a-412d-aeac-b79fd3e73f44 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:54.153962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd4187-572e-4d83-aa71-4c00bc007d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:54.154721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd4187-572e-4d83-aa71-4c00bc007d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:54.155008 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd4187-572e-4d83-aa71-4c00bc007d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:54.155925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd4187-572e-4d83-aa71-4c00bc007d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:54.156713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd4187-572e-4d83-aa71-4c00bc007d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:54.158470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df6716-3471-4182-9d25-fb2a8a015685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:54.158596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd4187-572e-4d83-aa71-4c00bc007d46 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:54.159447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df6716-3471-4182-9d25-fb2a8a015685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:54.159908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df6716-3471-4182-9d25-fb2a8a015685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:54.160520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df6716-3471-4182-9d25-fb2a8a015685 admin admin] PATH_INFO: `/v3/users/d0d269025a1b4cb78cb4f81be8c17634` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:54.162132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df6716-3471-4182-9d25-fb2a8a015685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d269025a1b4cb78cb4f81be8c17634)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:54.164690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df6716-3471-4182-9d25-fb2a8a015685 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:54.173822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 938/1913] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:33:54.177739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd4187-572e-4d83-aa71-4c00bc007d46 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:54.189475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd4187-572e-4d83-aa71-4c00bc007d46 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:54.195265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b161d7-49b4-4527-8baf-e0b428a5a56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:54.195885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b161d7-49b4-4527-8baf-e0b428a5a56b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:54.196167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b161d7-49b4-4527-8baf-e0b428a5a56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:54.197103 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b161d7-49b4-4527-8baf-e0b428a5a56b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:54.198166 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b161d7-49b4-4527-8baf-e0b428a5a56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:54.199760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b161d7-49b4-4527-8baf-e0b428a5a56b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:54.211614 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 939/1914] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:54.216402 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b161d7-49b4-4527-8baf-e0b428a5a56b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:54.226889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b161d7-49b4-4527-8baf-e0b428a5a56b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:54.232711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-83df6716-3471-4182-9d25-fb2a8a015685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d269025a1b4cb78cb4f81be8c17634'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:54.233169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dfa22-0fd8-4177-a7f6-f553e9099d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:54.233916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dfa22-0fd8-4177-a7f6-f553e9099d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:54.234270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dfa22-0fd8-4177-a7f6-f553e9099d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:54.234644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dfa22-0fd8-4177-a7f6-f553e9099d82 admin admin] PATH_INFO: `/v3/projects/19222479cea0420490f6c0463ed53bac/users/998c1892f03b44c19f82c90107f1b2d1/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:54.251915 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dfa22-0fd8-4177-a7f6-f553e9099d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19222479cea0420490f6c0463ed53bac, user_id=998c1892f03b44c19f82c90107f1b2d1, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:54.254673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dfa22-0fd8-4177-a7f6-f553e9099d82 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:54.259722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-83df6716-3471-4182-9d25-fb2a8a015685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d269025a1b4cb78cb4f81be8c17634'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:54.262674 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-83df6716-3471-4182-9d25-fb2a8a015685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d269025a1b4cb78cb4f81be8c17634'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:54.263364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-83df6716-3471-4182-9d25-fb2a8a015685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d269025a1b4cb78cb4f81be8c17634'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:54.272273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-83df6716-3471-4182-9d25-fb2a8a015685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d269025a1b4cb78cb4f81be8c17634'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:54.282897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 940/1915] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:54 2022] PUT /identity/v3/projects/19222479cea0420490f6c0463ed53bac/users/998c1892f03b44c19f82c90107f1b2d1/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:54.286516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0beacf-dd4d-4253-b3d5-0733d26d2f55 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:54.286811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0beacf-dd4d-4253-b3d5-0733d26d2f55 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:54.288563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 976/1916] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:54 2022] DELETE /identity/v3/users/d0d269025a1b4cb78cb4f81be8c17634 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:33:54.289227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0beacf-dd4d-4253-b3d5-0733d26d2f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:54.294035 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77d213-91ea-4066-a6b3-78973fe70c8d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:54.294453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77d213-91ea-4066-a6b3-78973fe70c8d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:54.294840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77d213-91ea-4066-a6b3-78973fe70c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:54.321912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3c0beacf-dd4d-4253-b3d5-0733d26d2f55 None None] MFA Rules not processed for user `998c1892f03b44c19f82c90107f1b2d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:54.323259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3c0beacf-dd4d-4253-b3d5-0733d26d2f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:54.323613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7c77d213-91ea-4066-a6b3-78973fe70c8d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:54.325289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7c77d213-91ea-4066-a6b3-78973fe70c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:54.347110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:54.402976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 977/1917] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:33:54.409672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 941/1918] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:54.413061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77d213-91ea-4066-a6b3-78973fe70c8d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:54.414683 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7c77d213-91ea-4066-a6b3-78973fe70c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:54.420681 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0beacf-dd4d-4253-b3d5-0733d26d2f55 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:54.422252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3c0beacf-dd4d-4253-b3d5-0733d26d2f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:54.480368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77d213-91ea-4066-a6b3-78973fe70c8d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:54.481180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0beacf-dd4d-4253-b3d5-0733d26d2f55 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:54.484043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34235837-55f5-4a57-a20d-7c7ccfebcd16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:54.484655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34235837-55f5-4a57-a20d-7c7ccfebcd16 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:54.484861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5006cda-93c0-440c-bebc-251b74d1d110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:54.485013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34235837-55f5-4a57-a20d-7c7ccfebcd16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:54.485329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34235837-55f5-4a57-a20d-7c7ccfebcd16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:54.485594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5006cda-93c0-440c-bebc-251b74d1d110 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:54.493896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5006cda-93c0-440c-bebc-251b74d1d110 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:54.494737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5006cda-93c0-440c-bebc-251b74d1d110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:54.498237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34235837-55f5-4a57-a20d-7c7ccfebcd16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:54.499683 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34235837-55f5-4a57-a20d-7c7ccfebcd16 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:54.513747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5006cda-93c0-440c-bebc-251b74d1d110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:54.515226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5006cda-93c0-440c-bebc-251b74d1d110 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:54.524056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 978/1919] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:54.541043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 942/1920] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:33:55.138226 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34235837-55f5-4a57-a20d-7c7ccfebcd16 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:55.140048 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-34235837-55f5-4a57-a20d-7c7ccfebcd16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:55.169739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34235837-55f5-4a57-a20d-7c7ccfebcd16 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:55.179027 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:55.179692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:55.179971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:55.180243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] PATH_INFO: `/v3/projects/081f83edbf894f75aacc64025253e99f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:55.182285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=081f83edbf894f75aacc64025253e99f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:55.184243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:55.233098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '081f83edbf894f75aacc64025253e99f', 'request_id': 'req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.238583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '081f83edbf894f75aacc64025253e99f', 'request_id': 'req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.247487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '081f83edbf894f75aacc64025253e99f', 'request_id': 'req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.260581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] The token cache is being invalidate because project 081f83edbf894f75aacc64025253e99f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:55.260824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.261519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.263041 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 979/1921] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:55 2022] DELETE /identity/v3/projects/081f83edbf894f75aacc64025253e99f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:55.267021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5006cda-93c0-440c-bebc-251b74d1d110 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:55.277935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5006cda-93c0-440c-bebc-251b74d1d110 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:55.294628 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:55.340347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c70de7-a3cf-487d-aa19-e4626a8dc4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:55.341045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c70de7-a3cf-487d-aa19-e4626a8dc4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:55.341414 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c70de7-a3cf-487d-aa19-e4626a8dc4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:55.341604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c70de7-a3cf-487d-aa19-e4626a8dc4da admin admin] PATH_INFO: `/v3/users/89c9781e42654e19b6aa1412b2b53b3d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:55.342964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c70de7-a3cf-487d-aa19-e4626a8dc4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c9781e42654e19b6aa1412b2b53b3d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:55.345089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c70de7-a3cf-487d-aa19-e4626a8dc4da admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:55.396539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-99c70de7-a3cf-487d-aa19-e4626a8dc4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c9781e42654e19b6aa1412b2b53b3d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.403812 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-99c70de7-a3cf-487d-aa19-e4626a8dc4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c9781e42654e19b6aa1412b2b53b3d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.417185 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-99c70de7-a3cf-487d-aa19-e4626a8dc4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c9781e42654e19b6aa1412b2b53b3d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.417843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-99c70de7-a3cf-487d-aa19-e4626a8dc4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c9781e42654e19b6aa1412b2b53b3d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.418602 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-99c70de7-a3cf-487d-aa19-e4626a8dc4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c9781e42654e19b6aa1412b2b53b3d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.433132 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 943/1922] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:55 2022] DELETE /identity/v3/users/89c9781e42654e19b6aa1412b2b53b3d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:55.778383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:55.779916 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:55.793700 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb1bff-feb8-4b60-9bd6-134bbe9e82f8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:55.839514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:55.853620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a086b7-6164-418f-a1b0-338f199b6a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:55.854283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a086b7-6164-418f-a1b0-338f199b6a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:55.854570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a086b7-6164-418f-a1b0-338f199b6a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:55.854851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a086b7-6164-418f-a1b0-338f199b6a5a admin admin] PATH_INFO: `/v3/projects/f25b0409a0c5444cb348033ee44246c1` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:55.856015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a086b7-6164-418f-a1b0-338f199b6a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25b0409a0c5444cb348033ee44246c1)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:55.857964 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a086b7-6164-418f-a1b0-338f199b6a5a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:55.904211 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-01a086b7-6164-418f-a1b0-338f199b6a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25b0409a0c5444cb348033ee44246c1', 'request_id': 'req-01a086b7-6164-418f-a1b0-338f199b6a5a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.909666 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-01a086b7-6164-418f-a1b0-338f199b6a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25b0409a0c5444cb348033ee44246c1', 'request_id': 'req-01a086b7-6164-418f-a1b0-338f199b6a5a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.917672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-01a086b7-6164-418f-a1b0-338f199b6a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25b0409a0c5444cb348033ee44246c1', 'request_id': 'req-01a086b7-6164-418f-a1b0-338f199b6a5a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.928873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-01a086b7-6164-418f-a1b0-338f199b6a5a admin admin] The token cache is being invalidate because project f25b0409a0c5444cb348033ee44246c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:55.929199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-01a086b7-6164-418f-a1b0-338f199b6a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.929844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-01a086b7-6164-418f-a1b0-338f199b6a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:55.931684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 980/1923] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:55 2022] DELETE /identity/v3/projects/f25b0409a0c5444cb348033ee44246c1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:55.937172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d927416-c7a8-4a8c-bc9e-fa474bb17398 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:55.937476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d927416-c7a8-4a8c-bc9e-fa474bb17398 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:55.937772 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d927416-c7a8-4a8c-bc9e-fa474bb17398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:55.960226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0d927416-c7a8-4a8c-bc9e-fa474bb17398 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:55.961508 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0d927416-c7a8-4a8c-bc9e-fa474bb17398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:56.028132 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 944/1924] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:56.037307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa81b-a56e-45bb-9ffa-b06d06a2512b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:56.037886 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa81b-a56e-45bb-9ffa-b06d06a2512b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:56.038448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aa81b-a56e-45bb-9ffa-b06d06a2512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:56.072298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-625aa81b-a56e-45bb-9ffa-b06d06a2512b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:56.074662 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-625aa81b-a56e-45bb-9ffa-b06d06a2512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:56.090364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 981/1925] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:56.094578 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d927416-c7a8-4a8c-bc9e-fa474bb17398 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:56.109897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d927416-c7a8-4a8c-bc9e-fa474bb17398 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:56.114968 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6df820-a48e-4981-abc7-fbebf2b410a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:56.115599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6df820-a48e-4981-abc7-fbebf2b410a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:56.115880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6df820-a48e-4981-abc7-fbebf2b410a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:56.116153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6df820-a48e-4981-abc7-fbebf2b410a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:56.117054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6df820-a48e-4981-abc7-fbebf2b410a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:33:56.117331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6df820-a48e-4981-abc7-fbebf2b410a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:56.119197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6df820-a48e-4981-abc7-fbebf2b410a0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:56.136950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 945/1926] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:33:56.140116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa81b-a56e-45bb-9ffa-b06d06a2512b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:56.149882 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aa81b-a56e-45bb-9ffa-b06d06a2512b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:56.154837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d138c7-53ed-4b31-85d2-0921a3bf0972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:56.155453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d138c7-53ed-4b31-85d2-0921a3bf0972 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:56.155738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d138c7-53ed-4b31-85d2-0921a3bf0972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:56.156018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d138c7-53ed-4b31-85d2-0921a3bf0972 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:56.156686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d138c7-53ed-4b31-85d2-0921a3bf0972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:56.158599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d138c7-53ed-4b31-85d2-0921a3bf0972 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:56.188107 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 982/1927] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:56 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:56.193785 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6df820-a48e-4981-abc7-fbebf2b410a0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:56.207178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6df820-a48e-4981-abc7-fbebf2b410a0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:56.236178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:56.293054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72204503-98f0-48be-b6a1-3182caaf40a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:56.294326 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72204503-98f0-48be-b6a1-3182caaf40a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:56.296248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72204503-98f0-48be-b6a1-3182caaf40a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:56.300950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72204503-98f0-48be-b6a1-3182caaf40a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:56.302055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72204503-98f0-48be-b6a1-3182caaf40a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:56.304962 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72204503-98f0-48be-b6a1-3182caaf40a5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:56.342510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 946/1928] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:56 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:56.347028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d138c7-53ed-4b31-85d2-0921a3bf0972 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:56.380372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d138c7-53ed-4b31-85d2-0921a3bf0972 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:56.393461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04876fa6-53ce-467b-88ed-3f64054170bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:56.398337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04876fa6-53ce-467b-88ed-3f64054170bb admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:56.398639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04876fa6-53ce-467b-88ed-3f64054170bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:56.398921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04876fa6-53ce-467b-88ed-3f64054170bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:56.401679 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04876fa6-53ce-467b-88ed-3f64054170bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:56.406718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04876fa6-53ce-467b-88ed-3f64054170bb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:56.438339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 983/1929] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:56.439948 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72204503-98f0-48be-b6a1-3182caaf40a5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:56.463570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72204503-98f0-48be-b6a1-3182caaf40a5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:56.479441 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa1f89-9c42-420e-9084-61988d2d8f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:56.480178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa1f89-9c42-420e-9084-61988d2d8f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:56.480535 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa1f89-9c42-420e-9084-61988d2d8f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:56.480821 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa1f89-9c42-420e-9084-61988d2d8f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:56.481740 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa1f89-9c42-420e-9084-61988d2d8f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:56.486363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa1f89-9c42-420e-9084-61988d2d8f61 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:56.516994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 947/1930] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:56.520253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04876fa6-53ce-467b-88ed-3f64054170bb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:56.535390 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04876fa6-53ce-467b-88ed-3f64054170bb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:56.544269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58a18b-cd08-4365-884a-b444af3b750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:56.545176 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58a18b-cd08-4365-884a-b444af3b750b admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:56.545561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58a18b-cd08-4365-884a-b444af3b750b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:56.546128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58a18b-cd08-4365-884a-b444af3b750b admin admin] PATH_INFO: `/v3/projects/2d9c357c0a154e81be62b426ec4e2ac9/users/bcac688f0c6f459d9b378088a63301e9/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:56.569064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58a18b-cd08-4365-884a-b444af3b750b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9c357c0a154e81be62b426ec4e2ac9, user_id=bcac688f0c6f459d9b378088a63301e9, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:56.573116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58a18b-cd08-4365-884a-b444af3b750b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:56.609960 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 984/1931] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:56 2022] PUT /identity/v3/projects/2d9c357c0a154e81be62b426ec4e2ac9/users/bcac688f0c6f459d9b378088a63301e9/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:56.614622 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10167f1-e0b1-43d4-8198-d77c4bc25941 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:56.615729 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10167f1-e0b1-43d4-8198-d77c4bc25941 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:56.619169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10167f1-e0b1-43d4-8198-d77c4bc25941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:56.715682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a10167f1-e0b1-43d4-8198-d77c4bc25941 None None] MFA Rules not processed for user `bcac688f0c6f459d9b378088a63301e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:56.717608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a10167f1-e0b1-43d4-8198-d77c4bc25941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:56.959958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 948/1932] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:56.965106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58a18b-cd08-4365-884a-b444af3b750b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:57.092748 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58a18b-cd08-4365-884a-b444af3b750b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:57.099229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9a66b-257d-4f40-9cb6-328b9c458ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:57.100283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9a66b-257d-4f40-9cb6-328b9c458ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:57.100810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9a66b-257d-4f40-9cb6-328b9c458ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:57.101338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9a66b-257d-4f40-9cb6-328b9c458ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:57.103763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9a66b-257d-4f40-9cb6-328b9c458ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:57.105952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9a66b-257d-4f40-9cb6-328b9c458ebd admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:57.156677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:57.174920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 985/1933] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:33:56 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:57.179137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10167f1-e0b1-43d4-8198-d77c4bc25941 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:57.206176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10167f1-e0b1-43d4-8198-d77c4bc25941 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:57.275149 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef81b64-d472-4fb6-b7cd-527d733c48ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:57.276005 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef81b64-d472-4fb6-b7cd-527d733c48ee admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:57.276292 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef81b64-d472-4fb6-b7cd-527d733c48ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:57.276568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef81b64-d472-4fb6-b7cd-527d733c48ee admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:57.277353 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef81b64-d472-4fb6-b7cd-527d733c48ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:57.279312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef81b64-d472-4fb6-b7cd-527d733c48ee admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:57.301490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 949/1934] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:33:57 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:33:57.305648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9a66b-257d-4f40-9cb6-328b9c458ebd admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:57.316080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9a66b-257d-4f40-9cb6-328b9c458ebd admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:57.321291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fc36f-01e0-4c7b-9543-d8f4b31371e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:57.321921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fc36f-01e0-4c7b-9543-d8f4b31371e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:57.322198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fc36f-01e0-4c7b-9543-d8f4b31371e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:57.322472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fc36f-01e0-4c7b-9543-d8f4b31371e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:57.323169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fc36f-01e0-4c7b-9543-d8f4b31371e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:57.324751 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fc36f-01e0-4c7b-9543-d8f4b31371e6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:57.337848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 986/1935] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:57.342313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef81b64-d472-4fb6-b7cd-527d733c48ee admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:57.352937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef81b64-d472-4fb6-b7cd-527d733c48ee admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:57.357961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6a126-9a1b-4a12-962e-1a471b73ad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:57.358638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a126-9a1b-4a12-962e-1a471b73ad9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:57.358921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a126-9a1b-4a12-962e-1a471b73ad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:57.359196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a126-9a1b-4a12-962e-1a471b73ad9d admin admin] PATH_INFO: `/v3/projects/d7e1a95329d04afd86f4c943f7338e14/users/6f703d57281049acbb4e404b012f99ae/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:57.375649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6a126-9a1b-4a12-962e-1a471b73ad9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e1a95329d04afd86f4c943f7338e14, user_id=6f703d57281049acbb4e404b012f99ae, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:57.378968 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6a126-9a1b-4a12-962e-1a471b73ad9d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:57.389139 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:57.398782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fc36f-01e0-4c7b-9543-d8f4b31371e6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:57.399232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 950/1936] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:57 2022] PUT /identity/v3/projects/d7e1a95329d04afd86f4c943f7338e14/users/6f703d57281049acbb4e404b012f99ae/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:57.408823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fc36f-01e0-4c7b-9543-d8f4b31371e6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:57.467182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f94570-28f0-4186-81f0-49d13e7722b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:57.467843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f94570-28f0-4186-81f0-49d13e7722b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:57.468102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f94570-28f0-4186-81f0-49d13e7722b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:57.468450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f94570-28f0-4186-81f0-49d13e7722b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:57.469124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f94570-28f0-4186-81f0-49d13e7722b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:57.470669 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f94570-28f0-4186-81f0-49d13e7722b8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:57.481708 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 987/1937] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:33:57.486845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6a126-9a1b-4a12-962e-1a471b73ad9d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:57.497465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6a126-9a1b-4a12-962e-1a471b73ad9d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:57.502002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0bbb2-5dda-409a-a0d9-473ae0462ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:57.502658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0bbb2-5dda-409a-a0d9-473ae0462ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:57.502937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0bbb2-5dda-409a-a0d9-473ae0462ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:57.503212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0bbb2-5dda-409a-a0d9-473ae0462ed0 admin admin] PATH_INFO: `/v3/projects/d7e1a95329d04afd86f4c943f7338e14/users/6f703d57281049acbb4e404b012f99ae/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:57.505174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0bbb2-5dda-409a-a0d9-473ae0462ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e1a95329d04afd86f4c943f7338e14, user_id=6f703d57281049acbb4e404b012f99ae, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:57.507770 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0bbb2-5dda-409a-a0d9-473ae0462ed0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:57.519716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 951/1938] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:33:57 2022] PUT /identity/v3/projects/d7e1a95329d04afd86f4c943f7338e14/users/6f703d57281049acbb4e404b012f99ae/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:57.531530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9c910-1805-410c-8e52-a650294e2227 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:57.531910 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9c910-1805-410c-8e52-a650294e2227 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:57.532340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9c910-1805-410c-8e52-a650294e2227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:57.563273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4cf9c910-1805-410c-8e52-a650294e2227 None None] MFA Rules not processed for user `6f703d57281049acbb4e404b012f99ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:33:57.564736 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4cf9c910-1805-410c-8e52-a650294e2227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:57.655799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 988/1939] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:33:57.670155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0bbb2-5dda-409a-a0d9-473ae0462ed0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:57.673065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3dd0bbb2-5dda-409a-a0d9-473ae0462ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:57.772934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0bbb2-5dda-409a-a0d9-473ae0462ed0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:57.777297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37668d4-51b5-46dd-9992-af1d553f9e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:57.778099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37668d4-51b5-46dd-9992-af1d553f9e24 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:57.778684 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37668d4-51b5-46dd-9992-af1d553f9e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:57.779027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37668d4-51b5-46dd-9992-af1d553f9e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:57.882134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37668d4-51b5-46dd-9992-af1d553f9e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:57.885993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37668d4-51b5-46dd-9992-af1d553f9e24 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:57.916779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 952/1940] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:02.621449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9c910-1805-410c-8e52-a650294e2227 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:02.631255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9c910-1805-410c-8e52-a650294e2227 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:02.635473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3c512-ca50-4eb9-850a-d335bdf20653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:02.636203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3c512-ca50-4eb9-850a-d335bdf20653 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:02.636592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3c512-ca50-4eb9-850a-d335bdf20653 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:02.637119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3c512-ca50-4eb9-850a-d335bdf20653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:02.648259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3c512-ca50-4eb9-850a-d335bdf20653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:02.650891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3c512-ca50-4eb9-850a-d335bdf20653 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:02.662185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 989/1941] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:03.316738 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37668d4-51b5-46dd-9992-af1d553f9e24 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:03.318321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a37668d4-51b5-46dd-9992-af1d553f9e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:03.394880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37668d4-51b5-46dd-9992-af1d553f9e24 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:03.399975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:03.400614 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:03.401445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:03.401445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] PATH_INFO: `/v3/users/e02f449354af45a9a89349306245620e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:03.402378 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02f449354af45a9a89349306245620e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:03.404372 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:03.451664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:03.454766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02f449354af45a9a89349306245620e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:03.465589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02f449354af45a9a89349306245620e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:03.479132 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02f449354af45a9a89349306245620e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:03.479877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02f449354af45a9a89349306245620e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:03.480481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02f449354af45a9a89349306245620e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:03.495955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 953/1942] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:03 2022] DELETE /identity/v3/users/e02f449354af45a9a89349306245620e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:03.500652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301ec65-0a43-4d5b-93cf-464738cbb9a9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:03.505019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301ec65-0a43-4d5b-93cf-464738cbb9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:03.505305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301ec65-0a43-4d5b-93cf-464738cbb9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:03.537305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8301ec65-0a43-4d5b-93cf-464738cbb9a9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:03.538563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8301ec65-0a43-4d5b-93cf-464738cbb9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:03.601117 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:03.616522 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 990/1943] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:03.626562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:03.628622 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:03.709090 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e002655-2042-4fdf-8b8e-73c10fe64c85 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:03.713864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c38a9-4e6f-4dd8-96cb-4baf7a01e9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:03.714608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c38a9-4e6f-4dd8-96cb-4baf7a01e9cb service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:03.714971 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c38a9-4e6f-4dd8-96cb-4baf7a01e9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:03.716072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c38a9-4e6f-4dd8-96cb-4baf7a01e9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:03.731129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c38a9-4e6f-4dd8-96cb-4baf7a01e9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:03.732316 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c38a9-4e6f-4dd8-96cb-4baf7a01e9cb service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:03.746766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 954/1944] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:04.713918 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301ec65-0a43-4d5b-93cf-464738cbb9a9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:04.716277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8301ec65-0a43-4d5b-93cf-464738cbb9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:04.778054 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301ec65-0a43-4d5b-93cf-464738cbb9a9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:04.795617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:04.796289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:04.796583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:04.796848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] PATH_INFO: `/v3/projects/c3a4070d23f1410f8ce5d1930750d091` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:04.799484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a4070d23f1410f8ce5d1930750d091)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:04.801681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:04.912941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a4070d23f1410f8ce5d1930750d091', 'request_id': 'req-c509f94b-7788-4a04-b83c-e330e0005f6e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:04.921506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a4070d23f1410f8ce5d1930750d091', 'request_id': 'req-c509f94b-7788-4a04-b83c-e330e0005f6e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:04.932256 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a4070d23f1410f8ce5d1930750d091', 'request_id': 'req-c509f94b-7788-4a04-b83c-e330e0005f6e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:04.946610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] The token cache is being invalidate because project c3a4070d23f1410f8ce5d1930750d091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:04.947227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:04.948350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:04.953551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 991/1945] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:04 2022] DELETE /identity/v3/projects/c3a4070d23f1410f8ce5d1930750d091 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:04.954743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c38a9-4e6f-4dd8-96cb-4baf7a01e9cb service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:04.967059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c38a9-4e6f-4dd8-96cb-4baf7a01e9cb service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:05.045844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:05.046603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:05.046898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:05.047184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] PATH_INFO: `/v3/users/4d28cee4bd5d481891ededc996fee54d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:05.049077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d28cee4bd5d481891ededc996fee54d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:05.051099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:05.100785 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d28cee4bd5d481891ededc996fee54d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:05.108689 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d28cee4bd5d481891ededc996fee54d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:05.116092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:05.123821 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d28cee4bd5d481891ededc996fee54d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:05.124760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d28cee4bd5d481891ededc996fee54d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:05.125469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d28cee4bd5d481891ededc996fee54d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:05.141474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 955/1946] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:04 2022] DELETE /identity/v3/users/4d28cee4bd5d481891ededc996fee54d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:05.790730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:05.793401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:05.809960 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509f94b-7788-4a04-b83c-e330e0005f6e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:05.881054 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894244a3-b31a-49e7-8112-a6d657ef7b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:05.881768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894244a3-b31a-49e7-8112-a6d657ef7b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:05.882196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894244a3-b31a-49e7-8112-a6d657ef7b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:05.882477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894244a3-b31a-49e7-8112-a6d657ef7b90 admin admin] PATH_INFO: `/v3/projects/683c932b65914b1481f63b953c7a9ae9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:05.883860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894244a3-b31a-49e7-8112-a6d657ef7b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=683c932b65914b1481f63b953c7a9ae9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:05.886459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894244a3-b31a-49e7-8112-a6d657ef7b90 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:05.940688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-894244a3-b31a-49e7-8112-a6d657ef7b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683c932b65914b1481f63b953c7a9ae9', 'request_id': 'req-894244a3-b31a-49e7-8112-a6d657ef7b90'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:05.947906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-894244a3-b31a-49e7-8112-a6d657ef7b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683c932b65914b1481f63b953c7a9ae9', 'request_id': 'req-894244a3-b31a-49e7-8112-a6d657ef7b90'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:05.956676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-894244a3-b31a-49e7-8112-a6d657ef7b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683c932b65914b1481f63b953c7a9ae9', 'request_id': 'req-894244a3-b31a-49e7-8112-a6d657ef7b90'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:05.964756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:05.966887 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:05.971453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-894244a3-b31a-49e7-8112-a6d657ef7b90 admin admin] The token cache is being invalidate because project 683c932b65914b1481f63b953c7a9ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:05.971748 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-894244a3-b31a-49e7-8112-a6d657ef7b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:05.972388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-894244a3-b31a-49e7-8112-a6d657ef7b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:05.973926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 992/1947] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:05 2022] DELETE /identity/v3/projects/683c932b65914b1481f63b953c7a9ae9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:05.979662 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715237a-c89e-48c8-baf2-34a31c984d22 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:05.979954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715237a-c89e-48c8-baf2-34a31c984d22 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:05.980259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715237a-c89e-48c8-baf2-34a31c984d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:05.980671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a37f33-39e1-4d49-bb39-9b5e59105460 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:06.002469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d715237a-c89e-48c8-baf2-34a31c984d22 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:06.003698 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d715237a-c89e-48c8-baf2-34a31c984d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:06.010830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:06.052409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:06.053180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.053474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.053911 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] PATH_INFO: `/v3/users/998c1892f03b44c19f82c90107f1b2d1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.055986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=998c1892f03b44c19f82c90107f1b2d1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:06.058990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:06.079810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 993/1948] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:06.090090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392b80a-34db-4d2f-b67c-4c572d4b3c0d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.090671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392b80a-34db-4d2f-b67c-4c572d4b3c0d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.090671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392b80a-34db-4d2f-b67c-4c572d4b3c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.116354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0392b80a-34db-4d2f-b67c-4c572d4b3c0d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:06.117898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0392b80a-34db-4d2f-b67c-4c572d4b3c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:06.125128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998c1892f03b44c19f82c90107f1b2d1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:06.127152 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 994/1949] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:34:06.131505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392b80a-34db-4d2f-b67c-4c572d4b3c0d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:06.134566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998c1892f03b44c19f82c90107f1b2d1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:06.143276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392b80a-34db-4d2f-b67c-4c572d4b3c0d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:06.148478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44944e27-9ad4-4ce0-974d-54baa36e13c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:06.149987 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44944e27-9ad4-4ce0-974d-54baa36e13c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.150548 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44944e27-9ad4-4ce0-974d-54baa36e13c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.151196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44944e27-9ad4-4ce0-974d-54baa36e13c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.152024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44944e27-9ad4-4ce0-974d-54baa36e13c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:34:06.152510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44944e27-9ad4-4ce0-974d-54baa36e13c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:06.153834 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998c1892f03b44c19f82c90107f1b2d1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:06.154315 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44944e27-9ad4-4ce0-974d-54baa36e13c0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:06.154732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998c1892f03b44c19f82c90107f1b2d1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:06.155389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998c1892f03b44c19f82c90107f1b2d1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:06.173738 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 956/1950] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:05 2022] DELETE /identity/v3/users/998c1892f03b44c19f82c90107f1b2d1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:06.176083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 995/1951] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:34:06.177876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:06.179453 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:06.186354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089210-30ba-45da-a32f-ed352689213c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.186737 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089210-30ba-45da-a32f-ed352689213c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.187234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089210-30ba-45da-a32f-ed352689213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.210708 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1b089210-30ba-45da-a32f-ed352689213c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:06.212655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1b089210-30ba-45da-a32f-ed352689213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:06.286339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78946bde-f2ed-4aa0-b46d-ab73e16c53f6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:06.292557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6f376-bd35-4350-8774-14aee98452be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:06.293214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6f376-bd35-4350-8774-14aee98452be admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.293741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6f376-bd35-4350-8774-14aee98452be admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.294570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6f376-bd35-4350-8774-14aee98452be admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.294811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6f376-bd35-4350-8774-14aee98452be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:06.297103 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6f376-bd35-4350-8774-14aee98452be admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:06.307861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 996/1952] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:06.319159 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089210-30ba-45da-a32f-ed352689213c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:06.320726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1b089210-30ba-45da-a32f-ed352689213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:06.322218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:06.343598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 957/1953] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:06 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:06.348833 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6f376-bd35-4350-8774-14aee98452be admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:06.406177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089210-30ba-45da-a32f-ed352689213c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:06.424287 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6f376-bd35-4350-8774-14aee98452be admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:06.428989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4aa6e-3e6c-4a11-b4c5-6e64c5c9675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:06.429601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4aa6e-3e6c-4a11-b4c5-6e64c5c9675f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.429884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4aa6e-3e6c-4a11-b4c5-6e64c5c9675f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.430191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4aa6e-3e6c-4a11-b4c5-6e64c5c9675f admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.430984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4aa6e-3e6c-4a11-b4c5-6e64c5c9675f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:06.432888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4aa6e-3e6c-4a11-b4c5-6e64c5c9675f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:06.454459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 958/1954] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:06 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:06.456343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:06.458565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4aa6e-3e6c-4a11-b4c5-6e64c5c9675f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:06.462432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c39d4f-090c-4dfe-b422-bb405f2ed8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:06.463244 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c39d4f-090c-4dfe-b422-bb405f2ed8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.463529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c39d4f-090c-4dfe-b422-bb405f2ed8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.463908 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c39d4f-090c-4dfe-b422-bb405f2ed8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.468619 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4aa6e-3e6c-4a11-b4c5-6e64c5c9675f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:06.473024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c39d4f-090c-4dfe-b422-bb405f2ed8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:06.473208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513bba9-6153-47a6-833d-98694cf9e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:06.473766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513bba9-6153-47a6-833d-98694cf9e689 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.474042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513bba9-6153-47a6-833d-98694cf9e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.474318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513bba9-6153-47a6-833d-98694cf9e689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.474476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c39d4f-090c-4dfe-b422-bb405f2ed8c6 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:06.475006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513bba9-6153-47a6-833d-98694cf9e689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:06.476578 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513bba9-6153-47a6-833d-98694cf9e689 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:06.484758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 997/1955] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:34:06.487628 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 959/1956] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:34:06.491448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c39d4f-090c-4dfe-b422-bb405f2ed8c6 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:06.502113 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c39d4f-090c-4dfe-b422-bb405f2ed8c6 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:06.506900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd3442-7d27-44ba-b0b0-afe3bed756de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:06.507639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd3442-7d27-44ba-b0b0-afe3bed756de admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.507926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd3442-7d27-44ba-b0b0-afe3bed756de admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.508310 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd3442-7d27-44ba-b0b0-afe3bed756de admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.509117 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd3442-7d27-44ba-b0b0-afe3bed756de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:06.511163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd3442-7d27-44ba-b0b0-afe3bed756de admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:06.522752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 998/1957] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:06.528071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513bba9-6153-47a6-833d-98694cf9e689 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:06.543912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513bba9-6153-47a6-833d-98694cf9e689 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:06.554056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa35ea5-989e-44ca-b4ea-ecd9dfd5d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:06.555417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa35ea5-989e-44ca-b4ea-ecd9dfd5d559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.555944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa35ea5-989e-44ca-b4ea-ecd9dfd5d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.556313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa35ea5-989e-44ca-b4ea-ecd9dfd5d559 admin admin] PATH_INFO: `/v3/projects/455636ad69f449999849398aa467e570/users/4bd1a69489bb4ef8a13dc6b040348aa7/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.581450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa35ea5-989e-44ca-b4ea-ecd9dfd5d559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=455636ad69f449999849398aa467e570, user_id=4bd1a69489bb4ef8a13dc6b040348aa7, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:06.585359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa35ea5-989e-44ca-b4ea-ecd9dfd5d559 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:06.615704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 960/1958] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:06 2022] PUT /identity/v3/projects/455636ad69f449999849398aa467e570/users/4bd1a69489bb4ef8a13dc6b040348aa7/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:06.618273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22665c-958f-4a14-a7f3-269af977d60d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.618273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22665c-958f-4a14-a7f3-269af977d60d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.618913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22665c-958f-4a14-a7f3-269af977d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.654527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4b22665c-958f-4a14-a7f3-269af977d60d None None] MFA Rules not processed for user `4bd1a69489bb4ef8a13dc6b040348aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:06.655865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4b22665c-958f-4a14-a7f3-269af977d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:06.793484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 999/1959] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:06.795668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa35ea5-989e-44ca-b4ea-ecd9dfd5d559 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:06.880528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa35ea5-989e-44ca-b4ea-ecd9dfd5d559 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:06.886722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f1ba1-767a-4c80-9394-ed19002ebdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:06.887344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f1ba1-767a-4c80-9394-ed19002ebdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.890343 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f1ba1-767a-4c80-9394-ed19002ebdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.890343 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f1ba1-767a-4c80-9394-ed19002ebdd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.890343 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f1ba1-767a-4c80-9394-ed19002ebdd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:06.891296 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f1ba1-767a-4c80-9394-ed19002ebdd4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:06.892268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22665c-958f-4a14-a7f3-269af977d60d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:06.893780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4b22665c-958f-4a14-a7f3-269af977d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:06.909214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22665c-958f-4a14-a7f3-269af977d60d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:06.914542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:06.915321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:06.915650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:06.915798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa admin admin] PATH_INFO: `/v3/projects/19222479cea0420490f6c0463ed53bac` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:06.917245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=19222479cea0420490f6c0463ed53bac)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:06.919405 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:06.930801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 961/1960] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:06 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:06.935156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f1ba1-767a-4c80-9394-ed19002ebdd4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:06.978861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:06.984981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19222479cea0420490f6c0463ed53bac', 'request_id': 'req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:06.991987 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19222479cea0420490f6c0463ed53bac', 'request_id': 'req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:07.000737 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19222479cea0420490f6c0463ed53bac', 'request_id': 'req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:07.013099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa admin admin] The token cache is being invalidate because project 19222479cea0420490f6c0463ed53bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:07.013389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:07.014119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fe4d0ff4-8a99-489b-bf4c-4d16e0ee3cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:07.015607 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1000/1961] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:06 2022] DELETE /identity/v3/projects/19222479cea0420490f6c0463ed53bac => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:07.018887 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f1ba1-767a-4c80-9394-ed19002ebdd4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.020436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a20c8-b47f-4df7-9ae3-ca0c810663f5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.020732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a20c8-b47f-4df7-9ae3-ca0c810663f5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.021120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a20c8-b47f-4df7-9ae3-ca0c810663f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.043376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-907a20c8-b47f-4df7-9ae3-ca0c810663f5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:07.044587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-907a20c8-b47f-4df7-9ae3-ca0c810663f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:07.085407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea695629-0870-4a85-a0f0-839f1020d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.085918 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea695629-0870-4a85-a0f0-839f1020d08f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.086933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea695629-0870-4a85-a0f0-839f1020d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.087220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea695629-0870-4a85-a0f0-839f1020d08f admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.087891 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea695629-0870-4a85-a0f0-839f1020d08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.089884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea695629-0870-4a85-a0f0-839f1020d08f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.110745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:07.112839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 962/1962] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:06 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:07.116110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea695629-0870-4a85-a0f0-839f1020d08f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.118307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ea695629-0870-4a85-a0f0-839f1020d08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:07.133954 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea695629-0870-4a85-a0f0-839f1020d08f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.141046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1001/1963] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:07.145541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05badba7-dd2f-4455-b4b4-0a1aaff918bc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.146257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05badba7-dd2f-4455-b4b4-0a1aaff918bc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.146716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05badba7-dd2f-4455-b4b4-0a1aaff918bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.146839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddeae8f-3513-4465-ab81-bfb57dcd6a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.147523 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddeae8f-3513-4465-ab81-bfb57dcd6a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.147937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddeae8f-3513-4465-ab81-bfb57dcd6a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.148458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddeae8f-3513-4465-ab81-bfb57dcd6a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.149974 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddeae8f-3513-4465-ab81-bfb57dcd6a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.152061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddeae8f-3513-4465-ab81-bfb57dcd6a5f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.165987 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 963/1964] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:34:07.170093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddeae8f-3513-4465-ab81-bfb57dcd6a5f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.173625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-05badba7-dd2f-4455-b4b4-0a1aaff918bc None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:07.174835 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-05badba7-dd2f-4455-b4b4-0a1aaff918bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:07.181867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddeae8f-3513-4465-ab81-bfb57dcd6a5f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.184939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1002/1965] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:07.188868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05badba7-dd2f-4455-b4b4-0a1aaff918bc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.190863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278ef1d-51fe-4d3b-bd0e-9d431ab82f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.191545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278ef1d-51fe-4d3b-bd0e-9d431ab82f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.191837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278ef1d-51fe-4d3b-bd0e-9d431ab82f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.192117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278ef1d-51fe-4d3b-bd0e-9d431ab82f14 admin admin] PATH_INFO: `/v3/projects/17641bdab5ca49e49f2802f5401b5bb0/users/ecd07dc3bfc84648a2d12d8ce2b7b321/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.207437 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05badba7-dd2f-4455-b4b4-0a1aaff918bc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.210031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278ef1d-51fe-4d3b-bd0e-9d431ab82f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17641bdab5ca49e49f2802f5401b5bb0, user_id=ecd07dc3bfc84648a2d12d8ce2b7b321, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.213623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278ef1d-51fe-4d3b-bd0e-9d431ab82f14 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.217674 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f30ba-bb74-452c-a5fb-eba5b2ab1b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.219275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f30ba-bb74-452c-a5fb-eba5b2ab1b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.219716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f30ba-bb74-452c-a5fb-eba5b2ab1b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.220014 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f30ba-bb74-452c-a5fb-eba5b2ab1b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.220833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f30ba-bb74-452c-a5fb-eba5b2ab1b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:34:07.221327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f30ba-bb74-452c-a5fb-eba5b2ab1b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.222787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f30ba-bb74-452c-a5fb-eba5b2ab1b3e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.240290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 964/1966] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:07 2022] PUT /identity/v3/projects/17641bdab5ca49e49f2802f5401b5bb0/users/ecd07dc3bfc84648a2d12d8ce2b7b321/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:07.241157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1003/1967] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:34:07.244691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278ef1d-51fe-4d3b-bd0e-9d431ab82f14 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.245939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f30ba-bb74-452c-a5fb-eba5b2ab1b3e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.263920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f30ba-bb74-452c-a5fb-eba5b2ab1b3e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.338149 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278ef1d-51fe-4d3b-bd0e-9d431ab82f14 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.354131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844f61f-fae9-45b1-9f78-013eb1dea8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.354945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844f61f-fae9-45b1-9f78-013eb1dea8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.355272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844f61f-fae9-45b1-9f78-013eb1dea8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.357158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844f61f-fae9-45b1-9f78-013eb1dea8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.357903 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844f61f-fae9-45b1-9f78-013eb1dea8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.370509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db6152-32a1-48bb-bcd4-aa4c21a647f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.371230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db6152-32a1-48bb-bcd4-aa4c21a647f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.371715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db6152-32a1-48bb-bcd4-aa4c21a647f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.371824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db6152-32a1-48bb-bcd4-aa4c21a647f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.372487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db6152-32a1-48bb-bcd4-aa4c21a647f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.374501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db6152-32a1-48bb-bcd4-aa4c21a647f0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.380757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844f61f-fae9-45b1-9f78-013eb1dea8e2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.393950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 965/1968] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:07.398342 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844f61f-fae9-45b1-9f78-013eb1dea8e2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.409243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844f61f-fae9-45b1-9f78-013eb1dea8e2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.410056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1004/1969] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:07 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:07.415205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db6152-32a1-48bb-bcd4-aa4c21a647f0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.440592 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:07.489669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cd853-9a12-4256-9da8-bc6cfdd5aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.490417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cd853-9a12-4256-9da8-bc6cfdd5aba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.490705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cd853-9a12-4256-9da8-bc6cfdd5aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.490982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cd853-9a12-4256-9da8-bc6cfdd5aba5 admin admin] PATH_INFO: `/v3/projects/17641bdab5ca49e49f2802f5401b5bb0/users/ecd07dc3bfc84648a2d12d8ce2b7b321/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.494248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cd853-9a12-4256-9da8-bc6cfdd5aba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17641bdab5ca49e49f2802f5401b5bb0, user_id=ecd07dc3bfc84648a2d12d8ce2b7b321, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.497009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cd853-9a12-4256-9da8-bc6cfdd5aba5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.503442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db6152-32a1-48bb-bcd4-aa4c21a647f0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.509006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 966/1970] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:07 2022] PUT /identity/v3/projects/17641bdab5ca49e49f2802f5401b5bb0/users/ecd07dc3bfc84648a2d12d8ce2b7b321/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:07.519514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9aa7a-d58d-4024-b50b-b7628f041a9e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.519800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9aa7a-d58d-4024-b50b-b7628f041a9e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.520528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9aa7a-d58d-4024-b50b-b7628f041a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.562039 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a7c9aa7a-d58d-4024-b50b-b7628f041a9e None None] MFA Rules not processed for user `ecd07dc3bfc84648a2d12d8ce2b7b321`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:07.563484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a7c9aa7a-d58d-4024-b50b-b7628f041a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:07.572346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b2c4-558e-4032-9c96-849c551a1365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.573021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b2c4-558e-4032-9c96-849c551a1365 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.573440 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b2c4-558e-4032-9c96-849c551a1365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.573837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b2c4-558e-4032-9c96-849c551a1365 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.574516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578b2c4-558e-4032-9c96-849c551a1365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.576567 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578b2c4-558e-4032-9c96-849c551a1365 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.588774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:07.604937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1005/1971] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:07 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:07.608699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b2c4-558e-4032-9c96-849c551a1365 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.620004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b2c4-558e-4032-9c96-849c551a1365 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.624736 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2bf09-a77b-4fac-bd53-c0ac7876da43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.625400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2bf09-a77b-4fac-bd53-c0ac7876da43 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.625674 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2bf09-a77b-4fac-bd53-c0ac7876da43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.625950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2bf09-a77b-4fac-bd53-c0ac7876da43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.626651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2bf09-a77b-4fac-bd53-c0ac7876da43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.628285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2bf09-a77b-4fac-bd53-c0ac7876da43 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.640960 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1006/1972] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:34:07.643878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2bf09-a77b-4fac-bd53-c0ac7876da43 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.653344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 967/1973] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:34:07.659606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2bf09-a77b-4fac-bd53-c0ac7876da43 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.665067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56153-bb26-45c3-9590-c9d97375b764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.665861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9aa7a-d58d-4024-b50b-b7628f041a9e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.666750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56153-bb26-45c3-9590-c9d97375b764 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.667040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56153-bb26-45c3-9590-c9d97375b764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.667234 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a7c9aa7a-d58d-4024-b50b-b7628f041a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:07.667332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56153-bb26-45c3-9590-c9d97375b764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.668142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd56153-bb26-45c3-9590-c9d97375b764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.669818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd56153-bb26-45c3-9590-c9d97375b764 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.681882 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1007/1974] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:34:07.685708 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56153-bb26-45c3-9590-c9d97375b764 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.698603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56153-bb26-45c3-9590-c9d97375b764 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.705551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f655c-73ed-4675-9525-ff8efd1b7dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.706230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f655c-73ed-4675-9525-ff8efd1b7dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.706516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f655c-73ed-4675-9525-ff8efd1b7dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.706797 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f655c-73ed-4675-9525-ff8efd1b7dfe admin admin] PATH_INFO: `/v3/projects/5b9e2d0636404622949975c57f76780d/users/7fc6d933ef05408b8681a08de7b2b4c8/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.725150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f655c-73ed-4675-9525-ff8efd1b7dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9e2d0636404622949975c57f76780d, user_id=7fc6d933ef05408b8681a08de7b2b4c8, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.727819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f655c-73ed-4675-9525-ff8efd1b7dfe admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.728244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9aa7a-d58d-4024-b50b-b7628f041a9e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.732557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c59846-2c99-4f6f-8e0e-65b39a4608af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.733267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59846-2c99-4f6f-8e0e-65b39a4608af service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.733630 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59846-2c99-4f6f-8e0e-65b39a4608af service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.733816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c59846-2c99-4f6f-8e0e-65b39a4608af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.742883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1008/1975] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:07 2022] PUT /identity/v3/projects/5b9e2d0636404622949975c57f76780d/users/7fc6d933ef05408b8681a08de7b2b4c8/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:07.744342 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c59846-2c99-4f6f-8e0e-65b39a4608af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.745827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c59846-2c99-4f6f-8e0e-65b39a4608af service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.749059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c71bf9-19ff-458d-ba15-e1365a439f21 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.749525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c71bf9-19ff-458d-ba15-e1365a439f21 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.749809 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c71bf9-19ff-458d-ba15-e1365a439f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.757592 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 968/1976] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:34:07.770940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-49c71bf9-19ff-458d-ba15-e1365a439f21 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:07.772155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-49c71bf9-19ff-458d-ba15-e1365a439f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:07.787283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c59846-2c99-4f6f-8e0e-65b39a4608af service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.801345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c59846-2c99-4f6f-8e0e-65b39a4608af service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.863212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:07.869836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1009/1977] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:07.870725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c71bf9-19ff-458d-ba15-e1365a439f21 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:07.875614 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-49c71bf9-19ff-458d-ba15-e1365a439f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:07.886574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.887551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.888089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.888546 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] PATH_INFO: `/v3/users/4bd1a69489bb4ef8a13dc6b040348aa7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.889641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c71bf9-19ff-458d-ba15-e1365a439f21 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:07.890534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd1a69489bb4ef8a13dc6b040348aa7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.893419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.894599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f8713-d5da-4a61-a390-efb4b5c02599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:07.895470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f8713-d5da-4a61-a390-efb4b5c02599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:07.895764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f8713-d5da-4a61-a390-efb4b5c02599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:07.896165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f8713-d5da-4a61-a390-efb4b5c02599 admin admin] PATH_INFO: `/v3/users/bcac688f0c6f459d9b378088a63301e9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:07.897416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f8713-d5da-4a61-a390-efb4b5c02599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcac688f0c6f459d9b378088a63301e9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:07.900006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f8713-d5da-4a61-a390-efb4b5c02599 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:07.968292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c00f8713-d5da-4a61-a390-efb4b5c02599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcac688f0c6f459d9b378088a63301e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:07.981994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd1a69489bb4ef8a13dc6b040348aa7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:07.990186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd1a69489bb4ef8a13dc6b040348aa7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:07.991589 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c00f8713-d5da-4a61-a390-efb4b5c02599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcac688f0c6f459d9b378088a63301e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:08.001502 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c00f8713-d5da-4a61-a390-efb4b5c02599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcac688f0c6f459d9b378088a63301e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:08.002309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c00f8713-d5da-4a61-a390-efb4b5c02599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcac688f0c6f459d9b378088a63301e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:08.005143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd1a69489bb4ef8a13dc6b040348aa7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:08.006068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd1a69489bb4ef8a13dc6b040348aa7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:08.006660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd1a69489bb4ef8a13dc6b040348aa7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:08.015816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c00f8713-d5da-4a61-a390-efb4b5c02599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcac688f0c6f459d9b378088a63301e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:08.033861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 969/1978] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:07 2022] DELETE /identity/v3/users/4bd1a69489bb4ef8a13dc6b040348aa7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:08.035157 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:08.036675 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:08.037803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1010/1979] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:07 2022] DELETE /identity/v3/users/bcac688f0c6f459d9b378088a63301e9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:08.046690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a36de-847a-4f5c-9e87-050fe3d44a5c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:08.047404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a36de-847a-4f5c-9e87-050fe3d44a5c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:08.047693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a36de-847a-4f5c-9e87-050fe3d44a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:08.104047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f99a36de-847a-4f5c-9e87-050fe3d44a5c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:08.105521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f99a36de-847a-4f5c-9e87-050fe3d44a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:08.149491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a538d0e-3ff3-4b21-aa80-dc4da654cf2e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:08.149711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:08.229715 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634b705-6a81-403a-8a20-4764b5791da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:08.230466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634b705-6a81-403a-8a20-4764b5791da6 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:08.230752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634b705-6a81-403a-8a20-4764b5791da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:08.231077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634b705-6a81-403a-8a20-4764b5791da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:08.233658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4634b705-6a81-403a-8a20-4764b5791da6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:08.236311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1011/1980] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:08.252056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919916-8a7e-481f-8a22-7f94123b42a4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:08.252427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919916-8a7e-481f-8a22-7f94123b42a4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:08.252968 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919916-8a7e-481f-8a22-7f94123b42a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:08.255811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634b705-6a81-403a-8a20-4764b5791da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:08.257857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634b705-6a81-403a-8a20-4764b5791da6 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:08.283478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 970/1981] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:08.285046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634b705-6a81-403a-8a20-4764b5791da6 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:08.294859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634b705-6a81-403a-8a20-4764b5791da6 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:08.297201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b2919916-8a7e-481f-8a22-7f94123b42a4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:08.298420 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b2919916-8a7e-481f-8a22-7f94123b42a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:08.299248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887698f-51b7-4994-82c5-f869b214ae5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:08.299878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887698f-51b7-4994-82c5-f869b214ae5c service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:08.300295 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887698f-51b7-4994-82c5-f869b214ae5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:08.300455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887698f-51b7-4994-82c5-f869b214ae5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:08.313067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1012/1982] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:08.313704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887698f-51b7-4994-82c5-f869b214ae5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:08.315852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887698f-51b7-4994-82c5-f869b214ae5c service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:08.323678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919916-8a7e-481f-8a22-7f94123b42a4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:08.330648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 971/1983] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:08.345182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919916-8a7e-481f-8a22-7f94123b42a4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:08.348342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf845d-3844-4b4e-bf0c-1ed0cd65e904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:08.349099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf845d-3844-4b4e-bf0c-1ed0cd65e904 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:08.349451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf845d-3844-4b4e-bf0c-1ed0cd65e904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:08.349775 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf845d-3844-4b4e-bf0c-1ed0cd65e904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:08.363927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf845d-3844-4b4e-bf0c-1ed0cd65e904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:08.367034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf845d-3844-4b4e-bf0c-1ed0cd65e904 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:08.384597 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1013/1984] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:34:09.061265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887698f-51b7-4994-82c5-f869b214ae5c service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:09.063121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c887698f-51b7-4994-82c5-f869b214ae5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:09.078823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887698f-51b7-4994-82c5-f869b214ae5c service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:09.088035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:09.088985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:09.089381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:09.089763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] PATH_INFO: `/v3/projects/455636ad69f449999849398aa467e570` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:09.091730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] RBAC: Authorizing `identity:delete_project(project_id=455636ad69f449999849398aa467e570)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:09.094107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:09.102358 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:09.153002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf845d-3844-4b4e-bf0c-1ed0cd65e904 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:09.156482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-24bf845d-3844-4b4e-bf0c-1ed0cd65e904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:09.178777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455636ad69f449999849398aa467e570', 'request_id': 'req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.187719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455636ad69f449999849398aa467e570', 'request_id': 'req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.208945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455636ad69f449999849398aa467e570', 'request_id': 'req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.209292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf845d-3844-4b4e-bf0c-1ed0cd65e904 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:09.229738 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] The token cache is being invalidate because project 455636ad69f449999849398aa467e570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:09.230217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.231108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.235692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 972/1985] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:09 2022] DELETE /identity/v3/projects/455636ad69f449999849398aa467e570 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:09.237529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:09.240443 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:09.336069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:09.337081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:09.337369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:09.337647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787 admin admin] PATH_INFO: `/v3/projects/2d9c357c0a154e81be62b426ec4e2ac9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:09.338851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9c357c0a154e81be62b426ec4e2ac9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:09.340767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:09.376954 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fece9-60ba-4952-a211-4bc6b9f0f2da admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:09.388652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:09.389594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:09.390034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:09.394873 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] PATH_INFO: `/v3/users/ecd07dc3bfc84648a2d12d8ce2b7b321` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:09.397496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd07dc3bfc84648a2d12d8ce2b7b321)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:09.402057 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:09.484106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9c357c0a154e81be62b426ec4e2ac9', 'request_id': 'req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.493301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9c357c0a154e81be62b426ec4e2ac9', 'request_id': 'req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.503779 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9c357c0a154e81be62b426ec4e2ac9', 'request_id': 'req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.504691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd07dc3bfc84648a2d12d8ce2b7b321'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.527995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787 admin admin] The token cache is being invalidate because project 2d9c357c0a154e81be62b426ec4e2ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:09.528391 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.529633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4daa37c1-99f4-4ef6-8d6b-9fa7c2f58787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.530260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd07dc3bfc84648a2d12d8ce2b7b321'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.532008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1014/1986] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:09 2022] DELETE /identity/v3/projects/2d9c357c0a154e81be62b426ec4e2ac9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:09.533418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969a52-3cc0-459b-9e3d-e4651597d03c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:09.533782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969a52-3cc0-459b-9e3d-e4651597d03c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:09.534131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969a52-3cc0-459b-9e3d-e4651597d03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:09.574142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d4969a52-3cc0-459b-9e3d-e4651597d03c None None] MFA Rules not processed for user `7fc6d933ef05408b8681a08de7b2b4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:09.575025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d4969a52-3cc0-459b-9e3d-e4651597d03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:09.575742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd07dc3bfc84648a2d12d8ce2b7b321'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.577233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd07dc3bfc84648a2d12d8ce2b7b321'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.578081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd07dc3bfc84648a2d12d8ce2b7b321'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.606000 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 973/1987] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:09 2022] DELETE /identity/v3/users/ecd07dc3bfc84648a2d12d8ce2b7b321 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:09.608201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:09.611615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:09.620373 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:09.636976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:09.788834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1015/1988] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:09.800313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4969a52-3cc0-459b-9e3d-e4651597d03c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:09.802305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d4969a52-3cc0-459b-9e3d-e4651597d03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:09.802591 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a787faf-a7ac-42f8-beef-ebca675a1adc admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:09.814531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:09.815207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:09.815494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:09.815787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] PATH_INFO: `/v3/users/6f703d57281049acbb4e404b012f99ae` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:09.820657 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f703d57281049acbb4e404b012f99ae)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:09.827989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:09.902978 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4969a52-3cc0-459b-9e3d-e4651597d03c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:09.924944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f703d57281049acbb4e404b012f99ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.940049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f703d57281049acbb4e404b012f99ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.962920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f703d57281049acbb4e404b012f99ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.965385 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f703d57281049acbb4e404b012f99ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.966051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f703d57281049acbb4e404b012f99ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:09.987588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 974/1989] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:09 2022] DELETE /identity/v3/users/6f703d57281049acbb4e404b012f99ae => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:10.001080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080a3b3-c215-4a3d-bbf0-0b8ce8193e23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:10.001849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080a3b3-c215-4a3d-bbf0-0b8ce8193e23 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:10.002010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080a3b3-c215-4a3d-bbf0-0b8ce8193e23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:10.002280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080a3b3-c215-4a3d-bbf0-0b8ce8193e23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:10.007126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3080a3b3-c215-4a3d-bbf0-0b8ce8193e23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:10.102362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080a3b3-c215-4a3d-bbf0-0b8ce8193e23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:10.104212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080a3b3-c215-4a3d-bbf0-0b8ce8193e23 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:10.130584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1016/1990] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:34:10.157627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:10.159219 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:10.264972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b64bfd-12db-4e98-b780-9f0cd94a3d35 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:10.271584 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657287c-36d0-459b-924f-f5b6d676c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:10.272308 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657287c-36d0-459b-924f-f5b6d676c7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:10.272595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657287c-36d0-459b-924f-f5b6d676c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:10.272872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657287c-36d0-459b-924f-f5b6d676c7ce admin admin] PATH_INFO: `/v3/projects/17641bdab5ca49e49f2802f5401b5bb0` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:10.274996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657287c-36d0-459b-924f-f5b6d676c7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=17641bdab5ca49e49f2802f5401b5bb0)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:10.277971 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657287c-36d0-459b-924f-f5b6d676c7ce admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:10.337253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:10.351088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8657287c-36d0-459b-924f-f5b6d676c7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17641bdab5ca49e49f2802f5401b5bb0', 'request_id': 'req-8657287c-36d0-459b-924f-f5b6d676c7ce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:10.368444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8657287c-36d0-459b-924f-f5b6d676c7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17641bdab5ca49e49f2802f5401b5bb0', 'request_id': 'req-8657287c-36d0-459b-924f-f5b6d676c7ce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:10.378793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8657287c-36d0-459b-924f-f5b6d676c7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17641bdab5ca49e49f2802f5401b5bb0', 'request_id': 'req-8657287c-36d0-459b-924f-f5b6d676c7ce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:10.393158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8657287c-36d0-459b-924f-f5b6d676c7ce admin admin] The token cache is being invalidate because project 17641bdab5ca49e49f2802f5401b5bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:10.393899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8657287c-36d0-459b-924f-f5b6d676c7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:10.394743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8657287c-36d0-459b-924f-f5b6d676c7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:10.397121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 975/1991] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:10 2022] DELETE /identity/v3/projects/17641bdab5ca49e49f2802f5401b5bb0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:10.402430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d00a3-cb2f-4297-ae08-24d0e386389a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:10.402962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d00a3-cb2f-4297-ae08-24d0e386389a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:10.403195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d00a3-cb2f-4297-ae08-24d0e386389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:10.432847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7a6d00a3-cb2f-4297-ae08-24d0e386389a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:10.434246 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7a6d00a3-cb2f-4297-ae08-24d0e386389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:10.513541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:10.586304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1017/1992] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:10.594722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a05b8-0c08-4f4d-ae11-070acc764a45 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:10.595265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a05b8-0c08-4f4d-ae11-070acc764a45 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:10.595265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a05b8-0c08-4f4d-ae11-070acc764a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:10.623369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d18a05b8-0c08-4f4d-ae11-070acc764a45 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:10.625061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d18a05b8-0c08-4f4d-ae11-070acc764a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:10.637489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 976/1993] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:10.638849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d00a3-cb2f-4297-ae08-24d0e386389a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:10.649965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d00a3-cb2f-4297-ae08-24d0e386389a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:10.655463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341eb1a9-440a-45ad-a679-fd2cdcfa5908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:10.656374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341eb1a9-440a-45ad-a679-fd2cdcfa5908 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:10.657063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341eb1a9-440a-45ad-a679-fd2cdcfa5908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:10.657263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341eb1a9-440a-45ad-a679-fd2cdcfa5908 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:10.658255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341eb1a9-440a-45ad-a679-fd2cdcfa5908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:34:10.658660 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341eb1a9-440a-45ad-a679-fd2cdcfa5908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:10.660285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341eb1a9-440a-45ad-a679-fd2cdcfa5908 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:10.674208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1018/1994] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:34:10.678632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a05b8-0c08-4f4d-ae11-070acc764a45 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:10.693742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a05b8-0c08-4f4d-ae11-070acc764a45 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:10.699913 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162b5c6-0210-4ef3-81d4-f296c74f5108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:10.700558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162b5c6-0210-4ef3-81d4-f296c74f5108 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:10.700842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162b5c6-0210-4ef3-81d4-f296c74f5108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:10.701155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162b5c6-0210-4ef3-81d4-f296c74f5108 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:10.701885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162b5c6-0210-4ef3-81d4-f296c74f5108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:10.703970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162b5c6-0210-4ef3-81d4-f296c74f5108 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:10.735818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 977/1995] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:10 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:10.740028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341eb1a9-440a-45ad-a679-fd2cdcfa5908 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:10.751721 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341eb1a9-440a-45ad-a679-fd2cdcfa5908 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:10.830918 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd9be5-4e7d-4809-8d95-3a58e31246b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:10.832143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd9be5-4e7d-4809-8d95-3a58e31246b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:10.832430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd9be5-4e7d-4809-8d95-3a58e31246b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:10.832761 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd9be5-4e7d-4809-8d95-3a58e31246b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:10.833489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd9be5-4e7d-4809-8d95-3a58e31246b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:10.837279 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd9be5-4e7d-4809-8d95-3a58e31246b1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:10.864845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1019/1996] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:10 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:10.866798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162b5c6-0210-4ef3-81d4-f296c74f5108 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:10.878485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162b5c6-0210-4ef3-81d4-f296c74f5108 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:10.884113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b963b9-1aa1-4715-90f2-7207f0de460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:10.884749 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b963b9-1aa1-4715-90f2-7207f0de460d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:10.885088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b963b9-1aa1-4715-90f2-7207f0de460d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:10.885685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b963b9-1aa1-4715-90f2-7207f0de460d admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:10.886551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b963b9-1aa1-4715-90f2-7207f0de460d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:10.888204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b963b9-1aa1-4715-90f2-7207f0de460d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:10.907727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd9be5-4e7d-4809-8d95-3a58e31246b1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:10.907909 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 978/1997] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:10.920614 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd9be5-4e7d-4809-8d95-3a58e31246b1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:10.942335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b6fc3-9d29-4699-83ca-1e498e677081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:10.944560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6fc3-9d29-4699-83ca-1e498e677081 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:10.945578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6fc3-9d29-4699-83ca-1e498e677081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:10.947130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6fc3-9d29-4699-83ca-1e498e677081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:10.948672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b6fc3-9d29-4699-83ca-1e498e677081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:10.951794 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b6fc3-9d29-4699-83ca-1e498e677081 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:10.972063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1020/1998] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:34:10.976354 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b963b9-1aa1-4715-90f2-7207f0de460d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:10.991411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b963b9-1aa1-4715-90f2-7207f0de460d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:10.998312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc4266-ca62-4556-b505-1cfcd0a88e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:10.999145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc4266-ca62-4556-b505-1cfcd0a88e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:10.999426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc4266-ca62-4556-b505-1cfcd0a88e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:10.999775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc4266-ca62-4556-b505-1cfcd0a88e21 admin admin] PATH_INFO: `/v3/projects/31d67ee1cb974677b175e25944fba691/users/5317ca2903344b6ea90f4d4d9d246090/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:11.028822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc4266-ca62-4556-b505-1cfcd0a88e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d67ee1cb974677b175e25944fba691, user_id=5317ca2903344b6ea90f4d4d9d246090, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:11.032631 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc4266-ca62-4556-b505-1cfcd0a88e21 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:11.046497 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 979/1999] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:10 2022] PUT /identity/v3/projects/31d67ee1cb974677b175e25944fba691/users/5317ca2903344b6ea90f4d4d9d246090/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:11.051707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c95c3-10c7-408e-a945-2593ead81ac1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:11.052000 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c95c3-10c7-408e-a945-2593ead81ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:11.052795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c95c3-10c7-408e-a945-2593ead81ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:11.054623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc4266-ca62-4556-b505-1cfcd0a88e21 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:11.059300 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b3bc4266-ca62-4556-b505-1cfcd0a88e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:11.091630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-143c95c3-10c7-408e-a945-2593ead81ac1 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:11.092422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-143c95c3-10c7-408e-a945-2593ead81ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:11.174558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc4266-ca62-4556-b505-1cfcd0a88e21 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:11.181158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:11.181815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:11.182103 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:11.182383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0 admin admin] PATH_INFO: `/v3/projects/d7e1a95329d04afd86f4c943f7338e14` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:11.183596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e1a95329d04afd86f4c943f7338e14)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:11.185571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:11.188369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1021/2000] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:11.199671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c95c3-10c7-408e-a945-2593ead81ac1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:11.201576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-143c95c3-10c7-408e-a945-2593ead81ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:11.266003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e1a95329d04afd86f4c943f7338e14', 'request_id': 'req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:11.276501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e1a95329d04afd86f4c943f7338e14', 'request_id': 'req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:11.281895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:11.282303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:11.291082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e1a95329d04afd86f4c943f7338e14', 'request_id': 'req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:11.308165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c95c3-10c7-408e-a945-2593ead81ac1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:11.327905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0 admin admin] The token cache is being invalidate because project d7e1a95329d04afd86f4c943f7338e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:11.328529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:11.329603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e2dac4b-707f-4e9d-9cf6-8be6342a8ec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:11.332118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 980/2001] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:11 2022] DELETE /identity/v3/projects/d7e1a95329d04afd86f4c943f7338e14 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:11.340854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d0825-f09a-4de0-8ba7-c81c5e8e782a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:11.341546 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d0825-f09a-4de0-8ba7-c81c5e8e782a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:11.342057 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d0825-f09a-4de0-8ba7-c81c5e8e782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:11.381903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa163056-9db6-4752-8a3f-ee0365eba0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:11.382596 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa163056-9db6-4752-8a3f-ee0365eba0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:11.383585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa163056-9db6-4752-8a3f-ee0365eba0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:11.384572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa163056-9db6-4752-8a3f-ee0365eba0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:11.388164 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-aa163056-9db6-4752-8a3f-ee0365eba0c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:11.388316 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8a6d0825-f09a-4de0-8ba7-c81c5e8e782a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:11.389548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8a6d0825-f09a-4de0-8ba7-c81c5e8e782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:11.468973 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 981/2002] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:11.473226 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa163056-9db6-4752-8a3f-ee0365eba0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:11.474935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa163056-9db6-4752-8a3f-ee0365eba0c3 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:11.478629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73e7a1-4643-46ab-adc2-d74ff5f4ab8c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:11.479276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73e7a1-4643-46ab-adc2-d74ff5f4ab8c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:11.479697 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73e7a1-4643-46ab-adc2-d74ff5f4ab8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:11.488988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1022/2003] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:34:11.511186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3a73e7a1-4643-46ab-adc2-d74ff5f4ab8c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:11.512980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3a73e7a1-4643-46ab-adc2-d74ff5f4ab8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:11.522810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 982/2004] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:11.528594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa163056-9db6-4752-8a3f-ee0365eba0c3 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:11.544792 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa163056-9db6-4752-8a3f-ee0365eba0c3 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:11.551250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d3bfb-bb1e-47fe-96db-08f45e36dad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:11.552158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d3bfb-bb1e-47fe-96db-08f45e36dad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:11.552631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d3bfb-bb1e-47fe-96db-08f45e36dad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:11.553118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d3bfb-bb1e-47fe-96db-08f45e36dad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:11.554539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d3bfb-bb1e-47fe-96db-08f45e36dad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:34:11.556339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d3bfb-bb1e-47fe-96db-08f45e36dad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:11.558322 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d3bfb-bb1e-47fe-96db-08f45e36dad9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:11.576629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1023/2005] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:34:11.582413 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73e7a1-4643-46ab-adc2-d74ff5f4ab8c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:11.594269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73e7a1-4643-46ab-adc2-d74ff5f4ab8c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:11.603388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41a9ab-4661-4d4c-9dee-22a2c16112d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:11.604090 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41a9ab-4661-4d4c-9dee-22a2c16112d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:11.604374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41a9ab-4661-4d4c-9dee-22a2c16112d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:11.604665 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41a9ab-4661-4d4c-9dee-22a2c16112d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:11.606796 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41a9ab-4661-4d4c-9dee-22a2c16112d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:11.609995 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41a9ab-4661-4d4c-9dee-22a2c16112d7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:11.642613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ce8e-2ca4-4a9b-a9cb-6b7619031ca6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:11.642845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ce8e-2ca4-4a9b-a9cb-6b7619031ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:11.643117 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ce8e-2ca4-4a9b-a9cb-6b7619031ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:11.655052 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 983/2006] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:11 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:11.658580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41a9ab-4661-4d4c-9dee-22a2c16112d7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:11.668043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ebc4ce8e-2ca4-4a9b-a9cb-6b7619031ca6 None None] MFA Rules not processed for user `7fc6d933ef05408b8681a08de7b2b4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:11.669794 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ebc4ce8e-2ca4-4a9b-a9cb-6b7619031ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:11.745074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1024/2007] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:11.766837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41a9ab-4661-4d4c-9dee-22a2c16112d7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:11.777686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2e547-9c3a-4fee-8133-7fa1327282a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:11.779075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2e547-9c3a-4fee-8133-7fa1327282a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:11.780068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2e547-9c3a-4fee-8133-7fa1327282a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:11.780432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2e547-9c3a-4fee-8133-7fa1327282a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:11.781432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2e547-9c3a-4fee-8133-7fa1327282a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:11.783584 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2e547-9c3a-4fee-8133-7fa1327282a5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:11.816064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 984/2008] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:11 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:11.818238 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4ce8e-2ca4-4a9b-a9cb-6b7619031ca6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:11.835694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4ce8e-2ca4-4a9b-a9cb-6b7619031ca6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:11.845108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9d03e-7701-44ef-8665-698d069df1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:11.847354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9d03e-7701-44ef-8665-698d069df1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:11.848065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9d03e-7701-44ef-8665-698d069df1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:11.849552 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9d03e-7701-44ef-8665-698d069df1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:11.850495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9d03e-7701-44ef-8665-698d069df1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:11.853315 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9d03e-7701-44ef-8665-698d069df1f4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:11.869967 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1025/2009] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:11.874874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2e547-9c3a-4fee-8133-7fa1327282a5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:11.896865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2e547-9c3a-4fee-8133-7fa1327282a5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:11.902666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e570c50-e3ba-46a7-9a75-f5d057b54421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:11.903302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e570c50-e3ba-46a7-9a75-f5d057b54421 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:11.903723 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e570c50-e3ba-46a7-9a75-f5d057b54421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:11.904013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e570c50-e3ba-46a7-9a75-f5d057b54421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:11.904736 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e570c50-e3ba-46a7-9a75-f5d057b54421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:11.906422 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e570c50-e3ba-46a7-9a75-f5d057b54421 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:11.926082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9d03e-7701-44ef-8665-698d069df1f4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:11.942012 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 985/2010] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:11.948718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9d03e-7701-44ef-8665-698d069df1f4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:11.968427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8b65-3760-48eb-919b-9b8beb839907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:11.969362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8b65-3760-48eb-919b-9b8beb839907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:11.971249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8b65-3760-48eb-919b-9b8beb839907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:11.980175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8b65-3760-48eb-919b-9b8beb839907 admin admin] PATH_INFO: `/v3/projects/d4917ef7020c4413970ea286b83b8de9/users/dffd98d83a1d443d9190e734dfadaf15/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:12.021812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f8b65-3760-48eb-919b-9b8beb839907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4917ef7020c4413970ea286b83b8de9, user_id=dffd98d83a1d443d9190e734dfadaf15, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:12.028804 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f8b65-3760-48eb-919b-9b8beb839907 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:12.061300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1026/2011] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:11 2022] PUT /identity/v3/projects/d4917ef7020c4413970ea286b83b8de9/users/dffd98d83a1d443d9190e734dfadaf15/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:12.078384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa716082-1b81-474b-ac37-cf8bebbc7fe5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:12.078682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa716082-1b81-474b-ac37-cf8bebbc7fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:12.078967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa716082-1b81-474b-ac37-cf8bebbc7fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:12.126747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fa716082-1b81-474b-ac37-cf8bebbc7fe5 None None] MFA Rules not processed for user `dffd98d83a1d443d9190e734dfadaf15`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:12.127995 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fa716082-1b81-474b-ac37-cf8bebbc7fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:12.194129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:12.257331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 986/2012] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:12.271693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8b65-3760-48eb-919b-9b8beb839907 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:12.274073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6f1f8b65-3760-48eb-919b-9b8beb839907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:12.278585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:12.399518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8b65-3760-48eb-919b-9b8beb839907 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:12.404700 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec8ba-df87-4257-917c-4e2fbb15aa80 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da39170a654d4d52a39b4b2c8cfd8906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:12.405370 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec8ba-df87-4257-917c-4e2fbb15aa80 service glance] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:12.405656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec8ba-df87-4257-917c-4e2fbb15aa80 service glance] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:12.406082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec8ba-df87-4257-917c-4e2fbb15aa80 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:12.415744 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ec8ba-df87-4257-917c-4e2fbb15aa80 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:12.422074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ec8ba-df87-4257-917c-4e2fbb15aa80 service glance] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:12.434360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1027/2013] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:12.613122 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c38e0c-ba09-4efc-96e9-775edbf7cbbb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:12.613491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c38e0c-ba09-4efc-96e9-775edbf7cbbb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:12.613863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c38e0c-ba09-4efc-96e9-775edbf7cbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:12.672243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b9c38e0c-ba09-4efc-96e9-775edbf7cbbb None None] MFA Rules not processed for user `5317ca2903344b6ea90f4d4d9d246090`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:12.673637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b9c38e0c-ba09-4efc-96e9-775edbf7cbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:12.871332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 987/2014] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:34:12.875367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec8ba-df87-4257-917c-4e2fbb15aa80 service glance] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:12.877173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7e7ec8ba-df87-4257-917c-4e2fbb15aa80 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:13.065372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec8ba-df87-4257-917c-4e2fbb15aa80 service glance] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:13.071446 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a060a9-0a89-4b07-aa81-b8cdf001f63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:13.072076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a060a9-0a89-4b07-aa81-b8cdf001f63a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:13.072365 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a060a9-0a89-4b07-aa81-b8cdf001f63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:13.072647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a060a9-0a89-4b07-aa81-b8cdf001f63a admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:13.073438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a060a9-0a89-4b07-aa81-b8cdf001f63a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:13.075346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a060a9-0a89-4b07-aa81-b8cdf001f63a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:13.114736 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1028/2015] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:12 2022] POST /identity/v3/projects => generated 371 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:13.116317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c38e0c-ba09-4efc-96e9-775edbf7cbbb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:13.145206 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c38e0c-ba09-4efc-96e9-775edbf7cbbb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:13.288802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d09060-ffde-43a8-919a-ff862f759fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:13.289656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d09060-ffde-43a8-919a-ff862f759fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:13.289953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d09060-ffde-43a8-919a-ff862f759fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:13.290243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d09060-ffde-43a8-919a-ff862f759fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:13.291200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d09060-ffde-43a8-919a-ff862f759fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:13.292946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d09060-ffde-43a8-919a-ff862f759fd0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:13.329104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 988/2016] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:13 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:13.334876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a060a9-0a89-4b07-aa81-b8cdf001f63a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:13.350300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a060a9-0a89-4b07-aa81-b8cdf001f63a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:13.355871 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafd178-d1f9-409e-94d3-52a5bc2c5548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:13.356496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd178-d1f9-409e-94d3-52a5bc2c5548 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:13.356803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd178-d1f9-409e-94d3-52a5bc2c5548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:13.357466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd178-d1f9-409e-94d3-52a5bc2c5548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:13.358339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafd178-d1f9-409e-94d3-52a5bc2c5548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:13.359962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafd178-d1f9-409e-94d3-52a5bc2c5548 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:13.377853 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1029/2017] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:13.378769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d09060-ffde-43a8-919a-ff862f759fd0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:13.392254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d09060-ffde-43a8-919a-ff862f759fd0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:13.399935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec029a-96f1-46df-b1e7-7be5c1b8e3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:13.400729 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec029a-96f1-46df-b1e7-7be5c1b8e3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:13.401158 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec029a-96f1-46df-b1e7-7be5c1b8e3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:13.401793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec029a-96f1-46df-b1e7-7be5c1b8e3b6 admin admin] PATH_INFO: `/v3/projects/c0d0ae97b994468b914052bd1da7c4bd/users/905dd88bc58b482e841fd4d494230ccc/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:13.422429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec029a-96f1-46df-b1e7-7be5c1b8e3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d0ae97b994468b914052bd1da7c4bd, user_id=905dd88bc58b482e841fd4d494230ccc, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:13.425213 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec029a-96f1-46df-b1e7-7be5c1b8e3b6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:13.441790 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 989/2018] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:13 2022] PUT /identity/v3/projects/c0d0ae97b994468b914052bd1da7c4bd/users/905dd88bc58b482e841fd4d494230ccc/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:13.446348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafd178-d1f9-409e-94d3-52a5bc2c5548 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:13.456573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafd178-d1f9-409e-94d3-52a5bc2c5548 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:13.521652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50893823-01be-4356-9588-becff79d05dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:13.522369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50893823-01be-4356-9588-becff79d05dc admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:13.523078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50893823-01be-4356-9588-becff79d05dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:13.523078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50893823-01be-4356-9588-becff79d05dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:13.524383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50893823-01be-4356-9588-becff79d05dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:13.526598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50893823-01be-4356-9588-becff79d05dc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:13.528292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:13.554409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1030/2019] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:13.558660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec029a-96f1-46df-b1e7-7be5c1b8e3b6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:13.570029 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec029a-96f1-46df-b1e7-7be5c1b8e3b6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:13.577328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a59e99-206d-412a-a2de-d5c2a9549802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:13.578074 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a59e99-206d-412a-a2de-d5c2a9549802 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:13.578495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a59e99-206d-412a-a2de-d5c2a9549802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:13.578764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a59e99-206d-412a-a2de-d5c2a9549802 admin admin] PATH_INFO: `/v3/projects/c0d0ae97b994468b914052bd1da7c4bd/users/905dd88bc58b482e841fd4d494230ccc/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:13.582929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a59e99-206d-412a-a2de-d5c2a9549802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d0ae97b994468b914052bd1da7c4bd, user_id=905dd88bc58b482e841fd4d494230ccc, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:13.583919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a59e99-206d-412a-a2de-d5c2a9549802 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:13.600078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 990/2020] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:13 2022] PUT /identity/v3/projects/c0d0ae97b994468b914052bd1da7c4bd/users/905dd88bc58b482e841fd4d494230ccc/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:14.622631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a6c80-fadd-49fa-874c-4ef29e3d862b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:14.623261 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a6c80-fadd-49fa-874c-4ef29e3d862b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:14.623399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a6c80-fadd-49fa-874c-4ef29e3d862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:14.665218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b64a6c80-fadd-49fa-874c-4ef29e3d862b None None] MFA Rules not processed for user `905dd88bc58b482e841fd4d494230ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:14.666921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b64a6c80-fadd-49fa-874c-4ef29e3d862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:14.785463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1031/2021] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:14.789527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f5c06-10d3-4d30-ad9b-fcd659528a88 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:14.790248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f5c06-10d3-4d30-ad9b-fcd659528a88 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:14.790248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f5c06-10d3-4d30-ad9b-fcd659528a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:14.823724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ec3f5c06-10d3-4d30-ad9b-fcd659528a88 None None] MFA Rules not processed for user `5317ca2903344b6ea90f4d4d9d246090`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:14.825138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ec3f5c06-10d3-4d30-ad9b-fcd659528a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:14.832482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:14.960643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 991/2022] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:14.968076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a6c80-fadd-49fa-874c-4ef29e3d862b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:14.969549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b64a6c80-fadd-49fa-874c-4ef29e3d862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:15.113323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a6c80-fadd-49fa-874c-4ef29e3d862b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:15.122602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187515-cc30-43ef-83c6-c9946344e624 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:15.123385 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187515-cc30-43ef-83c6-c9946344e624 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:15.123934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187515-cc30-43ef-83c6-c9946344e624 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:15.124648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187515-cc30-43ef-83c6-c9946344e624 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:15.155791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd187515-cc30-43ef-83c6-c9946344e624 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:15.157938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd187515-cc30-43ef-83c6-c9946344e624 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:15.179396 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1032/2023] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:15.697573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f5c06-10d3-4d30-ad9b-fcd659528a88 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:15.698924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ec3f5c06-10d3-4d30-ad9b-fcd659528a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:15.790215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f5c06-10d3-4d30-ad9b-fcd659528a88 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:15.795191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa12314-50bb-4465-bb2d-401c51973ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:15.795922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa12314-50bb-4465-bb2d-401c51973ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:15.796286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa12314-50bb-4465-bb2d-401c51973ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:15.796623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa12314-50bb-4465-bb2d-401c51973ccf admin admin] PATH_INFO: `/v3/users/1bac0cc0dd9149e4a25c2e1b5a54f1f5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:15.797896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa12314-50bb-4465-bb2d-401c51973ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bac0cc0dd9149e4a25c2e1b5a54f1f5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:15.799907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa12314-50bb-4465-bb2d-401c51973ccf admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:15.852922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1fa12314-50bb-4465-bb2d-401c51973ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bac0cc0dd9149e4a25c2e1b5a54f1f5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:15.859891 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1fa12314-50bb-4465-bb2d-401c51973ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bac0cc0dd9149e4a25c2e1b5a54f1f5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:15.871981 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1fa12314-50bb-4465-bb2d-401c51973ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bac0cc0dd9149e4a25c2e1b5a54f1f5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:15.872671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1fa12314-50bb-4465-bb2d-401c51973ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bac0cc0dd9149e4a25c2e1b5a54f1f5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:15.873518 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1fa12314-50bb-4465-bb2d-401c51973ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bac0cc0dd9149e4a25c2e1b5a54f1f5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:15.889230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 992/2024] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:15 2022] DELETE /identity/v3/users/1bac0cc0dd9149e4a25c2e1b5a54f1f5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:16.123089 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187515-cc30-43ef-83c6-c9946344e624 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:16.139821 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187515-cc30-43ef-83c6-c9946344e624 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:16.212508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fc607-a884-4e9c-8fac-9f374b0b9711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:16.213548 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fc607-a884-4e9c-8fac-9f374b0b9711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:16.213904 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fc607-a884-4e9c-8fac-9f374b0b9711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:16.214253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fc607-a884-4e9c-8fac-9f374b0b9711 admin admin] PATH_INFO: `/v3/projects/f2cfad2d066d43cd81682da19288778d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:16.215685 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fc607-a884-4e9c-8fac-9f374b0b9711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2cfad2d066d43cd81682da19288778d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:16.217759 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fc607-a884-4e9c-8fac-9f374b0b9711 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:16.226455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:16.281279 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0c6fc607-a884-4e9c-8fac-9f374b0b9711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2cfad2d066d43cd81682da19288778d', 'request_id': 'req-0c6fc607-a884-4e9c-8fac-9f374b0b9711'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:16.288624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0c6fc607-a884-4e9c-8fac-9f374b0b9711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2cfad2d066d43cd81682da19288778d', 'request_id': 'req-0c6fc607-a884-4e9c-8fac-9f374b0b9711'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:16.300477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0c6fc607-a884-4e9c-8fac-9f374b0b9711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2cfad2d066d43cd81682da19288778d', 'request_id': 'req-0c6fc607-a884-4e9c-8fac-9f374b0b9711'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:16.323719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0c6fc607-a884-4e9c-8fac-9f374b0b9711 admin admin] The token cache is being invalidate because project f2cfad2d066d43cd81682da19288778d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:16.324155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0c6fc607-a884-4e9c-8fac-9f374b0b9711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:16.325196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0c6fc607-a884-4e9c-8fac-9f374b0b9711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:16.327171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1033/2025] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:16 2022] DELETE /identity/v3/projects/f2cfad2d066d43cd81682da19288778d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:16.333387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b310e7-08a8-4581-abd9-2d75f9c450a3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:16.333915 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b310e7-08a8-4581-abd9-2d75f9c450a3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:16.334289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b310e7-08a8-4581-abd9-2d75f9c450a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:16.358359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-89b310e7-08a8-4581-abd9-2d75f9c450a3 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:16.359590 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-89b310e7-08a8-4581-abd9-2d75f9c450a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:16.407259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:16.448057 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 993/2026] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:16.458658 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6786e-7027-41b1-9204-ebeb898c7ed6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:16.459141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6786e-7027-41b1-9204-ebeb898c7ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:16.459503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6786e-7027-41b1-9204-ebeb898c7ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:16.482040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-16b6786e-7027-41b1-9204-ebeb898c7ed6 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:16.483339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-16b6786e-7027-41b1-9204-ebeb898c7ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:16.492715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1034/2027] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:16.497878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b310e7-08a8-4581-abd9-2d75f9c450a3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:16.537777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b310e7-08a8-4581-abd9-2d75f9c450a3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:16.550565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb96f1-f167-4103-9bed-820aa866834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:16.563916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb96f1-f167-4103-9bed-820aa866834d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:16.563916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb96f1-f167-4103-9bed-820aa866834d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:16.563916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb96f1-f167-4103-9bed-820aa866834d admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:16.563916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb96f1-f167-4103-9bed-820aa866834d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:34:16.563916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb96f1-f167-4103-9bed-820aa866834d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:16.563916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb96f1-f167-4103-9bed-820aa866834d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:16.583383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 994/2028] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:34:16.584662 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6786e-7027-41b1-9204-ebeb898c7ed6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:16.599627 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6786e-7027-41b1-9204-ebeb898c7ed6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:16.605123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acebf73-0982-41be-b89d-763e37f8bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:16.605741 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebf73-0982-41be-b89d-763e37f8bf0e admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:16.606025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebf73-0982-41be-b89d-763e37f8bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:16.606290 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebf73-0982-41be-b89d-763e37f8bf0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:16.606965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acebf73-0982-41be-b89d-763e37f8bf0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:16.609049 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acebf73-0982-41be-b89d-763e37f8bf0e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:16.664643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1035/2029] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:16 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:16.668354 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb96f1-f167-4103-9bed-820aa866834d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:16.680694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb96f1-f167-4103-9bed-820aa866834d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:16.752757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e104bd9-57f0-4829-b68b-fea6770db97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:16.753377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e104bd9-57f0-4829-b68b-fea6770db97c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:16.753662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e104bd9-57f0-4829-b68b-fea6770db97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:16.753942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e104bd9-57f0-4829-b68b-fea6770db97c admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:16.754635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e104bd9-57f0-4829-b68b-fea6770db97c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:16.756544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e104bd9-57f0-4829-b68b-fea6770db97c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:16.782705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 995/2030] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:16 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:16.786726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acebf73-0982-41be-b89d-763e37f8bf0e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:16.797831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acebf73-0982-41be-b89d-763e37f8bf0e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:16.802445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931dc26-f7ee-47cf-a7ec-a0fddce06e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:16.803058 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931dc26-f7ee-47cf-a7ec-a0fddce06e70 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:16.803337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931dc26-f7ee-47cf-a7ec-a0fddce06e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:16.803611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931dc26-f7ee-47cf-a7ec-a0fddce06e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:16.804313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931dc26-f7ee-47cf-a7ec-a0fddce06e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:16.807068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931dc26-f7ee-47cf-a7ec-a0fddce06e70 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:16.817448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1036/2031] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:16.822681 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e104bd9-57f0-4829-b68b-fea6770db97c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:16.835508 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e104bd9-57f0-4829-b68b-fea6770db97c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:16.842709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3196d-aa6e-4505-94a5-36e8a3e0df61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:16.843620 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3196d-aa6e-4505-94a5-36e8a3e0df61 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:16.844030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3196d-aa6e-4505-94a5-36e8a3e0df61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:16.844324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3196d-aa6e-4505-94a5-36e8a3e0df61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:16.845378 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3196d-aa6e-4505-94a5-36e8a3e0df61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:16.847645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3196d-aa6e-4505-94a5-36e8a3e0df61 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:16.859870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 996/2032] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:16.864184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931dc26-f7ee-47cf-a7ec-a0fddce06e70 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:16.875212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931dc26-f7ee-47cf-a7ec-a0fddce06e70 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:16.879922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8508d-6def-4f03-bc50-bc724da1bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:16.880580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8508d-6def-4f03-bc50-bc724da1bf28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:16.880866 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8508d-6def-4f03-bc50-bc724da1bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:16.881163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8508d-6def-4f03-bc50-bc724da1bf28 admin admin] PATH_INFO: `/v3/projects/ceb35265d0724da08c372846b0618c37/users/ee4f31eeae154261aa0e028efa48b598/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:16.905025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8508d-6def-4f03-bc50-bc724da1bf28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb35265d0724da08c372846b0618c37, user_id=ee4f31eeae154261aa0e028efa48b598, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:16.908619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8508d-6def-4f03-bc50-bc724da1bf28 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:16.931430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1037/2033] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:16 2022] PUT /identity/v3/projects/ceb35265d0724da08c372846b0618c37/users/ee4f31eeae154261aa0e028efa48b598/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:16.937398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a52a-dd01-4ea5-8780-ce3151750858 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:16.937663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a52a-dd01-4ea5-8780-ce3151750858 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:16.938259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768a52a-dd01-4ea5-8780-ce3151750858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:16.975825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c768a52a-dd01-4ea5-8780-ce3151750858 None None] MFA Rules not processed for user `ee4f31eeae154261aa0e028efa48b598`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:16.978159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c768a52a-dd01-4ea5-8780-ce3151750858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:17.052218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 997/2034] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:17.057264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8508d-6def-4f03-bc50-bc724da1bf28 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:17.125089 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8508d-6def-4f03-bc50-bc724da1bf28 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:17.130818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c8111-a0ab-49fc-ab92-159e4523fbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:17.131443 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c8111-a0ab-49fc-ab92-159e4523fbbd admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:17.131870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c8111-a0ab-49fc-ab92-159e4523fbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:17.132278 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c8111-a0ab-49fc-ab92-159e4523fbbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:17.134049 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c8111-a0ab-49fc-ab92-159e4523fbbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:17.136488 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c8111-a0ab-49fc-ab92-159e4523fbbd admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:17.168492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1038/2035] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:17 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:17.172892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768a52a-dd01-4ea5-8780-ce3151750858 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:17.184926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768a52a-dd01-4ea5-8780-ce3151750858 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:17.216207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:17.279069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8689f0-fa13-47e3-a1b4-1d53cebaa52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:17.279938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8689f0-fa13-47e3-a1b4-1d53cebaa52f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:17.280210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8689f0-fa13-47e3-a1b4-1d53cebaa52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:17.280559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8689f0-fa13-47e3-a1b4-1d53cebaa52f admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:17.281415 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8689f0-fa13-47e3-a1b4-1d53cebaa52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:17.283436 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8689f0-fa13-47e3-a1b4-1d53cebaa52f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:17.307511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 998/2036] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:17 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:17.311529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c8111-a0ab-49fc-ab92-159e4523fbbd admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:17.322444 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c8111-a0ab-49fc-ab92-159e4523fbbd admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:17.327753 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5ce57-06c9-46c2-ba83-0a37a3dfe46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:17.328433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5ce57-06c9-46c2-ba83-0a37a3dfe46c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:17.328714 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5ce57-06c9-46c2-ba83-0a37a3dfe46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:17.329027 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5ce57-06c9-46c2-ba83-0a37a3dfe46c admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:17.329749 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5ce57-06c9-46c2-ba83-0a37a3dfe46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:17.331348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5ce57-06c9-46c2-ba83-0a37a3dfe46c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:17.343002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1039/2037] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:17.346978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8689f0-fa13-47e3-a1b4-1d53cebaa52f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:17.357599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8689f0-fa13-47e3-a1b4-1d53cebaa52f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:17.362143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26682d14-8859-4893-ad00-383da7ecabf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:17.362812 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26682d14-8859-4893-ad00-383da7ecabf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:17.363098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26682d14-8859-4893-ad00-383da7ecabf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:17.363371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26682d14-8859-4893-ad00-383da7ecabf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:17.364059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26682d14-8859-4893-ad00-383da7ecabf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:17.365920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26682d14-8859-4893-ad00-383da7ecabf4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:17.384744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 999/2038] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:17.389331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5ce57-06c9-46c2-ba83-0a37a3dfe46c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:17.399585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5ce57-06c9-46c2-ba83-0a37a3dfe46c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:17.404298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ced5c9-457e-473f-b0bf-6e116d771b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:17.405247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ced5c9-457e-473f-b0bf-6e116d771b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:17.405531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ced5c9-457e-473f-b0bf-6e116d771b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:17.405809 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ced5c9-457e-473f-b0bf-6e116d771b46 admin admin] PATH_INFO: `/v3/projects/9741769dcf934533a6c66532675f865a/users/c620f75b96444ec0bbbe77129158aa8e/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:17.408186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:17.426377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ced5c9-457e-473f-b0bf-6e116d771b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9741769dcf934533a6c66532675f865a, user_id=c620f75b96444ec0bbbe77129158aa8e, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:17.429352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ced5c9-457e-473f-b0bf-6e116d771b46 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:17.449242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1040/2039] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:17 2022] PUT /identity/v3/projects/9741769dcf934533a6c66532675f865a/users/c620f75b96444ec0bbbe77129158aa8e/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:17.459662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da370d64-3b0b-4a91-a56b-0ff5fada434f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:17.460030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da370d64-3b0b-4a91-a56b-0ff5fada434f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:17.460376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da370d64-3b0b-4a91-a56b-0ff5fada434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:17.490846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-da370d64-3b0b-4a91-a56b-0ff5fada434f None None] MFA Rules not processed for user `c620f75b96444ec0bbbe77129158aa8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:17.492662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-da370d64-3b0b-4a91-a56b-0ff5fada434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:17.562584 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1000/2040] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:17.567230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ced5c9-457e-473f-b0bf-6e116d771b46 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:17.630863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ced5c9-457e-473f-b0bf-6e116d771b46 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:17.636317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d7883-b2de-4d26-b8e6-9e552ae7f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:17.636956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7883-b2de-4d26-b8e6-9e552ae7f75f admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:17.637272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7883-b2de-4d26-b8e6-9e552ae7f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:17.637554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7883-b2de-4d26-b8e6-9e552ae7f75f admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:17.638222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d7883-b2de-4d26-b8e6-9e552ae7f75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:17.640103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d7883-b2de-4d26-b8e6-9e552ae7f75f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:17.671586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1041/2041] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:17 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:17.675587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da370d64-3b0b-4a91-a56b-0ff5fada434f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:17.686838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da370d64-3b0b-4a91-a56b-0ff5fada434f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:17.749837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b78fa-fa0b-4719-ae4f-c93d54278881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:17.750471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b78fa-fa0b-4719-ae4f-c93d54278881 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:17.750758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b78fa-fa0b-4719-ae4f-c93d54278881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:17.751036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b78fa-fa0b-4719-ae4f-c93d54278881 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:17.751718 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b78fa-fa0b-4719-ae4f-c93d54278881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:17.753680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b78fa-fa0b-4719-ae4f-c93d54278881 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:17.783874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1001/2042] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:17 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:17.787898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d7883-b2de-4d26-b8e6-9e552ae7f75f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:17.798609 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d7883-b2de-4d26-b8e6-9e552ae7f75f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:17.803267 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbcfe8-6485-4784-a549-bffa891dc649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:17.803885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbcfe8-6485-4784-a549-bffa891dc649 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:17.804172 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbcfe8-6485-4784-a549-bffa891dc649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:17.804451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbcfe8-6485-4784-a549-bffa891dc649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:17.805990 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbcfe8-6485-4784-a549-bffa891dc649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:17.807584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbcfe8-6485-4784-a549-bffa891dc649 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:17.818152 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1042/2043] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:17.822893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b78fa-fa0b-4719-ae4f-c93d54278881 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:17.832852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b78fa-fa0b-4719-ae4f-c93d54278881 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:17.837525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3509fc5-5ad1-4a43-aba0-b917787fe448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:17.838174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3509fc5-5ad1-4a43-aba0-b917787fe448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:17.838453 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3509fc5-5ad1-4a43-aba0-b917787fe448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:17.838727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3509fc5-5ad1-4a43-aba0-b917787fe448 admin admin] PATH_INFO: `/v3/projects/bf68dc7e2f2449038f81981472408c2b/users/c393f3faa3aa449facd0f3f6720336ab/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:17.855069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3509fc5-5ad1-4a43-aba0-b917787fe448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf68dc7e2f2449038f81981472408c2b, user_id=c393f3faa3aa449facd0f3f6720336ab, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:17.857865 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3509fc5-5ad1-4a43-aba0-b917787fe448 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:17.871326 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1002/2044] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:17 2022] PUT /identity/v3/projects/bf68dc7e2f2449038f81981472408c2b/users/c393f3faa3aa449facd0f3f6720336ab/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:17.875324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbcfe8-6485-4784-a549-bffa891dc649 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:17.886186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbcfe8-6485-4784-a549-bffa891dc649 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:17.944917 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fadfa-b61f-4c30-a014-879ac5bfe39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:17.945581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fadfa-b61f-4c30-a014-879ac5bfe39d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:17.945867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fadfa-b61f-4c30-a014-879ac5bfe39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:17.946148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fadfa-b61f-4c30-a014-879ac5bfe39d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:17.946848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fadfa-b61f-4c30-a014-879ac5bfe39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:17.948430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fadfa-b61f-4c30-a014-879ac5bfe39d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:17.958454 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1043/2045] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:17.962809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3509fc5-5ad1-4a43-aba0-b917787fe448 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:17.970474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:17.974819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3509fc5-5ad1-4a43-aba0-b917787fe448 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:17.981362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592df649-58e2-4bea-b11f-d0f37d17bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:17.982043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592df649-58e2-4bea-b11f-d0f37d17bca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:17.982323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592df649-58e2-4bea-b11f-d0f37d17bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:17.982595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592df649-58e2-4bea-b11f-d0f37d17bca0 admin admin] PATH_INFO: `/v3/projects/bf68dc7e2f2449038f81981472408c2b/users/c393f3faa3aa449facd0f3f6720336ab/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:17.985478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592df649-58e2-4bea-b11f-d0f37d17bca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf68dc7e2f2449038f81981472408c2b, user_id=c393f3faa3aa449facd0f3f6720336ab, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:17.990809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592df649-58e2-4bea-b11f-d0f37d17bca0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:18.004260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1003/2046] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:17 2022] PUT /identity/v3/projects/bf68dc7e2f2449038f81981472408c2b/users/c393f3faa3aa449facd0f3f6720336ab/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:18.015756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e2c01-af89-4d2e-9557-6c757cb2db1a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:18.016051 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e2c01-af89-4d2e-9557-6c757cb2db1a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:18.016336 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e2c01-af89-4d2e-9557-6c757cb2db1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:18.044836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-015e2c01-af89-4d2e-9557-6c757cb2db1a None None] MFA Rules not processed for user `c393f3faa3aa449facd0f3f6720336ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:18.046001 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-015e2c01-af89-4d2e-9557-6c757cb2db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:18.087474 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:18.114870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1044/2047] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:18.126695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592df649-58e2-4bea-b11f-d0f37d17bca0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:18.128766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-592df649-58e2-4bea-b11f-d0f37d17bca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:18.194551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592df649-58e2-4bea-b11f-d0f37d17bca0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:18.199233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97fbe4-e856-459c-a2e0-df4ea8664c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:18.199913 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97fbe4-e856-459c-a2e0-df4ea8664c4a service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:18.200196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97fbe4-e856-459c-a2e0-df4ea8664c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:18.201388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97fbe4-e856-459c-a2e0-df4ea8664c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:18.215697 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97fbe4-e856-459c-a2e0-df4ea8664c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:18.217223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97fbe4-e856-459c-a2e0-df4ea8664c4a service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:18.228409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1004/2048] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:18.283022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e2c01-af89-4d2e-9557-6c757cb2db1a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:18.284705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-015e2c01-af89-4d2e-9557-6c757cb2db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:18.299969 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e2c01-af89-4d2e-9557-6c757cb2db1a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:18.304095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89f2bd-decd-43fe-a9cf-431da75b1806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:18.305348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89f2bd-decd-43fe-a9cf-431da75b1806 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:18.305776 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89f2bd-decd-43fe-a9cf-431da75b1806 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:18.306117 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89f2bd-decd-43fe-a9cf-431da75b1806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:18.402392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89f2bd-decd-43fe-a9cf-431da75b1806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:18.403853 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89f2bd-decd-43fe-a9cf-431da75b1806 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:18.413760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1045/2049] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:21.418279 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97fbe4-e856-459c-a2e0-df4ea8664c4a service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:21.484896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97fbe4-e856-459c-a2e0-df4ea8664c4a service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:21.489472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:21.490108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:21.490389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:21.490663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] PATH_INFO: `/v3/users/ee4f31eeae154261aa0e028efa48b598` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:21.491832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4f31eeae154261aa0e028efa48b598)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:21.494287 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:21.546259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4f31eeae154261aa0e028efa48b598'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:21.553767 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4f31eeae154261aa0e028efa48b598'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:21.566783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4f31eeae154261aa0e028efa48b598'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:21.567512 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4f31eeae154261aa0e028efa48b598'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:21.568319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4f31eeae154261aa0e028efa48b598'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:21.583405 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1005/2050] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:21 2022] DELETE /identity/v3/users/ee4f31eeae154261aa0e028efa48b598 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:21.588081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e055-cd2a-4689-a8a6-e41015520e2f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:21.588582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e055-cd2a-4689-a8a6-e41015520e2f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:21.588791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e055-cd2a-4689-a8a6-e41015520e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:21.609564 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0d89e055-cd2a-4689-a8a6-e41015520e2f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:21.610772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0d89e055-cd2a-4689-a8a6-e41015520e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:21.672484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1046/2051] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:21.682924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:21.684319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:21.698284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:21.744525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9f745-09e7-41cc-ab8b-cf0caaa752b1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:21.748109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20fc44-057b-4515-8b9a-8ee19ebe21a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:21.748730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20fc44-057b-4515-8b9a-8ee19ebe21a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:21.749036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20fc44-057b-4515-8b9a-8ee19ebe21a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:21.749310 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20fc44-057b-4515-8b9a-8ee19ebe21a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:21.758465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20fc44-057b-4515-8b9a-8ee19ebe21a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:21.760025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20fc44-057b-4515-8b9a-8ee19ebe21a3 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:21.769790 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1006/2052] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:22.062116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89e055-cd2a-4689-a8a6-e41015520e2f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:22.063658 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0d89e055-cd2a-4689-a8a6-e41015520e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:22.084632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89e055-cd2a-4689-a8a6-e41015520e2f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:22.090604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:22.091383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:22.091673 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:22.091945 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] PATH_INFO: `/v3/projects/ceb35265d0724da08c372846b0618c37` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:22.093164 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb35265d0724da08c372846b0618c37)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:22.095134 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:22.146102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb35265d0724da08c372846b0618c37', 'request_id': 'req-9cc7425c-a269-427f-ad10-8ffe0353c8ed'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.152146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb35265d0724da08c372846b0618c37', 'request_id': 'req-9cc7425c-a269-427f-ad10-8ffe0353c8ed'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.165109 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb35265d0724da08c372846b0618c37', 'request_id': 'req-9cc7425c-a269-427f-ad10-8ffe0353c8ed'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.173935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:22.178593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] The token cache is being invalidate because project ceb35265d0724da08c372846b0618c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:22.178885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.180076 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.182595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1047/2053] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:22 2022] DELETE /identity/v3/projects/ceb35265d0724da08c372846b0618c37 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:22.186605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20fc44-057b-4515-8b9a-8ee19ebe21a3 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:22.198548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20fc44-057b-4515-8b9a-8ee19ebe21a3 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:22.258064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:22.259349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:22.259833 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:22.260374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] PATH_INFO: `/v3/users/c620f75b96444ec0bbbe77129158aa8e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:22.261600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c620f75b96444ec0bbbe77129158aa8e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:22.263519 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:22.318808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c620f75b96444ec0bbbe77129158aa8e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.326464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c620f75b96444ec0bbbe77129158aa8e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.341097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c620f75b96444ec0bbbe77129158aa8e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.341955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c620f75b96444ec0bbbe77129158aa8e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.342608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c620f75b96444ec0bbbe77129158aa8e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.359118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1007/2054] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:22 2022] DELETE /identity/v3/users/c620f75b96444ec0bbbe77129158aa8e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:22.659256 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:22.660807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:22.675620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7425c-a269-427f-ad10-8ffe0353c8ed admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:22.741253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:22.741902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:22.742182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:22.742457 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] PATH_INFO: `/v3/projects/9741769dcf934533a6c66532675f865a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:22.745038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9741769dcf934533a6c66532675f865a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:22.746953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:22.795172 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9741769dcf934533a6c66532675f865a', 'request_id': 'req-1b01876f-e727-4189-b962-45fc0e771856'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.801297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9741769dcf934533a6c66532675f865a', 'request_id': 'req-1b01876f-e727-4189-b962-45fc0e771856'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.811513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9741769dcf934533a6c66532675f865a', 'request_id': 'req-1b01876f-e727-4189-b962-45fc0e771856'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.823451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] The token cache is being invalidate because project 9741769dcf934533a6c66532675f865a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:22.823737 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.824364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.825879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1048/2055] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:22 2022] DELETE /identity/v3/projects/9741769dcf934533a6c66532675f865a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:22.829814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:22.831199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:22.843669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa67f61-fb34-4126-aed6-5789981d6635 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:22.877568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:22.905010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b031396-315b-4257-9c82-334fc64baa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:22.905693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b031396-315b-4257-9c82-334fc64baa05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:22.905975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b031396-315b-4257-9c82-334fc64baa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:22.906248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b031396-315b-4257-9c82-334fc64baa05 admin admin] PATH_INFO: `/v3/users/c393f3faa3aa449facd0f3f6720336ab` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:22.907407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b031396-315b-4257-9c82-334fc64baa05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c393f3faa3aa449facd0f3f6720336ab)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:22.909362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b031396-315b-4257-9c82-334fc64baa05 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:22.958584 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1b031396-315b-4257-9c82-334fc64baa05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c393f3faa3aa449facd0f3f6720336ab'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.967544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1b031396-315b-4257-9c82-334fc64baa05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c393f3faa3aa449facd0f3f6720336ab'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.983133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1b031396-315b-4257-9c82-334fc64baa05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c393f3faa3aa449facd0f3f6720336ab'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.983890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1b031396-315b-4257-9c82-334fc64baa05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c393f3faa3aa449facd0f3f6720336ab'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.984510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1b031396-315b-4257-9c82-334fc64baa05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c393f3faa3aa449facd0f3f6720336ab'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:22.997850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1008/2056] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:22 2022] DELETE /identity/v3/users/c393f3faa3aa449facd0f3f6720336ab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:23.310471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:23.311935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:23.326582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01876f-e727-4189-b962-45fc0e771856 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:23.411931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0db7f-73cf-4955-b629-f06d312453ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:23.412520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0db7f-73cf-4955-b629-f06d312453ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:23.413190 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0db7f-73cf-4955-b629-f06d312453ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:23.413397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0db7f-73cf-4955-b629-f06d312453ae admin admin] PATH_INFO: `/v3/projects/bf68dc7e2f2449038f81981472408c2b` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:23.414605 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0db7f-73cf-4955-b629-f06d312453ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf68dc7e2f2449038f81981472408c2b)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:23.416593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0db7f-73cf-4955-b629-f06d312453ae admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:23.466911 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:23.486621 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ff0db7f-73cf-4955-b629-f06d312453ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf68dc7e2f2449038f81981472408c2b', 'request_id': 'req-5ff0db7f-73cf-4955-b629-f06d312453ae'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:23.499230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ff0db7f-73cf-4955-b629-f06d312453ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf68dc7e2f2449038f81981472408c2b', 'request_id': 'req-5ff0db7f-73cf-4955-b629-f06d312453ae'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:23.520062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ff0db7f-73cf-4955-b629-f06d312453ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf68dc7e2f2449038f81981472408c2b', 'request_id': 'req-5ff0db7f-73cf-4955-b629-f06d312453ae'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:23.539716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ff0db7f-73cf-4955-b629-f06d312453ae admin admin] The token cache is being invalidate because project bf68dc7e2f2449038f81981472408c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:23.539716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ff0db7f-73cf-4955-b629-f06d312453ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:23.540868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ff0db7f-73cf-4955-b629-f06d312453ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:23.553280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1049/2057] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:23 2022] DELETE /identity/v3/projects/bf68dc7e2f2449038f81981472408c2b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:23.559949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fa747-e100-41a4-a6e4-55b53b520d18 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:23.560245 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fa747-e100-41a4-a6e4-55b53b520d18 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:23.560530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fa747-e100-41a4-a6e4-55b53b520d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:23.596040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c13fa747-e100-41a4-a6e4-55b53b520d18 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:23.597310 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c13fa747-e100-41a4-a6e4-55b53b520d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:23.708618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1009/2058] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:23.717684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f635ae-df17-4124-a68e-254b8192abe9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:23.718221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f635ae-df17-4124-a68e-254b8192abe9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:23.718322 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f635ae-df17-4124-a68e-254b8192abe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:23.739299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-17f635ae-df17-4124-a68e-254b8192abe9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:23.740507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-17f635ae-df17-4124-a68e-254b8192abe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:23.748833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1050/2059] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:23.753105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fa747-e100-41a4-a6e4-55b53b520d18 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:23.763182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fa747-e100-41a4-a6e4-55b53b520d18 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:23.767827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d7651-f579-487c-9727-e6dd955d96c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:23.768483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d7651-f579-487c-9727-e6dd955d96c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:23.768757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d7651-f579-487c-9727-e6dd955d96c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:23.769064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d7651-f579-487c-9727-e6dd955d96c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:23.769775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d7651-f579-487c-9727-e6dd955d96c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:34:23.770085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d7651-f579-487c-9727-e6dd955d96c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:23.771748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d7651-f579-487c-9727-e6dd955d96c2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:23.785129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1010/2060] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:34:23.789603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f635ae-df17-4124-a68e-254b8192abe9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:23.799128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f635ae-df17-4124-a68e-254b8192abe9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:23.803815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dccd51-6d1f-419e-930d-fefcd51a8c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:23.804489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dccd51-6d1f-419e-930d-fefcd51a8c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:23.804834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dccd51-6d1f-419e-930d-fefcd51a8c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:23.805221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dccd51-6d1f-419e-930d-fefcd51a8c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:23.806489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dccd51-6d1f-419e-930d-fefcd51a8c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:23.808451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dccd51-6d1f-419e-930d-fefcd51a8c07 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:23.858929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1051/2061] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:23 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:23.862836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d7651-f579-487c-9727-e6dd955d96c2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:23.874677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d7651-f579-487c-9727-e6dd955d96c2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:23.926256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:23.961437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb293-bfed-41d7-8e31-1ec665365383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:23.962233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb293-bfed-41d7-8e31-1ec665365383 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:23.962474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb293-bfed-41d7-8e31-1ec665365383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:23.962757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eb293-bfed-41d7-8e31-1ec665365383 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:23.964046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb293-bfed-41d7-8e31-1ec665365383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:23.966241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971eb293-bfed-41d7-8e31-1ec665365383 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:24.001076 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1011/2062] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:23 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:24.005307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dccd51-6d1f-419e-930d-fefcd51a8c07 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:24.017894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dccd51-6d1f-419e-930d-fefcd51a8c07 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:24.022811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9a121-3f4d-4b37-91c1-d224564b0645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:24.024032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9a121-3f4d-4b37-91c1-d224564b0645 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:24.024422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9a121-3f4d-4b37-91c1-d224564b0645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:24.024844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9a121-3f4d-4b37-91c1-d224564b0645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:24.025688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9a121-3f4d-4b37-91c1-d224564b0645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:24.027601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9a121-3f4d-4b37-91c1-d224564b0645 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:24.038100 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1052/2063] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:24.042781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb293-bfed-41d7-8e31-1ec665365383 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:24.053799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eb293-bfed-41d7-8e31-1ec665365383 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:24.060345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a54d7-b938-4184-8a51-ec9c69d5f804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:24.061196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a54d7-b938-4184-8a51-ec9c69d5f804 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:24.061618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a54d7-b938-4184-8a51-ec9c69d5f804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:24.062043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a54d7-b938-4184-8a51-ec9c69d5f804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:24.063089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a54d7-b938-4184-8a51-ec9c69d5f804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:24.065258 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a54d7-b938-4184-8a51-ec9c69d5f804 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:24.077821 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1012/2064] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:34:24.081786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9a121-3f4d-4b37-91c1-d224564b0645 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:24.093370 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9a121-3f4d-4b37-91c1-d224564b0645 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:24.098782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705a2a4-0cf9-4582-be1c-d9049de8a972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:24.099466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705a2a4-0cf9-4582-be1c-d9049de8a972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:24.099751 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705a2a4-0cf9-4582-be1c-d9049de8a972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:24.100055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705a2a4-0cf9-4582-be1c-d9049de8a972 admin admin] PATH_INFO: `/v3/projects/47693620a5ef4c96a58ef7f108a735a0/users/c821520a0ebb4805b76130865513b860/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:24.116469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705a2a4-0cf9-4582-be1c-d9049de8a972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47693620a5ef4c96a58ef7f108a735a0, user_id=c821520a0ebb4805b76130865513b860, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:24.124572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705a2a4-0cf9-4582-be1c-d9049de8a972 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:24.138898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1053/2065] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:24 2022] PUT /identity/v3/projects/47693620a5ef4c96a58ef7f108a735a0/users/c821520a0ebb4805b76130865513b860/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:24.152207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bdda6-7260-431d-b879-b44e278e67f6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:24.152603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bdda6-7260-431d-b879-b44e278e67f6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:24.153467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bdda6-7260-431d-b879-b44e278e67f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:24.184301 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ee7bdda6-7260-431d-b879-b44e278e67f6 None None] MFA Rules not processed for user `c821520a0ebb4805b76130865513b860`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:24.185538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ee7bdda6-7260-431d-b879-b44e278e67f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:24.265089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1013/2066] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:24.267393 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705a2a4-0cf9-4582-be1c-d9049de8a972 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:24.363624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705a2a4-0cf9-4582-be1c-d9049de8a972 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:24.372024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ae3f8-383a-4f4e-a593-a9f6564c898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:24.376329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ae3f8-383a-4f4e-a593-a9f6564c898e admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:24.376329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ae3f8-383a-4f4e-a593-a9f6564c898e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:24.376589 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ae3f8-383a-4f4e-a593-a9f6564c898e admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:24.377609 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ae3f8-383a-4f4e-a593-a9f6564c898e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:24.380302 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ae3f8-383a-4f4e-a593-a9f6564c898e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:24.419886 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1054/2067] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:24 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:24.421121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bdda6-7260-431d-b879-b44e278e67f6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:24.432693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bdda6-7260-431d-b879-b44e278e67f6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:24.506941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aceb59-9c60-431b-a749-0f5393bea03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:24.507843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aceb59-9c60-431b-a749-0f5393bea03a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:24.508319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aceb59-9c60-431b-a749-0f5393bea03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:24.509736 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aceb59-9c60-431b-a749-0f5393bea03a admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:24.510932 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aceb59-9c60-431b-a749-0f5393bea03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:24.513290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aceb59-9c60-431b-a749-0f5393bea03a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:24.544612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1014/2068] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:24 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:24.547993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ae3f8-383a-4f4e-a593-a9f6564c898e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:24.559722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ae3f8-383a-4f4e-a593-a9f6564c898e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:24.564640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453666cc-cbfa-48c8-9abd-e5262a7b80d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:24.565333 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453666cc-cbfa-48c8-9abd-e5262a7b80d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:24.565671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453666cc-cbfa-48c8-9abd-e5262a7b80d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:24.565962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453666cc-cbfa-48c8-9abd-e5262a7b80d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:24.566757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453666cc-cbfa-48c8-9abd-e5262a7b80d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:24.570747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453666cc-cbfa-48c8-9abd-e5262a7b80d1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:24.582622 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1055/2069] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:24.586883 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aceb59-9c60-431b-a749-0f5393bea03a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:24.599049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aceb59-9c60-431b-a749-0f5393bea03a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:24.605550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae10b9-04fb-497a-b403-a6071d0c7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:24.606254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae10b9-04fb-497a-b403-a6071d0c7e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:24.606537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae10b9-04fb-497a-b403-a6071d0c7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:24.606811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae10b9-04fb-497a-b403-a6071d0c7e98 admin admin] PATH_INFO: `/v3/projects/855221bcdd4241b384eb01abdd6c8e00/users/84322f030467471e8970b099a7b576bd/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:24.623146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae10b9-04fb-497a-b403-a6071d0c7e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855221bcdd4241b384eb01abdd6c8e00, user_id=84322f030467471e8970b099a7b576bd, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:24.625396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae10b9-04fb-497a-b403-a6071d0c7e98 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:24.642610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1015/2070] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:24 2022] PUT /identity/v3/projects/855221bcdd4241b384eb01abdd6c8e00/users/84322f030467471e8970b099a7b576bd/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:24.648101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453666cc-cbfa-48c8-9abd-e5262a7b80d1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:24.660123 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453666cc-cbfa-48c8-9abd-e5262a7b80d1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:24.695146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:24.726686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8145af-db59-4834-921e-16f13262ddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:24.727895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8145af-db59-4834-921e-16f13262ddfe admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:24.728289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8145af-db59-4834-921e-16f13262ddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:24.728711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8145af-db59-4834-921e-16f13262ddfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:24.729403 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8145af-db59-4834-921e-16f13262ddfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:24.731909 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8145af-db59-4834-921e-16f13262ddfe admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:24.747396 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1056/2071] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:34:24.749479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae10b9-04fb-497a-b403-a6071d0c7e98 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:24.768052 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae10b9-04fb-497a-b403-a6071d0c7e98 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:24.772890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbfea1-6f5e-4f64-9a62-4e4774f9157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:24.773579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbfea1-6f5e-4f64-9a62-4e4774f9157e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:24.773859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbfea1-6f5e-4f64-9a62-4e4774f9157e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:24.776575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbfea1-6f5e-4f64-9a62-4e4774f9157e admin admin] PATH_INFO: `/v3/projects/855221bcdd4241b384eb01abdd6c8e00/users/84322f030467471e8970b099a7b576bd/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:24.776575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbfea1-6f5e-4f64-9a62-4e4774f9157e admin admin] RBAC: Authorizing `identity:create_grant(project_id=855221bcdd4241b384eb01abdd6c8e00, user_id=84322f030467471e8970b099a7b576bd, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:24.779242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbfea1-6f5e-4f64-9a62-4e4774f9157e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:24.790611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1016/2072] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:24 2022] PUT /identity/v3/projects/855221bcdd4241b384eb01abdd6c8e00/users/84322f030467471e8970b099a7b576bd/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:24.800660 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb66f9-11d2-487b-9eff-f176cc914db1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:24.801067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb66f9-11d2-487b-9eff-f176cc914db1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:24.801376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb66f9-11d2-487b-9eff-f176cc914db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:24.834187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6bfb66f9-11d2-487b-9eff-f176cc914db1 None None] MFA Rules not processed for user `84322f030467471e8970b099a7b576bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:24.835406 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6bfb66f9-11d2-487b-9eff-f176cc914db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:24.907725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1057/2073] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:24.920073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbfea1-6f5e-4f64-9a62-4e4774f9157e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:24.921864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-06cbfea1-6f5e-4f64-9a62-4e4774f9157e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:24.927115 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:24.983026 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbfea1-6f5e-4f64-9a62-4e4774f9157e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:24.986791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ed7e0-424b-482c-aedb-9bfcddc82d82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:24.987422 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ed7e0-424b-482c-aedb-9bfcddc82d82 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:24.987707 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ed7e0-424b-482c-aedb-9bfcddc82d82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:24.988018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ed7e0-424b-482c-aedb-9bfcddc82d82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:24.997527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ed7e0-424b-482c-aedb-9bfcddc82d82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:24.998961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ed7e0-424b-482c-aedb-9bfcddc82d82 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:25.010531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1017/2074] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:25.109660 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb66f9-11d2-487b-9eff-f176cc914db1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:25.121182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb66f9-11d2-487b-9eff-f176cc914db1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:25.124714 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d235ef2-a6da-46ff-b83d-6fac363b2dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:25.125379 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d235ef2-a6da-46ff-b83d-6fac363b2dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:25.125662 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d235ef2-a6da-46ff-b83d-6fac363b2dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:25.125936 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d235ef2-a6da-46ff-b83d-6fac363b2dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:25.201088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d235ef2-a6da-46ff-b83d-6fac363b2dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:25.202586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d235ef2-a6da-46ff-b83d-6fac363b2dc6 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:25.211877 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1058/2075] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:25.484777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ed7e0-424b-482c-aedb-9bfcddc82d82 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:25.550232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ed7e0-424b-482c-aedb-9bfcddc82d82 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:25.554771 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:25.555517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:25.555947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:25.556414 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] PATH_INFO: `/v3/users/c821520a0ebb4805b76130865513b860` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:25.557706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c821520a0ebb4805b76130865513b860)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:25.559614 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:25.616552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c821520a0ebb4805b76130865513b860'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:25.623692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c821520a0ebb4805b76130865513b860'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:25.638288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c821520a0ebb4805b76130865513b860'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:25.639187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c821520a0ebb4805b76130865513b860'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:25.639859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c821520a0ebb4805b76130865513b860'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:25.655734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1018/2076] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:25 2022] DELETE /identity/v3/users/c821520a0ebb4805b76130865513b860 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:25.660168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015ea8-25e2-479c-8373-4ce2dd72a9de None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:25.660465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015ea8-25e2-479c-8373-4ce2dd72a9de None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:25.660748 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015ea8-25e2-479c-8373-4ce2dd72a9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:25.681156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-46015ea8-25e2-479c-8373-4ce2dd72a9de None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:25.682373 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-46015ea8-25e2-479c-8373-4ce2dd72a9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:25.727104 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:25.742640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1059/2077] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:25.753070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:25.754490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:25.783588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:25.817493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173305e5-da36-4100-ba40-2b37d9de7c8a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:25.822315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27ce7e-fc9b-4cb3-a86f-5045dc81cb13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:25.823047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27ce7e-fc9b-4cb3-a86f-5045dc81cb13 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:25.823331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27ce7e-fc9b-4cb3-a86f-5045dc81cb13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:25.823611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27ce7e-fc9b-4cb3-a86f-5045dc81cb13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:25.833442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27ce7e-fc9b-4cb3-a86f-5045dc81cb13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:25.835078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27ce7e-fc9b-4cb3-a86f-5045dc81cb13 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:25.845547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1019/2078] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:26.219110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46015ea8-25e2-479c-8373-4ce2dd72a9de None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:26.220629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-46015ea8-25e2-479c-8373-4ce2dd72a9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:26.237577 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46015ea8-25e2-479c-8373-4ce2dd72a9de None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:26.242328 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:26.243559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:26.243847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:26.244166 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] PATH_INFO: `/v3/projects/47693620a5ef4c96a58ef7f108a735a0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:26.245551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47693620a5ef4c96a58ef7f108a735a0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:26.247881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:26.298465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47693620a5ef4c96a58ef7f108a735a0', 'request_id': 'req-25e467f7-6997-4c01-b7b2-90b2b4acfe72'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.305343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47693620a5ef4c96a58ef7f108a735a0', 'request_id': 'req-25e467f7-6997-4c01-b7b2-90b2b4acfe72'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.313386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47693620a5ef4c96a58ef7f108a735a0', 'request_id': 'req-25e467f7-6997-4c01-b7b2-90b2b4acfe72'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.325485 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] The token cache is being invalidate because project 47693620a5ef4c96a58ef7f108a735a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:26.325790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.326434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.327953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1060/2079] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:26 2022] DELETE /identity/v3/projects/47693620a5ef4c96a58ef7f108a735a0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:26.331905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27ce7e-fc9b-4cb3-a86f-5045dc81cb13 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:26.342571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27ce7e-fc9b-4cb3-a86f-5045dc81cb13 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:26.409457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5d20-455b-4389-980b-64cbef0dda5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:26.410103 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5d20-455b-4389-980b-64cbef0dda5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:26.410381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5d20-455b-4389-980b-64cbef0dda5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:26.410654 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5d20-455b-4389-980b-64cbef0dda5b admin admin] PATH_INFO: `/v3/users/84322f030467471e8970b099a7b576bd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:26.411877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e5d20-455b-4389-980b-64cbef0dda5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84322f030467471e8970b099a7b576bd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:26.413816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e5d20-455b-4389-980b-64cbef0dda5b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:26.464880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-333e5d20-455b-4389-980b-64cbef0dda5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84322f030467471e8970b099a7b576bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.472224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-333e5d20-455b-4389-980b-64cbef0dda5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84322f030467471e8970b099a7b576bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.485887 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-333e5d20-455b-4389-980b-64cbef0dda5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84322f030467471e8970b099a7b576bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.486582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-333e5d20-455b-4389-980b-64cbef0dda5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84322f030467471e8970b099a7b576bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.487185 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-333e5d20-455b-4389-980b-64cbef0dda5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84322f030467471e8970b099a7b576bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.503068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1020/2080] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:26 2022] DELETE /identity/v3/users/84322f030467471e8970b099a7b576bd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:26.815572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:26.817042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:26.829884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e467f7-6997-4c01-b7b2-90b2b4acfe72 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:26.901998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:26.902636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:26.902914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:26.903185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f admin admin] PATH_INFO: `/v3/projects/855221bcdd4241b384eb01abdd6c8e00` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:26.904318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f admin admin] RBAC: Authorizing `identity:delete_project(project_id=855221bcdd4241b384eb01abdd6c8e00)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:26.906247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:26.951486 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855221bcdd4241b384eb01abdd6c8e00', 'request_id': 'req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.957003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855221bcdd4241b384eb01abdd6c8e00', 'request_id': 'req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.965157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855221bcdd4241b384eb01abdd6c8e00', 'request_id': 'req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.976352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f admin admin] The token cache is being invalidate because project 855221bcdd4241b384eb01abdd6c8e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:26.976642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.977292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0a99d06-7e12-4e1c-9d8d-99dc3375634f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:26.978817 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1061/2081] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:26 2022] DELETE /identity/v3/projects/855221bcdd4241b384eb01abdd6c8e00 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:26.983673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debee3f0-c301-4ae4-81d8-4fad93093fec None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:26.983972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debee3f0-c301-4ae4-81d8-4fad93093fec None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:26.984274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debee3f0-c301-4ae4-81d8-4fad93093fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:27.003620 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-debee3f0-c301-4ae4-81d8-4fad93093fec None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:27.004810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-debee3f0-c301-4ae4-81d8-4fad93093fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:27.050832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:27.069893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1021/2082] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:27.078266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2d245-b734-44c6-a9d9-397273adf3c4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:27.078565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2d245-b734-44c6-a9d9-397273adf3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:27.078848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2d245-b734-44c6-a9d9-397273adf3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:27.088047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:27.101135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-09b2d245-b734-44c6-a9d9-397273adf3c4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:27.102911 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-09b2d245-b734-44c6-a9d9-397273adf3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:27.110880 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1062/2083] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:27.115536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debee3f0-c301-4ae4-81d8-4fad93093fec None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:27.126931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debee3f0-c301-4ae4-81d8-4fad93093fec None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:27.131529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641196d2-7497-4510-9d4b-3962c1e7dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:27.132171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641196d2-7497-4510-9d4b-3962c1e7dc56 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:27.132453 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641196d2-7497-4510-9d4b-3962c1e7dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:27.132733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641196d2-7497-4510-9d4b-3962c1e7dc56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:27.134031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641196d2-7497-4510-9d4b-3962c1e7dc56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:34:27.135297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641196d2-7497-4510-9d4b-3962c1e7dc56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:27.136890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641196d2-7497-4510-9d4b-3962c1e7dc56 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:27.161448 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1022/2084] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:34:27.161718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2d245-b734-44c6-a9d9-397273adf3c4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:27.165255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2d245-b734-44c6-a9d9-397273adf3c4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:27.169938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762181e-ecdc-4f16-bd55-0c8858b1057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:27.170693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762181e-ecdc-4f16-bd55-0c8858b1057d admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:27.170983 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762181e-ecdc-4f16-bd55-0c8858b1057d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:27.171261 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762181e-ecdc-4f16-bd55-0c8858b1057d admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:27.171931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762181e-ecdc-4f16-bd55-0c8858b1057d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:27.173890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762181e-ecdc-4f16-bd55-0c8858b1057d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:27.202712 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1063/2085] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:27 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:27.206835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641196d2-7497-4510-9d4b-3962c1e7dc56 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:27.217362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641196d2-7497-4510-9d4b-3962c1e7dc56 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:27.276788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44703d-875f-4ace-92b0-f6c5b7e67a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:27.277438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44703d-875f-4ace-92b0-f6c5b7e67a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:27.277719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44703d-875f-4ace-92b0-f6c5b7e67a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:27.277991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44703d-875f-4ace-92b0-f6c5b7e67a95 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:27.279249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44703d-875f-4ace-92b0-f6c5b7e67a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:27.281191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44703d-875f-4ace-92b0-f6c5b7e67a95 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:27.311676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1023/2086] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:27 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:27.320267 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762181e-ecdc-4f16-bd55-0c8858b1057d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:27.331259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762181e-ecdc-4f16-bd55-0c8858b1057d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:27.335766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4292cf-3b8b-48fa-9b3e-366c10f3718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:27.336374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4292cf-3b8b-48fa-9b3e-366c10f3718d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:27.337309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4292cf-3b8b-48fa-9b3e-366c10f3718d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:27.337592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4292cf-3b8b-48fa-9b3e-366c10f3718d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:27.338282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4292cf-3b8b-48fa-9b3e-366c10f3718d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:27.340353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4292cf-3b8b-48fa-9b3e-366c10f3718d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:27.350082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1064/2087] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:27.354628 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44703d-875f-4ace-92b0-f6c5b7e67a95 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:27.365124 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44703d-875f-4ace-92b0-f6c5b7e67a95 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:27.371808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8d43c-45d2-4939-8ccd-d7b7b39768b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:27.372447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8d43c-45d2-4939-8ccd-d7b7b39768b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:27.372733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8d43c-45d2-4939-8ccd-d7b7b39768b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:27.373058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8d43c-45d2-4939-8ccd-d7b7b39768b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:27.373766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8d43c-45d2-4939-8ccd-d7b7b39768b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:27.375536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8d43c-45d2-4939-8ccd-d7b7b39768b8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:27.387421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1024/2088] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:27.391470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4292cf-3b8b-48fa-9b3e-366c10f3718d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:27.402162 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4292cf-3b8b-48fa-9b3e-366c10f3718d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:27.406797 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d6dff-755d-4cbe-9b11-ec941cc0a5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:27.407445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d6dff-755d-4cbe-9b11-ec941cc0a5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:27.407728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d6dff-755d-4cbe-9b11-ec941cc0a5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:27.408005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d6dff-755d-4cbe-9b11-ec941cc0a5c8 admin admin] PATH_INFO: `/v3/projects/5a24b4d458504c309b48b63e10a783b0/users/8d9efdf8f2cf4d9ca107d353f4d2361d/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:27.423412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d6dff-755d-4cbe-9b11-ec941cc0a5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a24b4d458504c309b48b63e10a783b0, user_id=8d9efdf8f2cf4d9ca107d353f4d2361d, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:27.426092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d6dff-755d-4cbe-9b11-ec941cc0a5c8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:27.439039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1065/2089] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:27 2022] PUT /identity/v3/projects/5a24b4d458504c309b48b63e10a783b0/users/8d9efdf8f2cf4d9ca107d353f4d2361d/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:27.450468 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b3d8e-322f-4ecb-99b0-7675aa5fcc4e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:27.450771 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b3d8e-322f-4ecb-99b0-7675aa5fcc4e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:27.451045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b3d8e-322f-4ecb-99b0-7675aa5fcc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:27.480588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a60b3d8e-322f-4ecb-99b0-7675aa5fcc4e None None] MFA Rules not processed for user `8d9efdf8f2cf4d9ca107d353f4d2361d`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:27.481882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a60b3d8e-322f-4ecb-99b0-7675aa5fcc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:27.549386 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1025/2090] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:27.560232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d6dff-755d-4cbe-9b11-ec941cc0a5c8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:27.561973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c89d6dff-755d-4cbe-9b11-ec941cc0a5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:27.620648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d6dff-755d-4cbe-9b11-ec941cc0a5c8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:27.624196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023146dd-1399-4489-8f84-0981aa545a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:27.624813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023146dd-1399-4489-8f84-0981aa545a43 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:27.625126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023146dd-1399-4489-8f84-0981aa545a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:27.625404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023146dd-1399-4489-8f84-0981aa545a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:27.634217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023146dd-1399-4489-8f84-0981aa545a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:27.636253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023146dd-1399-4489-8f84-0981aa545a43 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:27.644998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1066/2091] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:34:34.031368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b3d8e-322f-4ecb-99b0-7675aa5fcc4e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:34.083639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:34.104748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b3d8e-322f-4ecb-99b0-7675aa5fcc4e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:34.109336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:34.109980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:34.110308 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:34.110535 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] PATH_INFO: `/v3/users/8d9efdf8f2cf4d9ca107d353f4d2361d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:34.111748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9efdf8f2cf4d9ca107d353f4d2361d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:34.113745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:34.160265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9efdf8f2cf4d9ca107d353f4d2361d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:34.167853 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9efdf8f2cf4d9ca107d353f4d2361d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:34.179398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9efdf8f2cf4d9ca107d353f4d2361d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:34.181019 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9efdf8f2cf4d9ca107d353f4d2361d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:34.181635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9efdf8f2cf4d9ca107d353f4d2361d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:34.194409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1026/2092] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:34 2022] DELETE /identity/v3/users/8d9efdf8f2cf4d9ca107d353f4d2361d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:34.198942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed52b0b-1f2f-4dc7-9834-346bae829bec None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:34.199401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed52b0b-1f2f-4dc7-9834-346bae829bec None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:34.199512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed52b0b-1f2f-4dc7-9834-346bae829bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:34.219329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6ed52b0b-1f2f-4dc7-9834-346bae829bec None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:34.220509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6ed52b0b-1f2f-4dc7-9834-346bae829bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:34.278890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1067/2093] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:34.288546 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:34.290084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:34.348695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638d2f4-68a8-43f7-8158-d103c878d936 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:34.352425 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be7505-f74c-4a49-89a8-d81526d368be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:34.353086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be7505-f74c-4a49-89a8-d81526d368be service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:34.353376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be7505-f74c-4a49-89a8-d81526d368be service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:34.353664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be7505-f74c-4a49-89a8-d81526d368be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:34.363783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be7505-f74c-4a49-89a8-d81526d368be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:34.365279 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be7505-f74c-4a49-89a8-d81526d368be service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:34.375939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1027/2094] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:34.754047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed52b0b-1f2f-4dc7-9834-346bae829bec None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:34.755572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6ed52b0b-1f2f-4dc7-9834-346bae829bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:34.768508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed52b0b-1f2f-4dc7-9834-346bae829bec None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:34.774954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737674c-5a80-48c5-804c-fed0bffc3eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:34.775730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737674c-5a80-48c5-804c-fed0bffc3eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:34.776010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737674c-5a80-48c5-804c-fed0bffc3eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:34.776287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737674c-5a80-48c5-804c-fed0bffc3eec admin admin] PATH_INFO: `/v3/projects/5a24b4d458504c309b48b63e10a783b0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:34.785232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737674c-5a80-48c5-804c-fed0bffc3eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a24b4d458504c309b48b63e10a783b0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:34.788005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737674c-5a80-48c5-804c-fed0bffc3eec admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:34.839999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:34.851777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5737674c-5a80-48c5-804c-fed0bffc3eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a24b4d458504c309b48b63e10a783b0', 'request_id': 'req-5737674c-5a80-48c5-804c-fed0bffc3eec'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:34.859492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5737674c-5a80-48c5-804c-fed0bffc3eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a24b4d458504c309b48b63e10a783b0', 'request_id': 'req-5737674c-5a80-48c5-804c-fed0bffc3eec'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:34.873785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5737674c-5a80-48c5-804c-fed0bffc3eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a24b4d458504c309b48b63e10a783b0', 'request_id': 'req-5737674c-5a80-48c5-804c-fed0bffc3eec'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:34.887907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5737674c-5a80-48c5-804c-fed0bffc3eec admin admin] The token cache is being invalidate because project 5a24b4d458504c309b48b63e10a783b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:34.888451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5737674c-5a80-48c5-804c-fed0bffc3eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:34.889165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5737674c-5a80-48c5-804c-fed0bffc3eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:34.890719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1068/2095] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:34 2022] DELETE /identity/v3/projects/5a24b4d458504c309b48b63e10a783b0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:34.896185 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda73cb-9bdd-443a-9db1-8abf8b945eee None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:34.896526 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda73cb-9bdd-443a-9db1-8abf8b945eee None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:34.896872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda73cb-9bdd-443a-9db1-8abf8b945eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:34.917912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4dda73cb-9bdd-443a-9db1-8abf8b945eee None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:34.919104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4dda73cb-9bdd-443a-9db1-8abf8b945eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:34.984447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1028/2096] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:34.992687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600d6b-096e-4499-a35e-132d4e2ad503 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:34.992995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600d6b-096e-4499-a35e-132d4e2ad503 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:34.993273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600d6b-096e-4499-a35e-132d4e2ad503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:35.014595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4e600d6b-096e-4499-a35e-132d4e2ad503 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:35.015851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4e600d6b-096e-4499-a35e-132d4e2ad503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:35.025296 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1069/2097] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:34:35.030175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda73cb-9bdd-443a-9db1-8abf8b945eee None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:35.037422 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:35.042824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda73cb-9bdd-443a-9db1-8abf8b945eee None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:35.049716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f572-db15-4e6f-820f-f9890acc4ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:35.051259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f572-db15-4e6f-820f-f9890acc4ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:35.051542 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f572-db15-4e6f-820f-f9890acc4ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:35.052211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f572-db15-4e6f-820f-f9890acc4ac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:35.053198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76f572-db15-4e6f-820f-f9890acc4ac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:34:35.053931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76f572-db15-4e6f-820f-f9890acc4ac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:35.056430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76f572-db15-4e6f-820f-f9890acc4ac6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:35.068618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1029/2098] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:34:35.073923 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600d6b-096e-4499-a35e-132d4e2ad503 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:35.083146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600d6b-096e-4499-a35e-132d4e2ad503 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:35.088073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dbda5-64c8-432f-ad0a-9864d704a33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:35.088928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dbda5-64c8-432f-ad0a-9864d704a33e admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:35.089055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dbda5-64c8-432f-ad0a-9864d704a33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:35.089255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dbda5-64c8-432f-ad0a-9864d704a33e admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:35.089950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dbda5-64c8-432f-ad0a-9864d704a33e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:35.091842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dbda5-64c8-432f-ad0a-9864d704a33e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:35.125887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1070/2099] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:35 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:35.127930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f572-db15-4e6f-820f-f9890acc4ac6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:35.141925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f572-db15-4e6f-820f-f9890acc4ac6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:35.206132 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac8691-1dee-46c1-a304-a4702b1f4359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:35.206764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac8691-1dee-46c1-a304-a4702b1f4359 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:35.207068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac8691-1dee-46c1-a304-a4702b1f4359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:35.207342 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac8691-1dee-46c1-a304-a4702b1f4359 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:35.208008 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac8691-1dee-46c1-a304-a4702b1f4359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:35.209979 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac8691-1dee-46c1-a304-a4702b1f4359 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:35.235290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1030/2100] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:35 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:35.239405 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dbda5-64c8-432f-ad0a-9864d704a33e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:35.250575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dbda5-64c8-432f-ad0a-9864d704a33e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:35.255330 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe1771-4a17-4399-a2c7-4c0c648b4991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:35.255951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1771-4a17-4399-a2c7-4c0c648b4991 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:35.256417 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1771-4a17-4399-a2c7-4c0c648b4991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:35.256706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe1771-4a17-4399-a2c7-4c0c648b4991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:35.257459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe1771-4a17-4399-a2c7-4c0c648b4991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:35.259878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe1771-4a17-4399-a2c7-4c0c648b4991 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:35.272931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1071/2101] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:35.275323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac8691-1dee-46c1-a304-a4702b1f4359 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:35.285435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac8691-1dee-46c1-a304-a4702b1f4359 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:35.290202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d23d2-a640-43a1-a0d5-1af51574110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:35.291020 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d23d2-a640-43a1-a0d5-1af51574110d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:35.291310 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d23d2-a640-43a1-a0d5-1af51574110d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:35.291589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d23d2-a640-43a1-a0d5-1af51574110d admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:35.293047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d23d2-a640-43a1-a0d5-1af51574110d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:35.294642 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d23d2-a640-43a1-a0d5-1af51574110d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:35.306006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1031/2102] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:34:35.310126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe1771-4a17-4399-a2c7-4c0c648b4991 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:35.321484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe1771-4a17-4399-a2c7-4c0c648b4991 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:35.326202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdb12e-d129-46c6-8607-4723c36e9876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:35.326940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdb12e-d129-46c6-8607-4723c36e9876 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:35.327283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdb12e-d129-46c6-8607-4723c36e9876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:35.327619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdb12e-d129-46c6-8607-4723c36e9876 admin admin] PATH_INFO: `/v3/projects/a9b3e9cd863b490e95dee19f678dde76/users/5267239ceb854233b8b412c776b198fe/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:35.343765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdb12e-d129-46c6-8607-4723c36e9876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b3e9cd863b490e95dee19f678dde76, user_id=5267239ceb854233b8b412c776b198fe, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:35.346040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdb12e-d129-46c6-8607-4723c36e9876 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:35.361148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1072/2103] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:35 2022] PUT /identity/v3/projects/a9b3e9cd863b490e95dee19f678dde76/users/5267239ceb854233b8b412c776b198fe/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:35.372262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d73f95-453d-4141-8cee-42a665e5a410 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:35.372551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d73f95-453d-4141-8cee-42a665e5a410 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:35.372833 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d73f95-453d-4141-8cee-42a665e5a410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:35.405660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-00d73f95-453d-4141-8cee-42a665e5a410 None None] MFA Rules not processed for user `5267239ceb854233b8b412c776b198fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:35.406820 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-00d73f95-453d-4141-8cee-42a665e5a410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:35.488089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1032/2104] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:35.496555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdb12e-d129-46c6-8607-4723c36e9876 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:35.498556 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0dfdb12e-d129-46c6-8607-4723c36e9876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:35.560560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdb12e-d129-46c6-8607-4723c36e9876 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:35.566115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7fd5-63b0-4be8-aa4d-57ecc2bf2536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:35.566749 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7fd5-63b0-4be8-aa4d-57ecc2bf2536 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:35.567035 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7fd5-63b0-4be8-aa4d-57ecc2bf2536 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:35.567313 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7fd5-63b0-4be8-aa4d-57ecc2bf2536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:35.577016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c7fd5-63b0-4be8-aa4d-57ecc2bf2536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:35.578607 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c7fd5-63b0-4be8-aa4d-57ecc2bf2536 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:35.588620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1073/2105] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:35.986458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d73f95-453d-4141-8cee-42a665e5a410 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:35.987850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-00d73f95-453d-4141-8cee-42a665e5a410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:36.059270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d73f95-453d-4141-8cee-42a665e5a410 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:36.063818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:36.064461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:36.064745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:36.065050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] PATH_INFO: `/v3/users/dffd98d83a1d443d9190e734dfadaf15` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:36.066219 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dffd98d83a1d443d9190e734dfadaf15)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:36.068150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:36.069649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:36.114760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dffd98d83a1d443d9190e734dfadaf15'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:36.122364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dffd98d83a1d443d9190e734dfadaf15'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:36.134113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dffd98d83a1d443d9190e734dfadaf15'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:36.134780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dffd98d83a1d443d9190e734dfadaf15'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:36.135649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dffd98d83a1d443d9190e734dfadaf15'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:36.147128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1033/2106] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:35 2022] DELETE /identity/v3/users/dffd98d83a1d443d9190e734dfadaf15 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:36.151808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12078d1-ac7a-4555-b159-e4efabf5de38 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:36.152103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12078d1-ac7a-4555-b159-e4efabf5de38 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:36.152383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12078d1-ac7a-4555-b159-e4efabf5de38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:36.171404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e12078d1-ac7a-4555-b159-e4efabf5de38 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:36.172599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e12078d1-ac7a-4555-b159-e4efabf5de38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:36.230933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1074/2107] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:36.241241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:36.243501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:36.300522 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edbc6a-16fd-4f40-98ec-2be0d01c0112 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:36.304180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dfd50-263d-4ab5-8296-dec01696e74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:36.304795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dfd50-263d-4ab5-8296-dec01696e74b service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:36.305116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dfd50-263d-4ab5-8296-dec01696e74b service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:36.305463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dfd50-263d-4ab5-8296-dec01696e74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:36.314076 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dfd50-263d-4ab5-8296-dec01696e74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:36.315499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dfd50-263d-4ab5-8296-dec01696e74b service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:36.324819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1034/2108] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:36.597576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12078d1-ac7a-4555-b159-e4efabf5de38 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:36.599519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e12078d1-ac7a-4555-b159-e4efabf5de38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:36.613299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12078d1-ac7a-4555-b159-e4efabf5de38 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:36.618647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500c12e-8299-48bd-8622-1c89cadf8f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:36.619468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500c12e-8299-48bd-8622-1c89cadf8f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:36.619758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500c12e-8299-48bd-8622-1c89cadf8f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:36.620035 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500c12e-8299-48bd-8622-1c89cadf8f68 admin admin] PATH_INFO: `/v3/projects/d4917ef7020c4413970ea286b83b8de9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:36.621970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500c12e-8299-48bd-8622-1c89cadf8f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4917ef7020c4413970ea286b83b8de9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:36.623222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500c12e-8299-48bd-8622-1c89cadf8f68 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:36.624965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:36.687262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5500c12e-8299-48bd-8622-1c89cadf8f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4917ef7020c4413970ea286b83b8de9', 'request_id': 'req-5500c12e-8299-48bd-8622-1c89cadf8f68'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:36.692848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5500c12e-8299-48bd-8622-1c89cadf8f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4917ef7020c4413970ea286b83b8de9', 'request_id': 'req-5500c12e-8299-48bd-8622-1c89cadf8f68'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:36.701699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5500c12e-8299-48bd-8622-1c89cadf8f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4917ef7020c4413970ea286b83b8de9', 'request_id': 'req-5500c12e-8299-48bd-8622-1c89cadf8f68'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:36.716562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5500c12e-8299-48bd-8622-1c89cadf8f68 admin admin] The token cache is being invalidate because project d4917ef7020c4413970ea286b83b8de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:36.716856 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5500c12e-8299-48bd-8622-1c89cadf8f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:36.717539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5500c12e-8299-48bd-8622-1c89cadf8f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:36.719038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1075/2109] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:36 2022] DELETE /identity/v3/projects/d4917ef7020c4413970ea286b83b8de9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:36.723954 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6d1b9-595a-4a5d-9c45-95f395cd0448 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:36.724243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6d1b9-595a-4a5d-9c45-95f395cd0448 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:36.724524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6d1b9-595a-4a5d-9c45-95f395cd0448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:36.743980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c8a6d1b9-595a-4a5d-9c45-95f395cd0448 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:36.745200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c8a6d1b9-595a-4a5d-9c45-95f395cd0448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:36.806852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1035/2110] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:36.816355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731812b2-10fe-42a2-ad96-561ab2cb35f9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:36.816649 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731812b2-10fe-42a2-ad96-561ab2cb35f9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:36.816961 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731812b2-10fe-42a2-ad96-561ab2cb35f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:36.853657 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-731812b2-10fe-42a2-ad96-561ab2cb35f9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:36.856097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-731812b2-10fe-42a2-ad96-561ab2cb35f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:36.870988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1076/2111] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:36.878779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6d1b9-595a-4a5d-9c45-95f395cd0448 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:36.889920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6d1b9-595a-4a5d-9c45-95f395cd0448 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:36.895104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40524e8-fd9a-4d95-ae6b-f63ce1f527f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:36.895759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40524e8-fd9a-4d95-ae6b-f63ce1f527f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:36.896047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40524e8-fd9a-4d95-ae6b-f63ce1f527f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:36.896329 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40524e8-fd9a-4d95-ae6b-f63ce1f527f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:36.897234 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40524e8-fd9a-4d95-ae6b-f63ce1f527f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:34:36.897694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40524e8-fd9a-4d95-ae6b-f63ce1f527f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:36.900060 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40524e8-fd9a-4d95-ae6b-f63ce1f527f8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:36.914737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1036/2112] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:34:36.919547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731812b2-10fe-42a2-ad96-561ab2cb35f9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:36.929525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731812b2-10fe-42a2-ad96-561ab2cb35f9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:36.934719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a56bd-fd43-47a8-bce2-27a1fa4e2b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:36.935372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a56bd-fd43-47a8-bce2-27a1fa4e2b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:36.935657 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a56bd-fd43-47a8-bce2-27a1fa4e2b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:36.935935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a56bd-fd43-47a8-bce2-27a1fa4e2b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:36.936704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a56bd-fd43-47a8-bce2-27a1fa4e2b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:36.938713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a56bd-fd43-47a8-bce2-27a1fa4e2b9d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:36.982628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1077/2113] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:36 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:36.986751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40524e8-fd9a-4d95-ae6b-f63ce1f527f8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:37.000521 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40524e8-fd9a-4d95-ae6b-f63ce1f527f8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:37.007711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:37.093852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc85c4-e24e-4a62-976a-63f66cb0560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:37.094515 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc85c4-e24e-4a62-976a-63f66cb0560e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.094842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc85c4-e24e-4a62-976a-63f66cb0560e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.095253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc85c4-e24e-4a62-976a-63f66cb0560e admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.095951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc85c4-e24e-4a62-976a-63f66cb0560e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:37.100921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a56bd-fd43-47a8-bce2-27a1fa4e2b9d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:37.101080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc85c4-e24e-4a62-976a-63f66cb0560e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:37.103058 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-de4a56bd-fd43-47a8-bce2-27a1fa4e2b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:37.136534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1037/2114] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:36 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:37.141939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc85c4-e24e-4a62-976a-63f66cb0560e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:37.159983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc85c4-e24e-4a62-976a-63f66cb0560e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:37.167173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb74f1-2123-4305-8338-5ee18d2fcafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:37.168695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb74f1-2123-4305-8338-5ee18d2fcafa admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.169167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb74f1-2123-4305-8338-5ee18d2fcafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.170907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb74f1-2123-4305-8338-5ee18d2fcafa admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.171651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb74f1-2123-4305-8338-5ee18d2fcafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:37.173303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb74f1-2123-4305-8338-5ee18d2fcafa admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:37.193201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1038/2115] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:37.194736 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb74f1-2123-4305-8338-5ee18d2fcafa admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:37.205480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a56bd-fd43-47a8-bce2-27a1fa4e2b9d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:37.210933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22936c-99ec-4b78-b33a-f2a6137fa597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:37.211075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb74f1-2123-4305-8338-5ee18d2fcafa admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:37.212073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22936c-99ec-4b78-b33a-f2a6137fa597 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.212360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22936c-99ec-4b78-b33a-f2a6137fa597 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.212629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22936c-99ec-4b78-b33a-f2a6137fa597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.214530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cd22936c-99ec-4b78-b33a-f2a6137fa597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:37.216882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddba240-08c4-4022-b796-514bb3744664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:37.217741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddba240-08c4-4022-b796-514bb3744664 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.218024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddba240-08c4-4022-b796-514bb3744664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.218294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddba240-08c4-4022-b796-514bb3744664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.219220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddba240-08c4-4022-b796-514bb3744664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:37.220827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddba240-08c4-4022-b796-514bb3744664 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:37.252998 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1039/2116] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:34:37.256656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddba240-08c4-4022-b796-514bb3744664 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:37.269114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddba240-08c4-4022-b796-514bb3744664 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:37.275888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65a44a-e647-4a84-8cac-6d77d59b97cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:37.276555 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65a44a-e647-4a84-8cac-6d77d59b97cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.276834 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65a44a-e647-4a84-8cac-6d77d59b97cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.277150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65a44a-e647-4a84-8cac-6d77d59b97cb admin admin] PATH_INFO: `/v3/projects/a8ca7cd8bd1947e1b920d88d5214a275/users/3eaae78695b04f44b60fcae0a9b78004/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.296223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65a44a-e647-4a84-8cac-6d77d59b97cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ca7cd8bd1947e1b920d88d5214a275, user_id=3eaae78695b04f44b60fcae0a9b78004, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:37.298961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65a44a-e647-4a84-8cac-6d77d59b97cb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:37.312370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1040/2117] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:37 2022] PUT /identity/v3/projects/a8ca7cd8bd1947e1b920d88d5214a275/users/3eaae78695b04f44b60fcae0a9b78004/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:37.313902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22936c-99ec-4b78-b33a-f2a6137fa597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:37.315357 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22936c-99ec-4b78-b33a-f2a6137fa597 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:37.324017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a046e-394d-48ea-b554-f814a3b20cb1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.324305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a046e-394d-48ea-b554-f814a3b20cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.324582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a046e-394d-48ea-b554-f814a3b20cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.325525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1078/2118] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:34:37.354068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4e6a046e-394d-48ea-b554-f814a3b20cb1 None None] MFA Rules not processed for user `3eaae78695b04f44b60fcae0a9b78004`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:37.355265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4e6a046e-394d-48ea-b554-f814a3b20cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:37.433288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1041/2119] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:34:37.437967 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22936c-99ec-4b78-b33a-f2a6137fa597 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:37.449144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22936c-99ec-4b78-b33a-f2a6137fa597 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:37.457530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:37.517482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3c659-4082-498f-95a6-1ba4b7718294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:37.518119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3c659-4082-498f-95a6-1ba4b7718294 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.518492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3c659-4082-498f-95a6-1ba4b7718294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.518774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3c659-4082-498f-95a6-1ba4b7718294 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.519478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3c659-4082-498f-95a6-1ba4b7718294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:37.521392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3c659-4082-498f-95a6-1ba4b7718294 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:37.550369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1079/2120] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:37 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:37.554374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a046e-394d-48ea-b554-f814a3b20cb1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:37.566605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a046e-394d-48ea-b554-f814a3b20cb1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:37.610929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:37.629370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7fbbd-3f61-4768-bcf3-33e38f915af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:37.630002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7fbbd-3f61-4768-bcf3-33e38f915af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.630278 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7fbbd-3f61-4768-bcf3-33e38f915af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.630551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7fbbd-3f61-4768-bcf3-33e38f915af8 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.631228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7fbbd-3f61-4768-bcf3-33e38f915af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:37.635631 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7fbbd-3f61-4768-bcf3-33e38f915af8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:37.655554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1042/2121] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:37 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:37.659484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3c659-4082-498f-95a6-1ba4b7718294 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:37.670717 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3c659-4082-498f-95a6-1ba4b7718294 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:37.675444 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e319d63-39f9-485f-98c4-3346cce9c231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:37.676051 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319d63-39f9-485f-98c4-3346cce9c231 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.676337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319d63-39f9-485f-98c4-3346cce9c231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.676615 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319d63-39f9-485f-98c4-3346cce9c231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.677368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e319d63-39f9-485f-98c4-3346cce9c231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:37.679003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e319d63-39f9-485f-98c4-3346cce9c231 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:37.690837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1080/2122] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:37.695012 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7fbbd-3f61-4768-bcf3-33e38f915af8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:37.705393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7fbbd-3f61-4768-bcf3-33e38f915af8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:37.710147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f8933-b295-4dee-b506-87d5e94c4a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:37.710794 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f8933-b295-4dee-b506-87d5e94c4a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.711114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f8933-b295-4dee-b506-87d5e94c4a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.712127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f8933-b295-4dee-b506-87d5e94c4a8f admin admin] PATH_INFO: `/v3/projects/fb00f3f6ff8a4203a810dad49b8b34f9/users/ea5662abcd9f406a9404ddf8adc2a6c1/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.726878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f8933-b295-4dee-b506-87d5e94c4a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb00f3f6ff8a4203a810dad49b8b34f9, user_id=ea5662abcd9f406a9404ddf8adc2a6c1, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:37.729671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f8933-b295-4dee-b506-87d5e94c4a8f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:37.742373 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1043/2123] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:37 2022] PUT /identity/v3/projects/fb00f3f6ff8a4203a810dad49b8b34f9/users/ea5662abcd9f406a9404ddf8adc2a6c1/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:37.748728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e319d63-39f9-485f-98c4-3346cce9c231 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:37.757312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e319d63-39f9-485f-98c4-3346cce9c231 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:37.822750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43f28-fa65-4634-b646-cee8f0c98bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:37.823379 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43f28-fa65-4634-b646-cee8f0c98bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.823686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43f28-fa65-4634-b646-cee8f0c98bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.823965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43f28-fa65-4634-b646-cee8f0c98bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.824664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f43f28-fa65-4634-b646-cee8f0c98bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:37.826315 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f43f28-fa65-4634-b646-cee8f0c98bbf admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:37.838219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1081/2124] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:37.842536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f8933-b295-4dee-b506-87d5e94c4a8f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:37.857462 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f8933-b295-4dee-b506-87d5e94c4a8f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:37.862490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db222b3-3230-414b-82ae-1139c84f07c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:37.863267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db222b3-3230-414b-82ae-1139c84f07c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.863641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db222b3-3230-414b-82ae-1139c84f07c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.864019 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db222b3-3230-414b-82ae-1139c84f07c8 admin admin] PATH_INFO: `/v3/projects/fb00f3f6ff8a4203a810dad49b8b34f9/users/ea5662abcd9f406a9404ddf8adc2a6c1/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.866487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db222b3-3230-414b-82ae-1139c84f07c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb00f3f6ff8a4203a810dad49b8b34f9, user_id=ea5662abcd9f406a9404ddf8adc2a6c1, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:37.869775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db222b3-3230-414b-82ae-1139c84f07c8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:37.882784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1044/2125] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:37 2022] PUT /identity/v3/projects/fb00f3f6ff8a4203a810dad49b8b34f9/users/ea5662abcd9f406a9404ddf8adc2a6c1/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:37.893395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405a64f-8f27-4e99-9fc1-f94ac448eae1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:37.893867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405a64f-8f27-4e99-9fc1-f94ac448eae1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:37.901933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405a64f-8f27-4e99-9fc1-f94ac448eae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:37.927783 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8405a64f-8f27-4e99-9fc1-f94ac448eae1 None None] MFA Rules not processed for user `ea5662abcd9f406a9404ddf8adc2a6c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:37.929037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8405a64f-8f27-4e99-9fc1-f94ac448eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:37.999441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1082/2126] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:38.010889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db222b3-3230-414b-82ae-1139c84f07c8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:38.083449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db222b3-3230-414b-82ae-1139c84f07c8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:38.088047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399390f-77b8-405f-993e-7df10b0b281e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:38.088684 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399390f-77b8-405f-993e-7df10b0b281e service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:38.089019 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399390f-77b8-405f-993e-7df10b0b281e service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:38.089274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399390f-77b8-405f-993e-7df10b0b281e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:38.158696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399390f-77b8-405f-993e-7df10b0b281e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:38.160334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399390f-77b8-405f-993e-7df10b0b281e service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:38.172108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1045/2127] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:40.848596 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405a64f-8f27-4e99-9fc1-f94ac448eae1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:40.858306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:40.918257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405a64f-8f27-4e99-9fc1-f94ac448eae1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:40.923193 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:40.923846 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:40.924131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:40.924408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] PATH_INFO: `/v3/users/3eaae78695b04f44b60fcae0a9b78004` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:40.925699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eaae78695b04f44b60fcae0a9b78004)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:40.927612 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:40.978833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eaae78695b04f44b60fcae0a9b78004'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:40.990657 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eaae78695b04f44b60fcae0a9b78004'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:40.991347 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eaae78695b04f44b60fcae0a9b78004'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:40.991947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eaae78695b04f44b60fcae0a9b78004'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:40.999109 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eaae78695b04f44b60fcae0a9b78004'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:41.013431 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1083/2128] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:40 2022] DELETE /identity/v3/users/3eaae78695b04f44b60fcae0a9b78004 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:41.018518 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5704d-24cd-4776-914a-38d9fe008f81 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:41.019008 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5704d-24cd-4776-914a-38d9fe008f81 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:41.019135 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5704d-24cd-4776-914a-38d9fe008f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:41.042945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ede5704d-24cd-4776-914a-38d9fe008f81 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:41.044154 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ede5704d-24cd-4776-914a-38d9fe008f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:41.090501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:41.107590 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1046/2129] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:41.117303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:41.119476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:41.176574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91631ddf-53ae-4bfd-bc76-368a5cbbd600 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:41.180178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac843af-3e83-4f0d-8bb5-47e3e254aced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:41.180839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac843af-3e83-4f0d-8bb5-47e3e254aced service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:41.181171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac843af-3e83-4f0d-8bb5-47e3e254aced service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:41.181447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac843af-3e83-4f0d-8bb5-47e3e254aced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:41.190883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac843af-3e83-4f0d-8bb5-47e3e254aced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:41.192403 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac843af-3e83-4f0d-8bb5-47e3e254aced service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:41.202309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1084/2130] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:41.642374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5704d-24cd-4776-914a-38d9fe008f81 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:41.643951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ede5704d-24cd-4776-914a-38d9fe008f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:41.674009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5704d-24cd-4776-914a-38d9fe008f81 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:41.679096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:41.679742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:41.680024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:41.680318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] PATH_INFO: `/v3/projects/a8ca7cd8bd1947e1b920d88d5214a275` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:41.682103 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ca7cd8bd1947e1b920d88d5214a275)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:41.684098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:41.738854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ca7cd8bd1947e1b920d88d5214a275', 'request_id': 'req-fa2072db-d628-4898-8d7e-cf75a9776efe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:41.748098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ca7cd8bd1947e1b920d88d5214a275', 'request_id': 'req-fa2072db-d628-4898-8d7e-cf75a9776efe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:41.757898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ca7cd8bd1947e1b920d88d5214a275', 'request_id': 'req-fa2072db-d628-4898-8d7e-cf75a9776efe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:41.771780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] The token cache is being invalidate because project a8ca7cd8bd1947e1b920d88d5214a275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:41.772100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:41.772920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:41.775657 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1047/2131] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:41 2022] DELETE /identity/v3/projects/a8ca7cd8bd1947e1b920d88d5214a275 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:41.780455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac843af-3e83-4f0d-8bb5-47e3e254aced service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:41.791816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac843af-3e83-4f0d-8bb5-47e3e254aced service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:41.837447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:41.881442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dcd2b-877d-477a-b90d-788202390007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:41.882107 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dcd2b-877d-477a-b90d-788202390007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:41.882695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dcd2b-877d-477a-b90d-788202390007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:41.883066 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dcd2b-877d-477a-b90d-788202390007 admin admin] PATH_INFO: `/v3/users/ea5662abcd9f406a9404ddf8adc2a6c1` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:41.885947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0dcd2b-877d-477a-b90d-788202390007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5662abcd9f406a9404ddf8adc2a6c1)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:41.888094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0dcd2b-877d-477a-b90d-788202390007 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:41.954966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ee0dcd2b-877d-477a-b90d-788202390007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5662abcd9f406a9404ddf8adc2a6c1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:41.970559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ee0dcd2b-877d-477a-b90d-788202390007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5662abcd9f406a9404ddf8adc2a6c1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:41.971434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ee0dcd2b-877d-477a-b90d-788202390007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5662abcd9f406a9404ddf8adc2a6c1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:41.981276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ee0dcd2b-877d-477a-b90d-788202390007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5662abcd9f406a9404ddf8adc2a6c1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:41.995333 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ee0dcd2b-877d-477a-b90d-788202390007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5662abcd9f406a9404ddf8adc2a6c1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:42.013543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1085/2132] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:41 2022] DELETE /identity/v3/users/ea5662abcd9f406a9404ddf8adc2a6c1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:42.392863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:42.394716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:42.408209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2072db-d628-4898-8d7e-cf75a9776efe admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:42.491536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:42.492559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:42.492843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:42.493176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b admin admin] PATH_INFO: `/v3/projects/fb00f3f6ff8a4203a810dad49b8b34f9` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:42.495131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb00f3f6ff8a4203a810dad49b8b34f9)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:42.497117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:42.563490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb00f3f6ff8a4203a810dad49b8b34f9', 'request_id': 'req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:42.569357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb00f3f6ff8a4203a810dad49b8b34f9', 'request_id': 'req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:42.578412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb00f3f6ff8a4203a810dad49b8b34f9', 'request_id': 'req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:42.590523 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b admin admin] The token cache is being invalidate because project fb00f3f6ff8a4203a810dad49b8b34f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:42.590893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:42.591625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2ea8c317-6eeb-4269-ba6a-fc2a3809524b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:42.596540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1048/2133] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:42 2022] DELETE /identity/v3/projects/fb00f3f6ff8a4203a810dad49b8b34f9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:42.602080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eb670-f360-491a-8ac8-492471639c9e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:42.602445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eb670-f360-491a-8ac8-492471639c9e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:42.602774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eb670-f360-491a-8ac8-492471639c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:42.626017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-112eb670-f360-491a-8ac8-492471639c9e None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:42.627297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-112eb670-f360-491a-8ac8-492471639c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:42.687722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1086/2134] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:42.695721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d81e6-50e4-448a-a2d4-ef5c4bc51880 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:42.696009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d81e6-50e4-448a-a2d4-ef5c4bc51880 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:42.696306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d81e6-50e4-448a-a2d4-ef5c4bc51880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:42.704664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:42.720100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4f5d81e6-50e4-448a-a2d4-ef5c4bc51880 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:42.721567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4f5d81e6-50e4-448a-a2d4-ef5c4bc51880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:42.730280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1049/2135] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:42.734569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eb670-f360-491a-8ac8-492471639c9e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:42.744737 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eb670-f360-491a-8ac8-492471639c9e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:42.749362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553a008-1d7b-4819-80d6-662c9621ab21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:42.749950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553a008-1d7b-4819-80d6-662c9621ab21 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:42.750235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553a008-1d7b-4819-80d6-662c9621ab21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:42.750581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553a008-1d7b-4819-80d6-662c9621ab21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:42.751339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553a008-1d7b-4819-80d6-662c9621ab21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:34:42.751664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553a008-1d7b-4819-80d6-662c9621ab21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:42.753265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553a008-1d7b-4819-80d6-662c9621ab21 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:42.766167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1087/2136] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:34:42.770404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d81e6-50e4-448a-a2d4-ef5c4bc51880 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:42.781292 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d81e6-50e4-448a-a2d4-ef5c4bc51880 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:42.786316 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c27e6a-3ad1-4f73-9a0a-1642f929ef3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:42.786922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c27e6a-3ad1-4f73-9a0a-1642f929ef3d admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:42.787205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c27e6a-3ad1-4f73-9a0a-1642f929ef3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:42.787480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c27e6a-3ad1-4f73-9a0a-1642f929ef3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:42.788144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c27e6a-3ad1-4f73-9a0a-1642f929ef3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:42.790078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c27e6a-3ad1-4f73-9a0a-1642f929ef3d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:42.818748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1050/2137] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:42 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:42.823478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553a008-1d7b-4819-80d6-662c9621ab21 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:42.833636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553a008-1d7b-4819-80d6-662c9621ab21 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:42.868092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:42.902498 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa9f19-1170-43d6-9ab0-8c911ae0335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:42.903218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa9f19-1170-43d6-9ab0-8c911ae0335b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:42.903611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa9f19-1170-43d6-9ab0-8c911ae0335b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:42.904026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa9f19-1170-43d6-9ab0-8c911ae0335b admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:42.904827 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa9f19-1170-43d6-9ab0-8c911ae0335b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:42.907368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa9f19-1170-43d6-9ab0-8c911ae0335b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:42.935445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1088/2138] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:42 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:42.936640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c27e6a-3ad1-4f73-9a0a-1642f929ef3d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:42.952242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c27e6a-3ad1-4f73-9a0a-1642f929ef3d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:42.958991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678019b-c930-4c93-a1fc-1bf40db070dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:42.960084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678019b-c930-4c93-a1fc-1bf40db070dd admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:42.960414 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678019b-c930-4c93-a1fc-1bf40db070dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:42.960761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678019b-c930-4c93-a1fc-1bf40db070dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:42.961680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678019b-c930-4c93-a1fc-1bf40db070dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:42.966411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678019b-c930-4c93-a1fc-1bf40db070dd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:42.990520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1051/2139] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:42.991800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa9f19-1170-43d6-9ab0-8c911ae0335b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:43.008624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa9f19-1170-43d6-9ab0-8c911ae0335b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:43.016197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32009ac4-03ae-4538-b804-24ffefbfc1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:43.017461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32009ac4-03ae-4538-b804-24ffefbfc1fe admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:43.017838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32009ac4-03ae-4538-b804-24ffefbfc1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:43.018460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32009ac4-03ae-4538-b804-24ffefbfc1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:43.019289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32009ac4-03ae-4538-b804-24ffefbfc1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:43.022298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32009ac4-03ae-4538-b804-24ffefbfc1fe admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:43.035448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1089/2140] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:43.047819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678019b-c930-4c93-a1fc-1bf40db070dd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:43.071176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678019b-c930-4c93-a1fc-1bf40db070dd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:43.080768 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda792d1-764c-47f8-9db4-84b59b90394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:43.081845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda792d1-764c-47f8-9db4-84b59b90394f admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:43.082217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda792d1-764c-47f8-9db4-84b59b90394f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:43.082568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda792d1-764c-47f8-9db4-84b59b90394f admin admin] PATH_INFO: `/v3/projects/bc3a73b8a8794873b68c65d81563ee65/users/d3c4ee9e5d744c62a3f958067e7b035f/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:43.116999 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda792d1-764c-47f8-9db4-84b59b90394f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3a73b8a8794873b68c65d81563ee65, user_id=d3c4ee9e5d744c62a3f958067e7b035f, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:43.121401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda792d1-764c-47f8-9db4-84b59b90394f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:43.154733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1052/2141] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:43 2022] PUT /identity/v3/projects/bc3a73b8a8794873b68c65d81563ee65/users/d3c4ee9e5d744c62a3f958067e7b035f/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:43.165929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d938b6c-96d7-439b-ac43-4993cc707bc6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:43.166260 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d938b6c-96d7-439b-ac43-4993cc707bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:43.166512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d938b6c-96d7-439b-ac43-4993cc707bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:43.207708 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4d938b6c-96d7-439b-ac43-4993cc707bc6 None None] MFA Rules not processed for user `d3c4ee9e5d744c62a3f958067e7b035f`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:43.209836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4d938b6c-96d7-439b-ac43-4993cc707bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:43.293516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1090/2142] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:43.305696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda792d1-764c-47f8-9db4-84b59b90394f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:43.308920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fda792d1-764c-47f8-9db4-84b59b90394f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:43.398387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda792d1-764c-47f8-9db4-84b59b90394f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:43.403381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c666aa3-c28f-4737-b2c5-a3870d79d1fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:43.404162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666aa3-c28f-4737-b2c5-a3870d79d1fe service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:43.404453 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666aa3-c28f-4737-b2c5-a3870d79d1fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:43.404734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666aa3-c28f-4737-b2c5-a3870d79d1fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:43.417482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c666aa3-c28f-4737-b2c5-a3870d79d1fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:43.419027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c666aa3-c28f-4737-b2c5-a3870d79d1fe service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:43.429190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1053/2143] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:47.562143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d938b6c-96d7-439b-ac43-4993cc707bc6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:47.624153 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d938b6c-96d7-439b-ac43-4993cc707bc6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:47.628674 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:47.629376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:47.629681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:47.629952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] PATH_INFO: `/v3/users/d3c4ee9e5d744c62a3f958067e7b035f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:47.631106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c4ee9e5d744c62a3f958067e7b035f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:47.633247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:47.677381 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:47.679005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c4ee9e5d744c62a3f958067e7b035f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:47.692977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c4ee9e5d744c62a3f958067e7b035f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:47.693640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c4ee9e5d744c62a3f958067e7b035f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:47.694239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c4ee9e5d744c62a3f958067e7b035f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:47.702644 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c4ee9e5d744c62a3f958067e7b035f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:47.715288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1091/2144] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:47 2022] DELETE /identity/v3/users/d3c4ee9e5d744c62a3f958067e7b035f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:47.720008 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb486c3-effa-4db1-bb17-a6a76b588404 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:47.720524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb486c3-effa-4db1-bb17-a6a76b588404 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:47.720618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb486c3-effa-4db1-bb17-a6a76b588404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:47.739551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-afb486c3-effa-4db1-bb17-a6a76b588404 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:47.740795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-afb486c3-effa-4db1-bb17-a6a76b588404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:47.799541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1054/2145] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:47.809828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:47.811231 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:47.868214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846ba57-1469-4a95-be5a-972164b30f92 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:47.872560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04daa4-f870-40ae-8644-6c706963bfc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:47.873207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04daa4-f870-40ae-8644-6c706963bfc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:47.873494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04daa4-f870-40ae-8644-6c706963bfc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:47.873772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04daa4-f870-40ae-8644-6c706963bfc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:47.882802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04daa4-f870-40ae-8644-6c706963bfc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:47.884168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04daa4-f870-40ae-8644-6c706963bfc9 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:47.893809 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1092/2146] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:48.182593 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb486c3-effa-4db1-bb17-a6a76b588404 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:48.185369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-afb486c3-effa-4db1-bb17-a6a76b588404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:48.200316 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb486c3-effa-4db1-bb17-a6a76b588404 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:48.210948 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b935375-32f1-4ef0-9e75-0f072888ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:48.211559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b935375-32f1-4ef0-9e75-0f072888ba43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:48.211969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b935375-32f1-4ef0-9e75-0f072888ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:48.212255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b935375-32f1-4ef0-9e75-0f072888ba43 admin admin] PATH_INFO: `/v3/projects/bc3a73b8a8794873b68c65d81563ee65` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:48.214197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b935375-32f1-4ef0-9e75-0f072888ba43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3a73b8a8794873b68c65d81563ee65)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:48.216652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b935375-32f1-4ef0-9e75-0f072888ba43 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:48.268042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:48.283600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5b935375-32f1-4ef0-9e75-0f072888ba43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3a73b8a8794873b68c65d81563ee65', 'request_id': 'req-5b935375-32f1-4ef0-9e75-0f072888ba43'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:48.293147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5b935375-32f1-4ef0-9e75-0f072888ba43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3a73b8a8794873b68c65d81563ee65', 'request_id': 'req-5b935375-32f1-4ef0-9e75-0f072888ba43'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:48.301868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5b935375-32f1-4ef0-9e75-0f072888ba43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3a73b8a8794873b68c65d81563ee65', 'request_id': 'req-5b935375-32f1-4ef0-9e75-0f072888ba43'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:48.323978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5b935375-32f1-4ef0-9e75-0f072888ba43 admin admin] The token cache is being invalidate because project bc3a73b8a8794873b68c65d81563ee65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:48.324414 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5b935375-32f1-4ef0-9e75-0f072888ba43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:48.325190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5b935375-32f1-4ef0-9e75-0f072888ba43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:48.326932 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1055/2147] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:48 2022] DELETE /identity/v3/projects/bc3a73b8a8794873b68c65d81563ee65 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:48.331847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4950f-27a4-412f-8ce6-2f6c96a70d1a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:48.332252 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4950f-27a4-412f-8ce6-2f6c96a70d1a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:48.332603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4950f-27a4-412f-8ce6-2f6c96a70d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:48.355185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-44e4950f-27a4-412f-8ce6-2f6c96a70d1a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:48.356822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-44e4950f-27a4-412f-8ce6-2f6c96a70d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:48.446368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1093/2148] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:48.455141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c17ae-0ab8-4fd9-a4fd-c3c731138a2c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:48.455843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c17ae-0ab8-4fd9-a4fd-c3c731138a2c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:48.456294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c17ae-0ab8-4fd9-a4fd-c3c731138a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:48.480241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b61c17ae-0ab8-4fd9-a4fd-c3c731138a2c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:48.481881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b61c17ae-0ab8-4fd9-a4fd-c3c731138a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:48.490701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1056/2149] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:48.495489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4950f-27a4-412f-8ce6-2f6c96a70d1a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:48.508073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4950f-27a4-412f-8ce6-2f6c96a70d1a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:48.513971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99776c04-ccb7-4c18-9721-257632dde5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:48.514622 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99776c04-ccb7-4c18-9721-257632dde5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:48.514914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99776c04-ccb7-4c18-9721-257632dde5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:48.515189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99776c04-ccb7-4c18-9721-257632dde5d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:48.515921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99776c04-ccb7-4c18-9721-257632dde5d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:34:48.516230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99776c04-ccb7-4c18-9721-257632dde5d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:48.517881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99776c04-ccb7-4c18-9721-257632dde5d7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:48.539733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1094/2150] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:34:48.539824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c17ae-0ab8-4fd9-a4fd-c3c731138a2c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:48.546068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c17ae-0ab8-4fd9-a4fd-c3c731138a2c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:48.550712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec776210-6736-4751-8a06-0f9d552c4cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:48.551321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec776210-6736-4751-8a06-0f9d552c4cfe admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:48.551603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec776210-6736-4751-8a06-0f9d552c4cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:48.551876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec776210-6736-4751-8a06-0f9d552c4cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:48.552547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec776210-6736-4751-8a06-0f9d552c4cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:48.554470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec776210-6736-4751-8a06-0f9d552c4cfe admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:48.582536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1057/2151] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:48 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:48.586995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99776c04-ccb7-4c18-9721-257632dde5d7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:48.599975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99776c04-ccb7-4c18-9721-257632dde5d7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:48.650042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:48.662128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff5a1e-aacb-468d-b5c9-169d858399b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:48.663012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff5a1e-aacb-468d-b5c9-169d858399b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:48.663306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff5a1e-aacb-468d-b5c9-169d858399b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:48.663811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff5a1e-aacb-468d-b5c9-169d858399b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:48.664707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff5a1e-aacb-468d-b5c9-169d858399b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:48.667513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff5a1e-aacb-468d-b5c9-169d858399b6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:48.688158 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1095/2152] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:48 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:48.692624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec776210-6736-4751-8a06-0f9d552c4cfe admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:48.703912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec776210-6736-4751-8a06-0f9d552c4cfe admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:48.708542 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a06c58-5098-45f6-8161-5d657e1b8b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:48.709175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06c58-5098-45f6-8161-5d657e1b8b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:48.709462 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06c58-5098-45f6-8161-5d657e1b8b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:48.709805 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06c58-5098-45f6-8161-5d657e1b8b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:48.710503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a06c58-5098-45f6-8161-5d657e1b8b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:48.712204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a06c58-5098-45f6-8161-5d657e1b8b50 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:48.722377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1058/2153] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:48.726544 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff5a1e-aacb-468d-b5c9-169d858399b6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:48.738131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff5a1e-aacb-468d-b5c9-169d858399b6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:48.742793 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c66bdc-66dd-4979-a055-caafd752686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:48.743430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c66bdc-66dd-4979-a055-caafd752686f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:48.744308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c66bdc-66dd-4979-a055-caafd752686f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:48.744580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c66bdc-66dd-4979-a055-caafd752686f admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:48.745349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c66bdc-66dd-4979-a055-caafd752686f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:48.746942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c66bdc-66dd-4979-a055-caafd752686f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:48.758645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1096/2154] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:48.763180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a06c58-5098-45f6-8161-5d657e1b8b50 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:48.773928 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a06c58-5098-45f6-8161-5d657e1b8b50 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:48.779095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f76dc6-aa6c-4528-a50c-18888570d2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:48.779784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f76dc6-aa6c-4528-a50c-18888570d2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:48.780068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f76dc6-aa6c-4528-a50c-18888570d2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:48.780346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f76dc6-aa6c-4528-a50c-18888570d2d3 admin admin] PATH_INFO: `/v3/projects/d92b4a4d50c4464891afe0119cb03cdc/users/aa2ea924ecf44adba4f45dea5f6a8dc1/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:48.795557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f76dc6-aa6c-4528-a50c-18888570d2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92b4a4d50c4464891afe0119cb03cdc, user_id=aa2ea924ecf44adba4f45dea5f6a8dc1, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:48.798255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f76dc6-aa6c-4528-a50c-18888570d2d3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:48.813204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1059/2155] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:48 2022] PUT /identity/v3/projects/d92b4a4d50c4464891afe0119cb03cdc/users/aa2ea924ecf44adba4f45dea5f6a8dc1/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:48.823521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987502ca-16e6-4004-b547-944f920137cf None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:48.823809 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987502ca-16e6-4004-b547-944f920137cf None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:48.824080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987502ca-16e6-4004-b547-944f920137cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:48.852374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-987502ca-16e6-4004-b547-944f920137cf None None] MFA Rules not processed for user `aa2ea924ecf44adba4f45dea5f6a8dc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:48.854143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-987502ca-16e6-4004-b547-944f920137cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:48.926125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1097/2156] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:48.927565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f76dc6-aa6c-4528-a50c-18888570d2d3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:48.991010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f76dc6-aa6c-4528-a50c-18888570d2d3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:48.996204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5e32e-1782-45be-8da8-fe9a899df7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:48.996816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5e32e-1782-45be-8da8-fe9a899df7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:48.997131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5e32e-1782-45be-8da8-fe9a899df7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:48.997410 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5e32e-1782-45be-8da8-fe9a899df7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:48.998080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5e32e-1782-45be-8da8-fe9a899df7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:48.999967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5e32e-1782-45be-8da8-fe9a899df7c7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:49.029432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1060/2157] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:48 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:49.033669 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987502ca-16e6-4004-b547-944f920137cf None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:49.046174 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987502ca-16e6-4004-b547-944f920137cf None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:49.108793 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5022899-924b-4f4d-874a-cb6114930442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:49.109440 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5022899-924b-4f4d-874a-cb6114930442 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:49.109748 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5022899-924b-4f4d-874a-cb6114930442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:49.110021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5022899-924b-4f4d-874a-cb6114930442 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:49.110695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5022899-924b-4f4d-874a-cb6114930442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:49.112668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5022899-924b-4f4d-874a-cb6114930442 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:49.135388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1098/2158] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:49 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:49.139825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5e32e-1782-45be-8da8-fe9a899df7c7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:49.151062 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5e32e-1782-45be-8da8-fe9a899df7c7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:49.155630 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ae69-f1f4-4033-a0e9-292463c7930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:49.156233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ae69-f1f4-4033-a0e9-292463c7930b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:49.156511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ae69-f1f4-4033-a0e9-292463c7930b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:49.156779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ae69-f1f4-4033-a0e9-292463c7930b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:49.157499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6ae69-f1f4-4033-a0e9-292463c7930b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:49.159071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6ae69-f1f4-4033-a0e9-292463c7930b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:49.170684 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1061/2159] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:49.174516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5022899-924b-4f4d-874a-cb6114930442 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:49.184591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5022899-924b-4f4d-874a-cb6114930442 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:49.189065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ef69-e951-45f8-ae53-35a91a7cb23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:49.189714 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ef69-e951-45f8-ae53-35a91a7cb23c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:49.189997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ef69-e951-45f8-ae53-35a91a7cb23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:49.190269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ef69-e951-45f8-ae53-35a91a7cb23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:49.190989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242ef69-e951-45f8-ae53-35a91a7cb23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:49.192569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242ef69-e951-45f8-ae53-35a91a7cb23c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:49.203162 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1099/2160] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:49.207442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ae69-f1f4-4033-a0e9-292463c7930b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:49.218219 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ae69-f1f4-4033-a0e9-292463c7930b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:49.222948 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e147425-dc4a-409a-b234-69ef0066590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:49.223615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e147425-dc4a-409a-b234-69ef0066590e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:49.223900 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e147425-dc4a-409a-b234-69ef0066590e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:49.224180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e147425-dc4a-409a-b234-69ef0066590e admin admin] PATH_INFO: `/v3/projects/0297213961b54d83badf68b7cb0f7630/users/24b301f1230a42c7bf2b4e8af2e34a98/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:49.239320 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e147425-dc4a-409a-b234-69ef0066590e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0297213961b54d83badf68b7cb0f7630, user_id=24b301f1230a42c7bf2b4e8af2e34a98, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:49.242011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e147425-dc4a-409a-b234-69ef0066590e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:49.255525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1062/2161] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:49 2022] PUT /identity/v3/projects/0297213961b54d83badf68b7cb0f7630/users/24b301f1230a42c7bf2b4e8af2e34a98/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:49.267556 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35440f59-2e07-41c3-8812-edc53a0fb388 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:49.267849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35440f59-2e07-41c3-8812-edc53a0fb388 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:49.268125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35440f59-2e07-41c3-8812-edc53a0fb388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:49.295511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-35440f59-2e07-41c3-8812-edc53a0fb388 None None] MFA Rules not processed for user `24b301f1230a42c7bf2b4e8af2e34a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:49.296725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-35440f59-2e07-41c3-8812-edc53a0fb388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:49.325754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:49.363516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1100/2162] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:49.368286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e147425-dc4a-409a-b234-69ef0066590e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:49.381630 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:49.438046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e147425-dc4a-409a-b234-69ef0066590e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:49.442777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3955c-5995-440e-943a-408357a3f57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:49.443400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3955c-5995-440e-943a-408357a3f57c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:49.443980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3955c-5995-440e-943a-408357a3f57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:49.443980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3955c-5995-440e-943a-408357a3f57c admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:49.444623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3955c-5995-440e-943a-408357a3f57c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:49.446558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3955c-5995-440e-943a-408357a3f57c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:49.479746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1063/2163] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:49 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:49.480799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35440f59-2e07-41c3-8812-edc53a0fb388 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:49.501658 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35440f59-2e07-41c3-8812-edc53a0fb388 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:49.568314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ae385-34d3-4e42-848a-cd384be555fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:49.569126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ae385-34d3-4e42-848a-cd384be555fe admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:49.569526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ae385-34d3-4e42-848a-cd384be555fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:49.570541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ae385-34d3-4e42-848a-cd384be555fe admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:49.570678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ae385-34d3-4e42-848a-cd384be555fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:49.574912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ae385-34d3-4e42-848a-cd384be555fe admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:49.602875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1101/2164] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:49 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:49.607061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3955c-5995-440e-943a-408357a3f57c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:49.628524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3955c-5995-440e-943a-408357a3f57c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:49.633649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547bb59-8d16-4fc9-9c5a-819d8049e809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:49.635365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547bb59-8d16-4fc9-9c5a-819d8049e809 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:49.635666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547bb59-8d16-4fc9-9c5a-819d8049e809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:49.636098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547bb59-8d16-4fc9-9c5a-819d8049e809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:49.636879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547bb59-8d16-4fc9-9c5a-819d8049e809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:49.638609 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547bb59-8d16-4fc9-9c5a-819d8049e809 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:49.654987 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1064/2165] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:34:49.660240 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ae385-34d3-4e42-848a-cd384be555fe admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:49.675808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ae385-34d3-4e42-848a-cd384be555fe admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:49.683459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18c090-9b51-49bc-a0dd-19c4ae1079b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:49.684233 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18c090-9b51-49bc-a0dd-19c4ae1079b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:49.684526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18c090-9b51-49bc-a0dd-19c4ae1079b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:49.684806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18c090-9b51-49bc-a0dd-19c4ae1079b4 admin admin] PATH_INFO: `/v3/projects/82e87745d71f4bcd80c90f444d75984f/users/e977f82a5c6346f7bd8e7cbed48abd7a/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:49.702357 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18c090-9b51-49bc-a0dd-19c4ae1079b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e87745d71f4bcd80c90f444d75984f, user_id=e977f82a5c6346f7bd8e7cbed48abd7a, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:49.705666 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18c090-9b51-49bc-a0dd-19c4ae1079b4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:49.725564 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1102/2166] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:49 2022] PUT /identity/v3/projects/82e87745d71f4bcd80c90f444d75984f/users/e977f82a5c6346f7bd8e7cbed48abd7a/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:49.730174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547bb59-8d16-4fc9-9c5a-819d8049e809 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:49.741908 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547bb59-8d16-4fc9-9c5a-819d8049e809 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:49.853144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3454874-2936-49fa-aa40-2252bd29607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:49.854218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3454874-2936-49fa-aa40-2252bd29607a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:49.854716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3454874-2936-49fa-aa40-2252bd29607a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:49.855171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3454874-2936-49fa-aa40-2252bd29607a admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:49.856379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3454874-2936-49fa-aa40-2252bd29607a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:49.858409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3454874-2936-49fa-aa40-2252bd29607a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:49.885943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1065/2167] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:49.890034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18c090-9b51-49bc-a0dd-19c4ae1079b4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:49.902880 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18c090-9b51-49bc-a0dd-19c4ae1079b4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:49.909411 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f054c7e-c16e-4c5d-912e-8954f39f4bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:49.910116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f054c7e-c16e-4c5d-912e-8954f39f4bea admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:49.910401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f054c7e-c16e-4c5d-912e-8954f39f4bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:49.910682 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f054c7e-c16e-4c5d-912e-8954f39f4bea admin admin] PATH_INFO: `/v3/projects/82e87745d71f4bcd80c90f444d75984f/users/e977f82a5c6346f7bd8e7cbed48abd7a/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:49.912685 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f054c7e-c16e-4c5d-912e-8954f39f4bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e87745d71f4bcd80c90f444d75984f, user_id=e977f82a5c6346f7bd8e7cbed48abd7a, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:49.915605 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f054c7e-c16e-4c5d-912e-8954f39f4bea admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:49.927173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1103/2168] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:49 2022] PUT /identity/v3/projects/82e87745d71f4bcd80c90f444d75984f/users/e977f82a5c6346f7bd8e7cbed48abd7a/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:49.938916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7944d0-5197-47de-b95c-3253a43a33a9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:49.939200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7944d0-5197-47de-b95c-3253a43a33a9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:49.939476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7944d0-5197-47de-b95c-3253a43a33a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:49.968850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ff7944d0-5197-47de-b95c-3253a43a33a9 None None] MFA Rules not processed for user `e977f82a5c6346f7bd8e7cbed48abd7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:49.970040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ff7944d0-5197-47de-b95c-3253a43a33a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:50.047862 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1066/2169] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:50.060513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f054c7e-c16e-4c5d-912e-8954f39f4bea admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:50.062339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1f054c7e-c16e-4c5d-912e-8954f39f4bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:50.122519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f054c7e-c16e-4c5d-912e-8954f39f4bea admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:50.126421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc48e2-cb44-4096-a8cc-e3acfa143ba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:50.127047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc48e2-cb44-4096-a8cc-e3acfa143ba3 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:50.127333 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc48e2-cb44-4096-a8cc-e3acfa143ba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:50.127606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc48e2-cb44-4096-a8cc-e3acfa143ba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:50.168938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:50.194308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc48e2-cb44-4096-a8cc-e3acfa143ba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:50.195756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc48e2-cb44-4096-a8cc-e3acfa143ba3 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:50.205769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1104/2170] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:50.903958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c31c75-8fc6-468b-8088-ab69ebd826fb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:50.904325 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c31c75-8fc6-468b-8088-ab69ebd826fb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:50.904402 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c31c75-8fc6-468b-8088-ab69ebd826fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:50.917821 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:50.924023 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b5c31c75-8fc6-468b-8088-ab69ebd826fb None None] MFA Rules not processed for user `02a1682847df4bd99bf09c8216a44850`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:50.926716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b5c31c75-8fc6-468b-8088-ab69ebd826fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:50.985461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1067/2171] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:51.803144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc48e2-cb44-4096-a8cc-e3acfa143ba3 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:51.813447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc48e2-cb44-4096-a8cc-e3acfa143ba3 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:51.822957 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f809a1-330d-4f03-bf7f-d65b5f8e63ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:51.823620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f809a1-330d-4f03-bf7f-d65b5f8e63ec service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:51.823885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f809a1-330d-4f03-bf7f-d65b5f8e63ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:51.824151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f809a1-330d-4f03-bf7f-d65b5f8e63ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:51.902922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f809a1-330d-4f03-bf7f-d65b5f8e63ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:51.904604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c31c75-8fc6-468b-8088-ab69ebd826fb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:51.905096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f809a1-330d-4f03-bf7f-d65b5f8e63ec service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:51.906248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b5c31c75-8fc6-468b-8088-ab69ebd826fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:51.916559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1105/2172] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:51.991624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c31c75-8fc6-468b-8088-ab69ebd826fb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:52.001165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:52.002277 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:52.002917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:52.003518 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] PATH_INFO: `/v3/users/5267239ceb854233b8b412c776b198fe` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:52.005334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5267239ceb854233b8b412c776b198fe)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:52.007782 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:52.077696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5267239ceb854233b8b412c776b198fe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:52.086681 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5267239ceb854233b8b412c776b198fe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:52.100006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5267239ceb854233b8b412c776b198fe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:52.100752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5267239ceb854233b8b412c776b198fe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:52.101586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5267239ceb854233b8b412c776b198fe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:52.119747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1068/2173] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:51 2022] DELETE /identity/v3/users/5267239ceb854233b8b412c776b198fe => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:52.124169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78e196-d10d-4049-b608-54288c48114d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:52.124468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78e196-d10d-4049-b608-54288c48114d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:52.124750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78e196-d10d-4049-b608-54288c48114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:52.163062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3e78e196-d10d-4049-b608-54288c48114d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:52.164303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3e78e196-d10d-4049-b608-54288c48114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:52.281218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1106/2174] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:34:52.291816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:52.293629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:52.360333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:52.408337 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d42621-475a-4a4a-9f15-179c9de07248 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:52.412357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e040fb-f5ff-4fcf-8463-f96ce00c466e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:52.413279 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e040fb-f5ff-4fcf-8463-f96ce00c466e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:52.413737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e040fb-f5ff-4fcf-8463-f96ce00c466e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:52.414405 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e040fb-f5ff-4fcf-8463-f96ce00c466e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:52.429557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e040fb-f5ff-4fcf-8463-f96ce00c466e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:52.432934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e040fb-f5ff-4fcf-8463-f96ce00c466e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:52.469485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1069/2175] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:52.669064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78e196-d10d-4049-b608-54288c48114d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:52.670604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3e78e196-d10d-4049-b608-54288c48114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:52.737049 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78e196-d10d-4049-b608-54288c48114d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:52.741678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96229357-15a6-4218-83c9-3deb439c476d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:52.742323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96229357-15a6-4218-83c9-3deb439c476d service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:52.742608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96229357-15a6-4218-83c9-3deb439c476d service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:52.742883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96229357-15a6-4218-83c9-3deb439c476d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:52.745476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-96229357-15a6-4218-83c9-3deb439c476d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:52.778807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:52.815411 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96229357-15a6-4218-83c9-3deb439c476d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:52.816897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96229357-15a6-4218-83c9-3deb439c476d service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:52.828374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1107/2176] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:52.846701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e040fb-f5ff-4fcf-8463-f96ce00c466e service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:52.849020 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-08e040fb-f5ff-4fcf-8463-f96ce00c466e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:52.866898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e040fb-f5ff-4fcf-8463-f96ce00c466e service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:52.874610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e64da-9309-40fe-92fc-bdd04d161f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:52.875478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e64da-9309-40fe-92fc-bdd04d161f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:52.875669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e64da-9309-40fe-92fc-bdd04d161f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:52.875949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e64da-9309-40fe-92fc-bdd04d161f6d admin admin] PATH_INFO: `/v3/projects/a9b3e9cd863b490e95dee19f678dde76` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:52.877314 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e64da-9309-40fe-92fc-bdd04d161f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b3e9cd863b490e95dee19f678dde76)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:52.880040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e64da-9309-40fe-92fc-bdd04d161f6d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:52.942229 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f66e64da-9309-40fe-92fc-bdd04d161f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b3e9cd863b490e95dee19f678dde76', 'request_id': 'req-f66e64da-9309-40fe-92fc-bdd04d161f6d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:52.949129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f66e64da-9309-40fe-92fc-bdd04d161f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b3e9cd863b490e95dee19f678dde76', 'request_id': 'req-f66e64da-9309-40fe-92fc-bdd04d161f6d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:52.957725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f66e64da-9309-40fe-92fc-bdd04d161f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b3e9cd863b490e95dee19f678dde76', 'request_id': 'req-f66e64da-9309-40fe-92fc-bdd04d161f6d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:52.969593 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f66e64da-9309-40fe-92fc-bdd04d161f6d admin admin] The token cache is being invalidate because project a9b3e9cd863b490e95dee19f678dde76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:52.969882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f66e64da-9309-40fe-92fc-bdd04d161f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:52.970503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f66e64da-9309-40fe-92fc-bdd04d161f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:52.971982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1070/2177] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:52 2022] DELETE /identity/v3/projects/a9b3e9cd863b490e95dee19f678dde76 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:52.977258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd018395-1061-45ee-9f19-4b3ad2a95524 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:52.977578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd018395-1061-45ee-9f19-4b3ad2a95524 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:52.978615 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd018395-1061-45ee-9f19-4b3ad2a95524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:53.000706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-cd018395-1061-45ee-9f19-4b3ad2a95524 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:53.001973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cd018395-1061-45ee-9f19-4b3ad2a95524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:53.079209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1108/2178] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:53.087077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b40b7-7211-4207-a35c-f2d26a1907c5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:53.087869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b40b7-7211-4207-a35c-f2d26a1907c5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:53.088167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b40b7-7211-4207-a35c-f2d26a1907c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:53.109449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a95b40b7-7211-4207-a35c-f2d26a1907c5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:53.110427 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a95b40b7-7211-4207-a35c-f2d26a1907c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:53.119403 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1071/2179] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:53.124199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd018395-1061-45ee-9f19-4b3ad2a95524 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:53.136269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd018395-1061-45ee-9f19-4b3ad2a95524 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:53.141309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74103ef2-36d4-4b9e-8372-e38357f0e34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:53.141975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74103ef2-36d4-4b9e-8372-e38357f0e34f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:53.142288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74103ef2-36d4-4b9e-8372-e38357f0e34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:53.142770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74103ef2-36d4-4b9e-8372-e38357f0e34f admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:53.143563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74103ef2-36d4-4b9e-8372-e38357f0e34f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:34:53.144227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74103ef2-36d4-4b9e-8372-e38357f0e34f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:53.145925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74103ef2-36d4-4b9e-8372-e38357f0e34f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:53.161432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1109/2180] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:34:53.166819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b40b7-7211-4207-a35c-f2d26a1907c5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:53.176340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b40b7-7211-4207-a35c-f2d26a1907c5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:53.182465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f66352-11e7-40ee-ab8d-a032b452e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:53.185709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f66352-11e7-40ee-ab8d-a032b452e0ac admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:53.185709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f66352-11e7-40ee-ab8d-a032b452e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:53.185709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f66352-11e7-40ee-ab8d-a032b452e0ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:53.185709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f66352-11e7-40ee-ab8d-a032b452e0ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:53.186984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f66352-11e7-40ee-ab8d-a032b452e0ac admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:53.216568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1072/2181] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:34:53 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:34:53.220787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74103ef2-36d4-4b9e-8372-e38357f0e34f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:53.231887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74103ef2-36d4-4b9e-8372-e38357f0e34f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:53.291930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155acd1b-3c93-464e-996d-3bd88de8b4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:53.292542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155acd1b-3c93-464e-996d-3bd88de8b4ae admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:53.292829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155acd1b-3c93-464e-996d-3bd88de8b4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:53.293137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155acd1b-3c93-464e-996d-3bd88de8b4ae admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:53.293818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155acd1b-3c93-464e-996d-3bd88de8b4ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:53.295731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155acd1b-3c93-464e-996d-3bd88de8b4ae admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:53.319096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1110/2182] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:34:53 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:34:53.323756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f66352-11e7-40ee-ab8d-a032b452e0ac admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:53.334362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f66352-11e7-40ee-ab8d-a032b452e0ac admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:53.340030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d617a-baee-4680-a246-966b627f94b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:53.340840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d617a-baee-4680-a246-966b627f94b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:53.341161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d617a-baee-4680-a246-966b627f94b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:53.341435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d617a-baee-4680-a246-966b627f94b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:53.342153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d617a-baee-4680-a246-966b627f94b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:53.343727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d617a-baee-4680-a246-966b627f94b9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:53.353957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1073/2183] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:34:53.357866 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155acd1b-3c93-464e-996d-3bd88de8b4ae admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:53.372279 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155acd1b-3c93-464e-996d-3bd88de8b4ae admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:53.377563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077ba5b-e434-4c01-9452-6f36e4ad65c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:53.378286 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077ba5b-e434-4c01-9452-6f36e4ad65c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:53.378636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077ba5b-e434-4c01-9452-6f36e4ad65c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:53.379002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077ba5b-e434-4c01-9452-6f36e4ad65c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:53.379815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077ba5b-e434-4c01-9452-6f36e4ad65c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:53.381507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077ba5b-e434-4c01-9452-6f36e4ad65c3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:53.394156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1111/2184] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:34:53.398541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d617a-baee-4680-a246-966b627f94b9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:53.409873 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d617a-baee-4680-a246-966b627f94b9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:53.414551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728f16-6000-4bf1-b9ca-e72ecde28a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:53.415490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728f16-6000-4bf1-b9ca-e72ecde28a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:53.415976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728f16-6000-4bf1-b9ca-e72ecde28a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:53.416411 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728f16-6000-4bf1-b9ca-e72ecde28a4b admin admin] PATH_INFO: `/v3/projects/63772a4388364e08a840bc3f7623c285/users/b6f470697bb34f29866b5f0e78388f87/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:53.432565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad728f16-6000-4bf1-b9ca-e72ecde28a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63772a4388364e08a840bc3f7623c285, user_id=b6f470697bb34f29866b5f0e78388f87, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:53.435267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad728f16-6000-4bf1-b9ca-e72ecde28a4b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:53.450228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1074/2185] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:34:53 2022] PUT /identity/v3/projects/63772a4388364e08a840bc3f7623c285/users/b6f470697bb34f29866b5f0e78388f87/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:53.460437 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe510a4-ed8a-434c-b381-b3df178704e8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:53.460727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe510a4-ed8a-434c-b381-b3df178704e8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:53.461026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe510a4-ed8a-434c-b381-b3df178704e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:53.491024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5fe510a4-ed8a-434c-b381-b3df178704e8 None None] MFA Rules not processed for user `b6f470697bb34f29866b5f0e78388f87`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:53.492314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5fe510a4-ed8a-434c-b381-b3df178704e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:53.515416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:53.583087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1112/2186] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:53.595524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728f16-6000-4bf1-b9ca-e72ecde28a4b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:53.599157 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ad728f16-6000-4bf1-b9ca-e72ecde28a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:53.670573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728f16-6000-4bf1-b9ca-e72ecde28a4b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:53.675303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451da906-947e-448d-9d6a-135bee861138 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da39170a654d4d52a39b4b2c8cfd8906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:53.675938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da906-947e-448d-9d6a-135bee861138 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:53.676225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da906-947e-448d-9d6a-135bee861138 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:53.676502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da906-947e-448d-9d6a-135bee861138 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:53.684760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:53.687541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451da906-947e-448d-9d6a-135bee861138 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:53.689510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451da906-947e-448d-9d6a-135bee861138 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:53.702610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1075/2187] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:57.955708 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe510a4-ed8a-434c-b381-b3df178704e8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:57.957155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5fe510a4-ed8a-434c-b381-b3df178704e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:58.031258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe510a4-ed8a-434c-b381-b3df178704e8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:58.036934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:58.037603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:58.038062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:58.038274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] PATH_INFO: `/v3/users/aa2ea924ecf44adba4f45dea5f6a8dc1` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:58.039712 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2ea924ecf44adba4f45dea5f6a8dc1)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:58.042636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:58.097186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2ea924ecf44adba4f45dea5f6a8dc1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.109634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2ea924ecf44adba4f45dea5f6a8dc1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.110608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2ea924ecf44adba4f45dea5f6a8dc1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.111288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2ea924ecf44adba4f45dea5f6a8dc1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.119148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2ea924ecf44adba4f45dea5f6a8dc1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.136542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1113/2188] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:57 2022] DELETE /identity/v3/users/aa2ea924ecf44adba4f45dea5f6a8dc1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:58.141367 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab3e55-ec55-44a1-953a-b016449c1afd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:58.141870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab3e55-ec55-44a1-953a-b016449c1afd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:58.141972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab3e55-ec55-44a1-953a-b016449c1afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:58.161296 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-89ab3e55-ec55-44a1-953a-b016449c1afd None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:58.162590 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-89ab3e55-ec55-44a1-953a-b016449c1afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:58.224694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1076/2189] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:58.234694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:58.236366 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:58.281713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:58.296997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f8fa3-527a-4f8d-a6b6-ecba2c40312d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:58.300574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684ba26-2175-4b62-87bf-d387ceae5ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:58.301221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684ba26-2175-4b62-87bf-d387ceae5ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:58.301500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684ba26-2175-4b62-87bf-d387ceae5ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:58.301775 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684ba26-2175-4b62-87bf-d387ceae5ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:58.311126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684ba26-2175-4b62-87bf-d387ceae5ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:58.312540 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684ba26-2175-4b62-87bf-d387ceae5ad1 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:58.321984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1114/2190] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:34:58.598984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab3e55-ec55-44a1-953a-b016449c1afd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:58.600523 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-89ab3e55-ec55-44a1-953a-b016449c1afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:58.613106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab3e55-ec55-44a1-953a-b016449c1afd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:58.619232 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:58.620309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:58.620662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:58.621049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] PATH_INFO: `/v3/projects/d92b4a4d50c4464891afe0119cb03cdc` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:58.622507 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92b4a4d50c4464891afe0119cb03cdc)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:58.631059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:58.688325 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92b4a4d50c4464891afe0119cb03cdc', 'request_id': 'req-f66dcb37-22dd-4c18-9a31-3b56c1de7315'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.695097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92b4a4d50c4464891afe0119cb03cdc', 'request_id': 'req-f66dcb37-22dd-4c18-9a31-3b56c1de7315'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.704102 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92b4a4d50c4464891afe0119cb03cdc', 'request_id': 'req-f66dcb37-22dd-4c18-9a31-3b56c1de7315'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.720872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] The token cache is being invalidate because project d92b4a4d50c4464891afe0119cb03cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:58.721240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.721978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.726567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1077/2191] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:58 2022] DELETE /identity/v3/projects/d92b4a4d50c4464891afe0119cb03cdc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:58.727848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684ba26-2175-4b62-87bf-d387ceae5ad1 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:58.738520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684ba26-2175-4b62-87bf-d387ceae5ad1 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:58.798483 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:58.799149 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:58.799460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:58.799879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] PATH_INFO: `/v3/users/24b301f1230a42c7bf2b4e8af2e34a98` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:58.801537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24b301f1230a42c7bf2b4e8af2e34a98)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:58.803466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:58.854558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24b301f1230a42c7bf2b4e8af2e34a98'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.867715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24b301f1230a42c7bf2b4e8af2e34a98'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.869053 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24b301f1230a42c7bf2b4e8af2e34a98'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.869690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24b301f1230a42c7bf2b4e8af2e34a98'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.877588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24b301f1230a42c7bf2b4e8af2e34a98'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:58.891686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1115/2192] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:58 2022] DELETE /identity/v3/users/24b301f1230a42c7bf2b4e8af2e34a98 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:34:59.333156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:59.334694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:59.349408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dcb37-22dd-4c18-9a31-3b56c1de7315 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:59.422897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59ea25-689a-4879-bf13-bcde34ec6381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:59.423550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ea25-689a-4879-bf13-bcde34ec6381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:59.423835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ea25-689a-4879-bf13-bcde34ec6381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:59.424110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ea25-689a-4879-bf13-bcde34ec6381 admin admin] PATH_INFO: `/v3/projects/0297213961b54d83badf68b7cb0f7630` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:59.425307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59ea25-689a-4879-bf13-bcde34ec6381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0297213961b54d83badf68b7cb0f7630)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:59.427236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59ea25-689a-4879-bf13-bcde34ec6381 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:59.454379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:59.482560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec59ea25-689a-4879-bf13-bcde34ec6381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0297213961b54d83badf68b7cb0f7630', 'request_id': 'req-ec59ea25-689a-4879-bf13-bcde34ec6381'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:59.488281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec59ea25-689a-4879-bf13-bcde34ec6381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0297213961b54d83badf68b7cb0f7630', 'request_id': 'req-ec59ea25-689a-4879-bf13-bcde34ec6381'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:59.496349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec59ea25-689a-4879-bf13-bcde34ec6381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0297213961b54d83badf68b7cb0f7630', 'request_id': 'req-ec59ea25-689a-4879-bf13-bcde34ec6381'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:59.508293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec59ea25-689a-4879-bf13-bcde34ec6381 admin admin] The token cache is being invalidate because project 0297213961b54d83badf68b7cb0f7630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:34:59.508585 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec59ea25-689a-4879-bf13-bcde34ec6381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:59.510112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec59ea25-689a-4879-bf13-bcde34ec6381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:59.511943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1078/2193] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:34:59 2022] DELETE /identity/v3/projects/0297213961b54d83badf68b7cb0f7630 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:59.517266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:59.519292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:59.536619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782c293-f63a-4988-9fd9-acf896ff01a5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:59.608867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddafcac-ee69-4262-a855-b2ca81495057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:59.609627 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddafcac-ee69-4262-a855-b2ca81495057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:59.609980 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddafcac-ee69-4262-a855-b2ca81495057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:59.610362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddafcac-ee69-4262-a855-b2ca81495057 admin admin] PATH_INFO: `/v3/users/e977f82a5c6346f7bd8e7cbed48abd7a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:59.611840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddafcac-ee69-4262-a855-b2ca81495057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e977f82a5c6346f7bd8e7cbed48abd7a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:59.614095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddafcac-ee69-4262-a855-b2ca81495057 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:59.617840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:59.680776 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dddafcac-ee69-4262-a855-b2ca81495057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e977f82a5c6346f7bd8e7cbed48abd7a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:59.692976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dddafcac-ee69-4262-a855-b2ca81495057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e977f82a5c6346f7bd8e7cbed48abd7a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:59.693830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dddafcac-ee69-4262-a855-b2ca81495057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e977f82a5c6346f7bd8e7cbed48abd7a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:59.694474 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dddafcac-ee69-4262-a855-b2ca81495057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e977f82a5c6346f7bd8e7cbed48abd7a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:59.702262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dddafcac-ee69-4262-a855-b2ca81495057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e977f82a5c6346f7bd8e7cbed48abd7a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:34:59.721132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1116/2194] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:34:59 2022] DELETE /identity/v3/users/e977f82a5c6346f7bd8e7cbed48abd7a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:34:59.813262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85254ab0-3eca-4794-b238-ee40c5ee5a07 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:59.813551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85254ab0-3eca-4794-b238-ee40c5ee5a07 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:59.813830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85254ab0-3eca-4794-b238-ee40c5ee5a07 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:59.815197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1079/2195] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:34:59.828411 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466c5c2-7516-4d76-a6d2-de3a92907792 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:59.828781 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466c5c2-7516-4d76-a6d2-de3a92907792 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:59.829115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466c5c2-7516-4d76-a6d2-de3a92907792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:59.851788 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a466c5c2-7516-4d76-a6d2-de3a92907792 None None] MFA Rules not processed for user `fc1bd453c1114da4a5d9aa543bf1ff32`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:34:59.855739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a466c5c2-7516-4d76-a6d2-de3a92907792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:59.956110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1117/2196] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:34:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:34:59.969639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85254ab0-3eca-4794-b238-ee40c5ee5a07 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:59.971730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-85254ab0-3eca-4794-b238-ee40c5ee5a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:59.988798 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85254ab0-3eca-4794-b238-ee40c5ee5a07 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:59.999552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845a46-0069-4df8-90d9-1e3d7b0b7633 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:00.000497 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845a46-0069-4df8-90d9-1e3d7b0b7633 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.001249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845a46-0069-4df8-90d9-1e3d7b0b7633 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.001249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845a46-0069-4df8-90d9-1e3d7b0b7633 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:00.011883 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845a46-0069-4df8-90d9-1e3d7b0b7633 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:00.013656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845a46-0069-4df8-90d9-1e3d7b0b7633 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:00.024089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1080/2197] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:35:00.095034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466c5c2-7516-4d76-a6d2-de3a92907792 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:00.096702 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a466c5c2-7516-4d76-a6d2-de3a92907792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:00.188889 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466c5c2-7516-4d76-a6d2-de3a92907792 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:00.193566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462efd1-4340-4fcf-889a-c2fdf73d96f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:00.194299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462efd1-4340-4fcf-889a-c2fdf73d96f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.194585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462efd1-4340-4fcf-889a-c2fdf73d96f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.194864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462efd1-4340-4fcf-889a-c2fdf73d96f7 admin admin] PATH_INFO: `/v3/projects/82e87745d71f4bcd80c90f444d75984f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:00.196108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462efd1-4340-4fcf-889a-c2fdf73d96f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e87745d71f4bcd80c90f444d75984f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:00.198649 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462efd1-4340-4fcf-889a-c2fdf73d96f7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:00.221617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:00.269921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e462efd1-4340-4fcf-889a-c2fdf73d96f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e87745d71f4bcd80c90f444d75984f', 'request_id': 'req-e462efd1-4340-4fcf-889a-c2fdf73d96f7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:00.276992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e462efd1-4340-4fcf-889a-c2fdf73d96f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e87745d71f4bcd80c90f444d75984f', 'request_id': 'req-e462efd1-4340-4fcf-889a-c2fdf73d96f7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:00.284721 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e462efd1-4340-4fcf-889a-c2fdf73d96f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e87745d71f4bcd80c90f444d75984f', 'request_id': 'req-e462efd1-4340-4fcf-889a-c2fdf73d96f7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:00.296686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e462efd1-4340-4fcf-889a-c2fdf73d96f7 admin admin] The token cache is being invalidate because project 82e87745d71f4bcd80c90f444d75984f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:35:00.297018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e462efd1-4340-4fcf-889a-c2fdf73d96f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:00.297680 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e462efd1-4340-4fcf-889a-c2fdf73d96f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:00.299191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1118/2198] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:35:00 2022] DELETE /identity/v3/projects/82e87745d71f4bcd80c90f444d75984f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:35:00.304012 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2f424-963f-47ca-9a34-84ef78d26476 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.304303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2f424-963f-47ca-9a34-84ef78d26476 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.304581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2f424-963f-47ca-9a34-84ef78d26476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:00.324178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-87a2f424-963f-47ca-9a34-84ef78d26476 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:00.325447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-87a2f424-963f-47ca-9a34-84ef78d26476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:00.401876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1081/2199] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:00.470668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adf6fa-9778-409d-bb3a-ebdffe35c446 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.470955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adf6fa-9778-409d-bb3a-ebdffe35c446 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.471230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66adf6fa-9778-409d-bb3a-ebdffe35c446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:00.494903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-66adf6fa-9778-409d-bb3a-ebdffe35c446 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:00.496387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-66adf6fa-9778-409d-bb3a-ebdffe35c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:00.505595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1119/2200] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:00.510501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2f424-963f-47ca-9a34-84ef78d26476 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:00.550141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2f424-963f-47ca-9a34-84ef78d26476 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:00.556441 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1df9e-6ec0-4f67-b4b3-6cc1c46ad8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:00.557356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1df9e-6ec0-4f67-b4b3-6cc1c46ad8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.557701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1df9e-6ec0-4f67-b4b3-6cc1c46ad8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.558167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1df9e-6ec0-4f67-b4b3-6cc1c46ad8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:00.559070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1df9e-6ec0-4f67-b4b3-6cc1c46ad8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:35:00.559571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1df9e-6ec0-4f67-b4b3-6cc1c46ad8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:00.561530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1df9e-6ec0-4f67-b4b3-6cc1c46ad8e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:00.583897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1082/2201] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:35:00.586213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adf6fa-9778-409d-bb3a-ebdffe35c446 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:00.588472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-66adf6fa-9778-409d-bb3a-ebdffe35c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:00.588888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1df9e-6ec0-4f67-b4b3-6cc1c46ad8e1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:00.601756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1df9e-6ec0-4f67-b4b3-6cc1c46ad8e1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:00.607178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66adf6fa-9778-409d-bb3a-ebdffe35c446 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:00.607642 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248470cd-98b3-4061-86ce-baacce53544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:00.608276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248470cd-98b3-4061-86ce-baacce53544e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.608570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248470cd-98b3-4061-86ce-baacce53544e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.608845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248470cd-98b3-4061-86ce-baacce53544e admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:00.609583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248470cd-98b3-4061-86ce-baacce53544e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:00.611476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248470cd-98b3-4061-86ce-baacce53544e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:00.615042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:00.616120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.616797 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.617262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] PATH_INFO: `/v3/users/5317ca2903344b6ea90f4d4d9d246090` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:00.619623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5317ca2903344b6ea90f4d4d9d246090)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:00.621610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:00.647279 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1083/2202] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:35:00 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:35:00.653247 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248470cd-98b3-4061-86ce-baacce53544e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:00.689890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5317ca2903344b6ea90f4d4d9d246090'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:00.708586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5317ca2903344b6ea90f4d4d9d246090'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:00.709376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5317ca2903344b6ea90f4d4d9d246090'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:00.709999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5317ca2903344b6ea90f4d4d9d246090'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:00.719836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5317ca2903344b6ea90f4d4d9d246090'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:00.733162 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1120/2203] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:35:00 2022] DELETE /identity/v3/users/5317ca2903344b6ea90f4d4d9d246090 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:35:00.739797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248470cd-98b3-4061-86ce-baacce53544e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:00.745900 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:00.807242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e91738-a0d7-4046-bcf7-185d9ba52b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:00.807866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e91738-a0d7-4046-bcf7-185d9ba52b10 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.808144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e91738-a0d7-4046-bcf7-185d9ba52b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.808412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e91738-a0d7-4046-bcf7-185d9ba52b10 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:00.809099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e91738-a0d7-4046-bcf7-185d9ba52b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:00.811002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e91738-a0d7-4046-bcf7-185d9ba52b10 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:00.834163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1084/2204] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:35:00 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:35:00.838473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:00.840011 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:00.854020 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb30d7-5830-4397-b4f6-91e37b625eac admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:00.859250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb250f5-c4fb-4223-9812-21147ea60dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:00.859896 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb250f5-c4fb-4223-9812-21147ea60dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.860179 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb250f5-c4fb-4223-9812-21147ea60dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.860577 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb250f5-c4fb-4223-9812-21147ea60dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:00.861216 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb250f5-c4fb-4223-9812-21147ea60dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:00.862829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb250f5-c4fb-4223-9812-21147ea60dc3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:00.873873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1121/2205] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:35:00.878032 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e91738-a0d7-4046-bcf7-185d9ba52b10 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:00.888363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e91738-a0d7-4046-bcf7-185d9ba52b10 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:00.892971 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777a42c-532d-4b18-955e-80b4c4c35efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:00.893581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777a42c-532d-4b18-955e-80b4c4c35efb admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.893866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777a42c-532d-4b18-955e-80b4c4c35efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.894145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777a42c-532d-4b18-955e-80b4c4c35efb admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:00.894839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777a42c-532d-4b18-955e-80b4c4c35efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:00.896428 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777a42c-532d-4b18-955e-80b4c4c35efb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:00.907927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1085/2206] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:35:00.912508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb250f5-c4fb-4223-9812-21147ea60dc3 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:00.924251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777a42c-532d-4b18-955e-80b4c4c35efb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:00.925799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb250f5-c4fb-4223-9812-21147ea60dc3 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:00.926151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c777a42c-532d-4b18-955e-80b4c4c35efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:00.932865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960f867-0dd2-45b4-b882-35c008c7069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:00.933576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960f867-0dd2-45b4-b882-35c008c7069b admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.933860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960f867-0dd2-45b4-b882-35c008c7069b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.934138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960f867-0dd2-45b4-b882-35c008c7069b admin admin] PATH_INFO: `/v3/projects/54a54142f064443e961f2e6519d2392d/users/ada164ddadcb44da955c7360c5eeef54/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:00.942750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777a42c-532d-4b18-955e-80b4c4c35efb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:00.948851 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:00.949545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.949951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.950145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] PATH_INFO: `/v3/projects/31d67ee1cb974677b175e25944fba691` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:00.951383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d67ee1cb974677b175e25944fba691)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:00.953342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960f867-0dd2-45b4-b882-35c008c7069b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a54142f064443e961f2e6519d2392d, user_id=ada164ddadcb44da955c7360c5eeef54, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:00.953440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:00.956346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960f867-0dd2-45b4-b882-35c008c7069b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:00.972377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1122/2207] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:35:00 2022] PUT /identity/v3/projects/54a54142f064443e961f2e6519d2392d/users/ada164ddadcb44da955c7360c5eeef54/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:35:00.978168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0b10c-d870-4e5f-83ba-31e5ff05f023 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:00.978595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0b10c-d870-4e5f-83ba-31e5ff05f023 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:00.978942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0b10c-d870-4e5f-83ba-31e5ff05f023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:01.003703 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-07a0b10c-d870-4e5f-83ba-31e5ff05f023 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:01.005301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-07a0b10c-d870-4e5f-83ba-31e5ff05f023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:01.014732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d67ee1cb974677b175e25944fba691', 'request_id': 'req-139e0893-8291-45d6-87d1-6debf6bc9351'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.021043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d67ee1cb974677b175e25944fba691', 'request_id': 'req-139e0893-8291-45d6-87d1-6debf6bc9351'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.029666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d67ee1cb974677b175e25944fba691', 'request_id': 'req-139e0893-8291-45d6-87d1-6debf6bc9351'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.039982 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:01.044466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] The token cache is being invalidate because project 31d67ee1cb974677b175e25944fba691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:35:01.044831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.045589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.047202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1086/2208] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:35:00 2022] DELETE /identity/v3/projects/31d67ee1cb974677b175e25944fba691 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:35:01.051201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:01.052651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:01.075380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1123/2209] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:35:01.085728 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0b10c-d870-4e5f-83ba-31e5ff05f023 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:01.087087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-07a0b10c-d870-4e5f-83ba-31e5ff05f023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:01.119012 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e0893-8291-45d6-87d1-6debf6bc9351 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:01.124200 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634326c7-ef2e-4d67-9436-81a0e823f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:01.124874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634326c7-ef2e-4d67-9436-81a0e823f174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:01.125196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634326c7-ef2e-4d67-9436-81a0e823f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:01.125474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634326c7-ef2e-4d67-9436-81a0e823f174 admin admin] PATH_INFO: `/v3/users/905dd88bc58b482e841fd4d494230ccc` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:01.126666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634326c7-ef2e-4d67-9436-81a0e823f174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=905dd88bc58b482e841fd4d494230ccc)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:01.128591 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634326c7-ef2e-4d67-9436-81a0e823f174 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:01.142376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:01.145747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0b10c-d870-4e5f-83ba-31e5ff05f023 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:01.149847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76071a-dc01-4ecc-bed5-8af03bd21169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:01.150459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76071a-dc01-4ecc-bed5-8af03bd21169 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:01.150742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76071a-dc01-4ecc-bed5-8af03bd21169 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:01.151021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76071a-dc01-4ecc-bed5-8af03bd21169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:01.161229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76071a-dc01-4ecc-bed5-8af03bd21169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:01.162925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76071a-dc01-4ecc-bed5-8af03bd21169 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:01.173265 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1124/2210] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:35:01.179442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-634326c7-ef2e-4d67-9436-81a0e823f174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905dd88bc58b482e841fd4d494230ccc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.187444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-634326c7-ef2e-4d67-9436-81a0e823f174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905dd88bc58b482e841fd4d494230ccc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.207278 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-634326c7-ef2e-4d67-9436-81a0e823f174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905dd88bc58b482e841fd4d494230ccc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.208412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-634326c7-ef2e-4d67-9436-81a0e823f174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905dd88bc58b482e841fd4d494230ccc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.209621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-634326c7-ef2e-4d67-9436-81a0e823f174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905dd88bc58b482e841fd4d494230ccc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.234784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1087/2211] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:35:01 2022] DELETE /identity/v3/users/905dd88bc58b482e841fd4d494230ccc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:35:01.454786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76071a-dc01-4ecc-bed5-8af03bd21169 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:01.475727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76071a-dc01-4ecc-bed5-8af03bd21169 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:01.577182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:01.577911 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:01.578258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:01.578601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a admin admin] PATH_INFO: `/v3/projects/c0d0ae97b994468b914052bd1da7c4bd` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:01.579828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d0ae97b994468b914052bd1da7c4bd)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:01.581920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:01.666885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d0ae97b994468b914052bd1da7c4bd', 'request_id': 'req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.675774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d0ae97b994468b914052bd1da7c4bd', 'request_id': 'req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.685956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d0ae97b994468b914052bd1da7c4bd', 'request_id': 'req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.699110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a admin admin] The token cache is being invalidate because project c0d0ae97b994468b914052bd1da7c4bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:35:01.699396 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.700043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ee68119-16bc-4a37-be8a-21e12ab2ae3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:01.701572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1125/2212] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:35:01 2022] DELETE /identity/v3/projects/c0d0ae97b994468b914052bd1da7c4bd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:35:01.708437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dde8e8-456a-419e-90aa-95f4e4605c05 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:01.709403 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dde8e8-456a-419e-90aa-95f4e4605c05 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:01.709691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dde8e8-456a-419e-90aa-95f4e4605c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:01.734709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c1dde8e8-456a-419e-90aa-95f4e4605c05 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:01.735937 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c1dde8e8-456a-419e-90aa-95f4e4605c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:01.799022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1088/2213] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:01.807780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c10b3-fc06-4122-b883-b1d3df199e60 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:01.808071 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c10b3-fc06-4122-b883-b1d3df199e60 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:01.808341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c10b3-fc06-4122-b883-b1d3df199e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:01.828184 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6e6c10b3-fc06-4122-b883-b1d3df199e60 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:01.829431 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6e6c10b3-fc06-4122-b883-b1d3df199e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:01.837482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1126/2214] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:01.841837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dde8e8-456a-419e-90aa-95f4e4605c05 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:01.851710 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dde8e8-456a-419e-90aa-95f4e4605c05 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:01.857174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a16001-0299-495d-adc1-48395d827daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:01.865187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16001-0299-495d-adc1-48395d827daa admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:01.865187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16001-0299-495d-adc1-48395d827daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:01.865187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16001-0299-495d-adc1-48395d827daa admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:01.865187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a16001-0299-495d-adc1-48395d827daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:35:01.865187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a16001-0299-495d-adc1-48395d827daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:01.865187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a16001-0299-495d-adc1-48395d827daa admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:01.875095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1089/2215] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:35:01.879520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c10b3-fc06-4122-b883-b1d3df199e60 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:01.886685 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:01.890859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c10b3-fc06-4122-b883-b1d3df199e60 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:01.896195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ea8bc-f99c-4f82-8d77-955a0c05c975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:01.896825 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ea8bc-f99c-4f82-8d77-955a0c05c975 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:01.897150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ea8bc-f99c-4f82-8d77-955a0c05c975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:01.897426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ea8bc-f99c-4f82-8d77-955a0c05c975 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:01.898150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ea8bc-f99c-4f82-8d77-955a0c05c975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:01.900039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ea8bc-f99c-4f82-8d77-955a0c05c975 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:01.934936 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1127/2216] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:35:01 2022] POST /identity/v3/projects => generated 361 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:35:01.936093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a16001-0299-495d-adc1-48395d827daa admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:01.947917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a16001-0299-495d-adc1-48395d827daa admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:01.975542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8993b-88e2-4029-b764-9e1308d66bab None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:01.977132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8993b-88e2-4029-b764-9e1308d66bab None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:01.977598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8993b-88e2-4029-b764-9e1308d66bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:02.012529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48f91e-0500-4ece-bb36-681bac73146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:02.013607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f91e-0500-4ece-bb36-681bac73146c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:02.013902 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f91e-0500-4ece-bb36-681bac73146c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:02.014177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f91e-0500-4ece-bb36-681bac73146c admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:02.014856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48f91e-0500-4ece-bb36-681bac73146c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:02.016827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48f91e-0500-4ece-bb36-681bac73146c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:02.031208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-23e8993b-88e2-4029-b764-9e1308d66bab None None] MFA Rules not processed for user `ada164ddadcb44da955c7360c5eeef54`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:02.035368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-23e8993b-88e2-4029-b764-9e1308d66bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:02.050548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1090/2217] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:35:01 2022] POST /identity/v3/users => generated 281 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:35:02.051591 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48f91e-0500-4ece-bb36-681bac73146c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:02.065755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48f91e-0500-4ece-bb36-681bac73146c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:02.072831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9e28e-d399-4dfe-8be2-1a9b3cb4ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:02.073486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9e28e-d399-4dfe-8be2-1a9b3cb4ded2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:02.073920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9e28e-d399-4dfe-8be2-1a9b3cb4ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:02.074201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9e28e-d399-4dfe-8be2-1a9b3cb4ded2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:02.074902 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9e28e-d399-4dfe-8be2-1a9b3cb4ded2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:02.076497 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9e28e-d399-4dfe-8be2-1a9b3cb4ded2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:02.078148 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:02.090074 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1091/2218] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:35:02.094153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9e28e-d399-4dfe-8be2-1a9b3cb4ded2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:02.111331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9e28e-d399-4dfe-8be2-1a9b3cb4ded2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:02.117064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1128/2219] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:02.117707 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884981c-951c-4493-988e-792b115062c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:02.119249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884981c-951c-4493-988e-792b115062c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:02.119629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884981c-951c-4493-988e-792b115062c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:02.119925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884981c-951c-4493-988e-792b115062c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:02.120889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884981c-951c-4493-988e-792b115062c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:02.123043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884981c-951c-4493-988e-792b115062c6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:02.128085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8993b-88e2-4029-b764-9e1308d66bab None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:02.130057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-23e8993b-88e2-4029-b764-9e1308d66bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:02.138183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1092/2220] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:35:02.139198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884981c-951c-4493-988e-792b115062c6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:02.150550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884981c-951c-4493-988e-792b115062c6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:02.155802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13f6fa-f1b7-400b-83bf-31c8f7ef3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:02.156475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13f6fa-f1b7-400b-83bf-31c8f7ef3eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:02.156772 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13f6fa-f1b7-400b-83bf-31c8f7ef3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:02.161264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13f6fa-f1b7-400b-83bf-31c8f7ef3eb3 admin admin] PATH_INFO: `/v3/projects/91b26c57fa6d4f778d6f818c076e2025/users/ced57e183bbc4fcdb8af9636c85fadd6/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:02.184699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13f6fa-f1b7-400b-83bf-31c8f7ef3eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b26c57fa6d4f778d6f818c076e2025, user_id=ced57e183bbc4fcdb8af9636c85fadd6, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:02.188440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13f6fa-f1b7-400b-83bf-31c8f7ef3eb3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:02.205544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1093/2221] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:35:02 2022] PUT /identity/v3/projects/91b26c57fa6d4f778d6f818c076e2025/users/ced57e183bbc4fcdb8af9636c85fadd6/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:35:02.211163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8993b-88e2-4029-b764-9e1308d66bab None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:02.216468 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3f473-650b-480d-b415-2357f799de24 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:02.216758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3f473-650b-480d-b415-2357f799de24 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:02.217069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3f473-650b-480d-b415-2357f799de24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:02.250494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-62b3f473-650b-480d-b415-2357f799de24 None None] MFA Rules not processed for user `ced57e183bbc4fcdb8af9636c85fadd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:02.251212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-62b3f473-650b-480d-b415-2357f799de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:02.275746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300cbde-e7ce-42d8-8f93-d46bb50d5991 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:02.276550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300cbde-e7ce-42d8-8f93-d46bb50d5991 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:02.276962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300cbde-e7ce-42d8-8f93-d46bb50d5991 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:02.277320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300cbde-e7ce-42d8-8f93-d46bb50d5991 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:02.342407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:02.351573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1094/2222] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:02.358851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300cbde-e7ce-42d8-8f93-d46bb50d5991 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:02.360511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300cbde-e7ce-42d8-8f93-d46bb50d5991 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:02.372452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1129/2223] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:35:02.384958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3f473-650b-480d-b415-2357f799de24 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:02.386623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-62b3f473-650b-480d-b415-2357f799de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:02.398274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3f473-650b-480d-b415-2357f799de24 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:02.402536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d71ddf-f184-4f89-9598-c9e20d5b0e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:02.403145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d71ddf-f184-4f89-9598-c9e20d5b0e77 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:02.403428 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d71ddf-f184-4f89-9598-c9e20d5b0e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:02.403703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d71ddf-f184-4f89-9598-c9e20d5b0e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:02.413291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d71ddf-f184-4f89-9598-c9e20d5b0e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:02.414804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d71ddf-f184-4f89-9598-c9e20d5b0e77 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:02.424229 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1095/2224] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:35:02.439968 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300cbde-e7ce-42d8-8f93-d46bb50d5991 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:02.517015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300cbde-e7ce-42d8-8f93-d46bb50d5991 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:02.522277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:02.522931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:02.523217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:02.523494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] PATH_INFO: `/v3/users/ced57e183bbc4fcdb8af9636c85fadd6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:02.525808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced57e183bbc4fcdb8af9636c85fadd6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:02.528204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:02.588859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced57e183bbc4fcdb8af9636c85fadd6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:02.604787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced57e183bbc4fcdb8af9636c85fadd6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:02.605706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced57e183bbc4fcdb8af9636c85fadd6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:02.606675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced57e183bbc4fcdb8af9636c85fadd6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:02.625262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced57e183bbc4fcdb8af9636c85fadd6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:02.640054 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1130/2225] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:35:02 2022] DELETE /identity/v3/users/ced57e183bbc4fcdb8af9636c85fadd6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:35:02.644734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c78e62-a58c-4967-bc74-fd79440930af None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:02.645176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c78e62-a58c-4967-bc74-fd79440930af None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:02.645584 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c78e62-a58c-4967-bc74-fd79440930af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:02.701880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c2c78e62-a58c-4967-bc74-fd79440930af None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:02.701880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c2c78e62-a58c-4967-bc74-fd79440930af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:02.787305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1096/2226] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:02.798427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:02.800553 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:02.862996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ea122-af94-4826-86e5-f39a94678a3f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:02.866620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bcb2a-ac03-4da5-b4a5-8f562fd235fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:02.867246 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bcb2a-ac03-4da5-b4a5-8f562fd235fc service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:02.867531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bcb2a-ac03-4da5-b4a5-8f562fd235fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:02.867811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bcb2a-ac03-4da5-b4a5-8f562fd235fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:02.877815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bcb2a-ac03-4da5-b4a5-8f562fd235fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:02.879241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bcb2a-ac03-4da5-b4a5-8f562fd235fc service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:02.888873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1131/2227] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:35:03.298035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c78e62-a58c-4967-bc74-fd79440930af None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:03.306363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c2c78e62-a58c-4967-bc74-fd79440930af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:03.322138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c78e62-a58c-4967-bc74-fd79440930af None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:03.327466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ea092-1440-4dac-b37c-9319d8b75ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:03.328119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ea092-1440-4dac-b37c-9319d8b75ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:03.328439 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ea092-1440-4dac-b37c-9319d8b75ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:03.328656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ea092-1440-4dac-b37c-9319d8b75ebe admin admin] PATH_INFO: `/v3/projects/91b26c57fa6d4f778d6f818c076e2025` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:03.329871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ea092-1440-4dac-b37c-9319d8b75ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b26c57fa6d4f778d6f818c076e2025)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:03.333066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ea092-1440-4dac-b37c-9319d8b75ebe admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:03.379498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:03.403097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-313ea092-1440-4dac-b37c-9319d8b75ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b26c57fa6d4f778d6f818c076e2025', 'request_id': 'req-313ea092-1440-4dac-b37c-9319d8b75ebe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:03.410205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-313ea092-1440-4dac-b37c-9319d8b75ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b26c57fa6d4f778d6f818c076e2025', 'request_id': 'req-313ea092-1440-4dac-b37c-9319d8b75ebe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:03.419639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-313ea092-1440-4dac-b37c-9319d8b75ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b26c57fa6d4f778d6f818c076e2025', 'request_id': 'req-313ea092-1440-4dac-b37c-9319d8b75ebe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:03.434390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-313ea092-1440-4dac-b37c-9319d8b75ebe admin admin] The token cache is being invalidate because project 91b26c57fa6d4f778d6f818c076e2025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:35:03.434755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-313ea092-1440-4dac-b37c-9319d8b75ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:03.435489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-313ea092-1440-4dac-b37c-9319d8b75ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:03.441070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1097/2228] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:35:03 2022] DELETE /identity/v3/projects/91b26c57fa6d4f778d6f818c076e2025 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:35:03.447953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59128d9-8832-4c66-bb05-365c371334cc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:03.447953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59128d9-8832-4c66-bb05-365c371334cc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:03.447953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59128d9-8832-4c66-bb05-365c371334cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:03.466724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:03.485537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b59128d9-8832-4c66-bb05-365c371334cc None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:03.486884 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b59128d9-8832-4c66-bb05-365c371334cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:03.558654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1132/2229] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:03.566526 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f00d60-344d-4e6d-9bc5-12cd366594b7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:03.566944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f00d60-344d-4e6d-9bc5-12cd366594b7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:03.567228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f00d60-344d-4e6d-9bc5-12cd366594b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:03.589741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-21f00d60-344d-4e6d-9bc5-12cd366594b7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:03.591299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-21f00d60-344d-4e6d-9bc5-12cd366594b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:03.601153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1098/2230] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:03.606514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59128d9-8832-4c66-bb05-365c371334cc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:03.616935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59128d9-8832-4c66-bb05-365c371334cc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:03.622590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9de96d-471b-4313-9747-b6eea79acdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:03.623234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9de96d-471b-4313-9747-b6eea79acdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:03.623757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9de96d-471b-4313-9747-b6eea79acdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:03.623950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9de96d-471b-4313-9747-b6eea79acdc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:03.624680 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9de96d-471b-4313-9747-b6eea79acdc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:35:03.625448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9de96d-471b-4313-9747-b6eea79acdc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:03.626605 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9de96d-471b-4313-9747-b6eea79acdc2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:03.639766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1133/2231] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:35:03.644309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f00d60-344d-4e6d-9bc5-12cd366594b7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:03.660216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f00d60-344d-4e6d-9bc5-12cd366594b7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:03.665648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbba5c6-c208-4855-8ef1-c780d6e61179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:03.666267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbba5c6-c208-4855-8ef1-c780d6e61179 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:03.666545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbba5c6-c208-4855-8ef1-c780d6e61179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:03.666812 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbba5c6-c208-4855-8ef1-c780d6e61179 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:03.667571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbba5c6-c208-4855-8ef1-c780d6e61179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:03.670808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbba5c6-c208-4855-8ef1-c780d6e61179 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:03.703438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1099/2232] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:35:03 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:35:03.707642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9de96d-471b-4313-9747-b6eea79acdc2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:03.719010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9de96d-471b-4313-9747-b6eea79acdc2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:03.783484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953073c-eff7-4a4a-ae34-603a06058b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:03.784104 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953073c-eff7-4a4a-ae34-603a06058b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:03.784389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953073c-eff7-4a4a-ae34-603a06058b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:03.784688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953073c-eff7-4a4a-ae34-603a06058b57 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:03.785353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953073c-eff7-4a4a-ae34-603a06058b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:03.787277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953073c-eff7-4a4a-ae34-603a06058b57 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:03.810230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1134/2233] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:35:03 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:35:03.814367 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbba5c6-c208-4855-8ef1-c780d6e61179 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:03.825543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbba5c6-c208-4855-8ef1-c780d6e61179 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:03.830475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcec7c-1579-4f02-9ac8-12a660d18cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:03.831101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcec7c-1579-4f02-9ac8-12a660d18cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:03.831434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcec7c-1579-4f02-9ac8-12a660d18cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:03.831642 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcec7c-1579-4f02-9ac8-12a660d18cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:03.832601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcec7c-1579-4f02-9ac8-12a660d18cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:03.834091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcec7c-1579-4f02-9ac8-12a660d18cc9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:03.847721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1100/2234] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:35:03.851805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953073c-eff7-4a4a-ae34-603a06058b57 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:03.874748 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953073c-eff7-4a4a-ae34-603a06058b57 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:03.880304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f3e22-eca5-4220-a853-3d8a170547dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:03.881300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f3e22-eca5-4220-a853-3d8a170547dd admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:03.881760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f3e22-eca5-4220-a853-3d8a170547dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:03.882205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f3e22-eca5-4220-a853-3d8a170547dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:03.883067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f3e22-eca5-4220-a853-3d8a170547dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:03.885325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f3e22-eca5-4220-a853-3d8a170547dd admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:03.900338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1135/2235] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:35:03.901522 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcec7c-1579-4f02-9ac8-12a660d18cc9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:03.911510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcec7c-1579-4f02-9ac8-12a660d18cc9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:03.917196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fce7ed-546b-49cd-ab9d-27fe90be1aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:03.917856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fce7ed-546b-49cd-ab9d-27fe90be1aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:03.918146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fce7ed-546b-49cd-ab9d-27fe90be1aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:03.918418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fce7ed-546b-49cd-ab9d-27fe90be1aa1 admin admin] PATH_INFO: `/v3/projects/1c255cbe41f548918656bbe6a2390de2/users/02f5c57318474e399f5741979b10af52/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:03.933783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fce7ed-546b-49cd-ab9d-27fe90be1aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c255cbe41f548918656bbe6a2390de2, user_id=02f5c57318474e399f5741979b10af52, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:03.936399 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fce7ed-546b-49cd-ab9d-27fe90be1aa1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:03.950339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1101/2236] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:35:03 2022] PUT /identity/v3/projects/1c255cbe41f548918656bbe6a2390de2/users/02f5c57318474e399f5741979b10af52/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:35:03.961441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ddded-5688-4dd9-aba5-3976f32f3912 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:03.962245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ddded-5688-4dd9-aba5-3976f32f3912 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:03.962578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ddded-5688-4dd9-aba5-3976f32f3912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:03.992789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ed9ddded-5688-4dd9-aba5-3976f32f3912 None None] MFA Rules not processed for user `02f5c57318474e399f5741979b10af52`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:03.994252 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ed9ddded-5688-4dd9-aba5-3976f32f3912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:04.062653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:04.066827 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1136/2237] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:04.078498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fce7ed-546b-49cd-ab9d-27fe90be1aa1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:04.080202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f0fce7ed-546b-49cd-ab9d-27fe90be1aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:04.143649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fce7ed-546b-49cd-ab9d-27fe90be1aa1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:04.147429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa977a-0313-4313-b58c-e7ba25c64bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:04.148054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa977a-0313-4313-b58c-e7ba25c64bfe service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:04.148339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa977a-0313-4313-b58c-e7ba25c64bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:04.148614 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa977a-0313-4313-b58c-e7ba25c64bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:04.159551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa977a-0313-4313-b58c-e7ba25c64bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:04.161064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa977a-0313-4313-b58c-e7ba25c64bfe service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:04.171850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1102/2238] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:35:04.819414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491427-5bff-4903-85c8-6a4717836db7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:04.819930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491427-5bff-4903-85c8-6a4717836db7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:04.820028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491427-5bff-4903-85c8-6a4717836db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:04.839212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-55491427-5bff-4903-85c8-6a4717836db7 None None] MFA Rules not processed for user `ada164ddadcb44da955c7360c5eeef54`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:04.840401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-55491427-5bff-4903-85c8-6a4717836db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:04.896067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1137/2239] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:11.311465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8e81b-235e-4e9b-8e61-623053fc401b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:11.312077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8e81b-235e-4e9b-8e61-623053fc401b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:11.312077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8e81b-235e-4e9b-8e61-623053fc401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:11.340834 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-68e8e81b-235e-4e9b-8e61-623053fc401b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:11.342096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-68e8e81b-235e-4e9b-8e61-623053fc401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:11.408094 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:11.419030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1103/2240] 10.222.0.43 () {58 vars in 1016 bytes} [Sat Aug 6 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:11.441676 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55491427-5bff-4903-85c8-6a4717836db7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:11.442770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-55491427-5bff-4903-85c8-6a4717836db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:11.530646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55491427-5bff-4903-85c8-6a4717836db7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:11.536164 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71eaa5-c07b-4b09-a2c5-5fa36a03794c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:11.536837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71eaa5-c07b-4b09-a2c5-5fa36a03794c service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:11.537156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71eaa5-c07b-4b09-a2c5-5fa36a03794c service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:11.537435 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71eaa5-c07b-4b09-a2c5-5fa36a03794c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:11.546241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71eaa5-c07b-4b09-a2c5-5fa36a03794c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:11.547839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71eaa5-c07b-4b09-a2c5-5fa36a03794c service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:11.558441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1138/2241] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:35:18.595113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8e81b-235e-4e9b-8e61-623053fc401b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:18.605479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8e81b-235e-4e9b-8e61-623053fc401b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:18.609896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:18.610522 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:18.610807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:18.611078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] PATH_INFO: `/v3/users/02f5c57318474e399f5741979b10af52` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:18.612220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f5c57318474e399f5741979b10af52)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:18.614146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:18.660097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f5c57318474e399f5741979b10af52'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:18.667755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f5c57318474e399f5741979b10af52'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:18.679581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f5c57318474e399f5741979b10af52'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:18.680264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f5c57318474e399f5741979b10af52'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:18.681557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f5c57318474e399f5741979b10af52'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:18.693867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1104/2242] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:35:18 2022] DELETE /identity/v3/users/02f5c57318474e399f5741979b10af52 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:35:18.699605 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdc660-b51c-4842-bb85-f5089518a5ef None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:18.700378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdc660-b51c-4842-bb85-f5089518a5ef None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:18.700537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdc660-b51c-4842-bb85-f5089518a5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:18.721256 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7ecdc660-b51c-4842-bb85-f5089518a5ef None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:18.722461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7ecdc660-b51c-4842-bb85-f5089518a5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:18.781221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1139/2243] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:35:18.791108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:18.792499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:18.850418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f541d-2e38-466e-b60c-cf94576bcd88 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:18.854041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e86e20-2ef3-4d71-8377-e214326e058b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:18.854660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e86e20-2ef3-4d71-8377-e214326e058b service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:18.854944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e86e20-2ef3-4d71-8377-e214326e058b service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:18.855220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e86e20-2ef3-4d71-8377-e214326e058b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:18.864125 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e86e20-2ef3-4d71-8377-e214326e058b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:18.865534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e86e20-2ef3-4d71-8377-e214326e058b service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:18.874875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1105/2244] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:35:19.137770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdc660-b51c-4842-bb85-f5089518a5ef None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:19.148407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7ecdc660-b51c-4842-bb85-f5089518a5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:19.162092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdc660-b51c-4842-bb85-f5089518a5ef None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:19.166944 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:19.168067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:19.168353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:19.168653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] PATH_INFO: `/v3/projects/1c255cbe41f548918656bbe6a2390de2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:19.169875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c255cbe41f548918656bbe6a2390de2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:19.171787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:19.203849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:19.221503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c255cbe41f548918656bbe6a2390de2', 'request_id': 'req-bccb45f5-5160-425c-9322-d2ea2e9b06b5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:19.226843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c255cbe41f548918656bbe6a2390de2', 'request_id': 'req-bccb45f5-5160-425c-9322-d2ea2e9b06b5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:19.233578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c255cbe41f548918656bbe6a2390de2', 'request_id': 'req-bccb45f5-5160-425c-9322-d2ea2e9b06b5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:19.244881 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] The token cache is being invalidate because project 1c255cbe41f548918656bbe6a2390de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:35:19.245198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:19.245818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:19.247289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1140/2245] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:35:19 2022] DELETE /identity/v3/projects/1c255cbe41f548918656bbe6a2390de2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:35:27.692314 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbb765-d464-46de-9482-322202c6dd61 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:27.692875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbb765-d464-46de-9482-322202c6dd61 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:27.692875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbb765-d464-46de-9482-322202c6dd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:27.714035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d6bbb765-d464-46de-9482-322202c6dd61 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:27.715230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d6bbb765-d464-46de-9482-322202c6dd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:27.776149 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1106/2246] 10.222.0.43 () {58 vars in 1016 bytes} [Sat Aug 6 01:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:27.798304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:27.799696 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:27.873405 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb45f5-5160-425c-9322-d2ea2e9b06b5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:27.878836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadfaa4-e6a6-458e-b0b0-dd5abda60035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:27.879503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadfaa4-e6a6-458e-b0b0-dd5abda60035 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:27.879784 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadfaa4-e6a6-458e-b0b0-dd5abda60035 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:27.880060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadfaa4-e6a6-458e-b0b0-dd5abda60035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:27.889263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadfaa4-e6a6-458e-b0b0-dd5abda60035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:27.890851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadfaa4-e6a6-458e-b0b0-dd5abda60035 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:27.901216 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1141/2247] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:35:33.812235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbb765-d464-46de-9482-322202c6dd61 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:33.814226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d6bbb765-d464-46de-9482-322202c6dd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:33.827454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbb765-d464-46de-9482-322202c6dd61 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:33.834754 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccccfe-9ed2-4e73-bdbb-2f3a6884fbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:33.835554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccccfe-9ed2-4e73-bdbb-2f3a6884fbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:33.835841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccccfe-9ed2-4e73-bdbb-2f3a6884fbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:33.836109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccccfe-9ed2-4e73-bdbb-2f3a6884fbbc admin admin] PATH_INFO: `/v3/users/b6f470697bb34f29866b5f0e78388f87` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:33.837318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccccfe-9ed2-4e73-bdbb-2f3a6884fbbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f470697bb34f29866b5f0e78388f87)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:33.839406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccccfe-9ed2-4e73-bdbb-2f3a6884fbbc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:33.853342 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:33.902209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b7ccccfe-9ed2-4e73-bdbb-2f3a6884fbbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f470697bb34f29866b5f0e78388f87'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:33.910382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b7ccccfe-9ed2-4e73-bdbb-2f3a6884fbbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f470697bb34f29866b5f0e78388f87'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:33.922730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b7ccccfe-9ed2-4e73-bdbb-2f3a6884fbbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f470697bb34f29866b5f0e78388f87'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:33.923471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b7ccccfe-9ed2-4e73-bdbb-2f3a6884fbbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f470697bb34f29866b5f0e78388f87'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:33.924164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b7ccccfe-9ed2-4e73-bdbb-2f3a6884fbbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f470697bb34f29866b5f0e78388f87'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:33.937575 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1107/2248] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:35:33 2022] DELETE /identity/v3/users/b6f470697bb34f29866b5f0e78388f87 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:35:33.942319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e004c-1dce-4db4-aa40-df108a007a89 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:33.942775 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e004c-1dce-4db4-aa40-df108a007a89 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:33.942915 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e004c-1dce-4db4-aa40-df108a007a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:33.962536 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4b4e004c-1dce-4db4-aa40-df108a007a89 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:33.963665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4b4e004c-1dce-4db4-aa40-df108a007a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:34.026130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1142/2249] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:34.034714 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7645c-c95d-4152-9bec-bc413a6c4914 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:34.035007 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7645c-c95d-4152-9bec-bc413a6c4914 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:34.035283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7645c-c95d-4152-9bec-bc413a6c4914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:34.036224 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e004c-1dce-4db4-aa40-df108a007a89 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:34.037599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4b4e004c-1dce-4db4-aa40-df108a007a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:34.055746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-11a7645c-c95d-4152-9bec-bc413a6c4914 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:34.057036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-11a7645c-c95d-4152-9bec-bc413a6c4914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:34.064977 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1108/2250] 10.222.0.43 () {58 vars in 1016 bytes} [Sat Aug 6 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:34.080681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:34.088309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7645c-c95d-4152-9bec-bc413a6c4914 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:34.090306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-11a7645c-c95d-4152-9bec-bc413a6c4914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:34.096994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e004c-1dce-4db4-aa40-df108a007a89 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:34.100553 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f663ae-3d59-4ffc-b845-3694c8332f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:34.101206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f663ae-3d59-4ffc-b845-3694c8332f41 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:34.101490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f663ae-3d59-4ffc-b845-3694c8332f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:34.101767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f663ae-3d59-4ffc-b845-3694c8332f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:34.116254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f663ae-3d59-4ffc-b845-3694c8332f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:34.117791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f663ae-3d59-4ffc-b845-3694c8332f41 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:34.130338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1143/2251] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:35:34.177065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7645c-c95d-4152-9bec-bc413a6c4914 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:34.184455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcedc01-8dba-4c8a-ace0-d77d1706568b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:34.185205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcedc01-8dba-4c8a-ace0-d77d1706568b service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:34.185489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcedc01-8dba-4c8a-ace0-d77d1706568b service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:34.185766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcedc01-8dba-4c8a-ace0-d77d1706568b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:34.195043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcedc01-8dba-4c8a-ace0-d77d1706568b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:34.197106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcedc01-8dba-4c8a-ace0-d77d1706568b service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:34.208492 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1109/2252] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:35:34.298647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b37233-d8d9-446b-92fb-f05a6189ebba None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:34.299526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b37233-d8d9-446b-92fb-f05a6189ebba None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:34.299809 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b37233-d8d9-446b-92fb-f05a6189ebba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:34.331301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-68b37233-d8d9-446b-92fb-f05a6189ebba None None] MFA Rules not processed for user `ada164ddadcb44da955c7360c5eeef54`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:34.333066 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-68b37233-d8d9-446b-92fb-f05a6189ebba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:34.403383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1144/2253] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:34.474736 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcedc01-8dba-4c8a-ace0-d77d1706568b service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:34.478266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-edcedc01-8dba-4c8a-ace0-d77d1706568b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:34.492249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcedc01-8dba-4c8a-ace0-d77d1706568b service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:34.497611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff44e31-f542-42ca-9b79-763e1f97d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:34.498252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff44e31-f542-42ca-9b79-763e1f97d4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:34.498535 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff44e31-f542-42ca-9b79-763e1f97d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:34.498813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff44e31-f542-42ca-9b79-763e1f97d4d2 admin admin] PATH_INFO: `/v3/projects/63772a4388364e08a840bc3f7623c285` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:34.499988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff44e31-f542-42ca-9b79-763e1f97d4d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63772a4388364e08a840bc3f7623c285)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:34.501929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff44e31-f542-42ca-9b79-763e1f97d4d2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:34.554498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5ff44e31-f542-42ca-9b79-763e1f97d4d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63772a4388364e08a840bc3f7623c285', 'request_id': 'req-5ff44e31-f542-42ca-9b79-763e1f97d4d2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:34.560454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5ff44e31-f542-42ca-9b79-763e1f97d4d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63772a4388364e08a840bc3f7623c285', 'request_id': 'req-5ff44e31-f542-42ca-9b79-763e1f97d4d2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:34.563174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:34.568705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5ff44e31-f542-42ca-9b79-763e1f97d4d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63772a4388364e08a840bc3f7623c285', 'request_id': 'req-5ff44e31-f542-42ca-9b79-763e1f97d4d2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:34.582885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5ff44e31-f542-42ca-9b79-763e1f97d4d2 admin admin] The token cache is being invalidate because project 63772a4388364e08a840bc3f7623c285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:35:34.583380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5ff44e31-f542-42ca-9b79-763e1f97d4d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:34.584047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5ff44e31-f542-42ca-9b79-763e1f97d4d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:35:34.585686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1110/2254] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:35:34 2022] DELETE /identity/v3/projects/63772a4388364e08a840bc3f7623c285 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:35:34.591389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c5ca-a76a-44d9-9b63-2d43e9a172b4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:34.591685 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c5ca-a76a-44d9-9b63-2d43e9a172b4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:34.591964 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c5ca-a76a-44d9-9b63-2d43e9a172b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:34.612031 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4216c5ca-a76a-44d9-9b63-2d43e9a172b4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:34.613304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4216c5ca-a76a-44d9-9b63-2d43e9a172b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:34.679239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1145/2255] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:34.687501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78a870-5e31-49b9-9cb7-14472e4e4ea2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:34.687816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78a870-5e31-49b9-9cb7-14472e4e4ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:34.688088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78a870-5e31-49b9-9cb7-14472e4e4ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:34.708223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8f78a870-5e31-49b9-9cb7-14472e4e4ea2 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:34.709560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8f78a870-5e31-49b9-9cb7-14472e4e4ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:34.718706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1111/2256] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:34.722515 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216c5ca-a76a-44d9-9b63-2d43e9a172b4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:34.733006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216c5ca-a76a-44d9-9b63-2d43e9a172b4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:34.737632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93353121-da2f-4c31-a255-c39582dee2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:34.738278 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93353121-da2f-4c31-a255-c39582dee2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:34.738565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93353121-da2f-4c31-a255-c39582dee2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:34.738843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93353121-da2f-4c31-a255-c39582dee2b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:34.739551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93353121-da2f-4c31-a255-c39582dee2b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:35:34.739870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93353121-da2f-4c31-a255-c39582dee2b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:34.741495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93353121-da2f-4c31-a255-c39582dee2b8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:34.753387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1146/2257] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:35:34.757745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78a870-5e31-49b9-9cb7-14472e4e4ea2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:34.767787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78a870-5e31-49b9-9cb7-14472e4e4ea2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:34.773091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa4e56-3f7f-433c-9a77-4fa8b4e4a517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:34.773813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa4e56-3f7f-433c-9a77-4fa8b4e4a517 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:34.774098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa4e56-3f7f-433c-9a77-4fa8b4e4a517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:34.774901 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa4e56-3f7f-433c-9a77-4fa8b4e4a517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:34.775898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa4e56-3f7f-433c-9a77-4fa8b4e4a517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:34.777841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa4e56-3f7f-433c-9a77-4fa8b4e4a517 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:34.815710 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1112/2258] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:35:34 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:35:34.819734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93353121-da2f-4c31-a255-c39582dee2b8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:34.830471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93353121-da2f-4c31-a255-c39582dee2b8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:34.890348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293d1e4-80aa-423e-ab28-12ac70b9b9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:34.890966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293d1e4-80aa-423e-ab28-12ac70b9b9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:34.891244 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293d1e4-80aa-423e-ab28-12ac70b9b9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:34.891516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293d1e4-80aa-423e-ab28-12ac70b9b9d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:34.892188 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293d1e4-80aa-423e-ab28-12ac70b9b9d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:34.894176 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293d1e4-80aa-423e-ab28-12ac70b9b9d0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:34.918941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1147/2259] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:35:34 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:35:34.922796 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa4e56-3f7f-433c-9a77-4fa8b4e4a517 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:34.934363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa4e56-3f7f-433c-9a77-4fa8b4e4a517 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:34.944745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e20e9-5021-49b0-a907-deb201ac042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:34.945404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e20e9-5021-49b0-a907-deb201ac042e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:34.945711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e20e9-5021-49b0-a907-deb201ac042e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:34.945991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e20e9-5021-49b0-a907-deb201ac042e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:34.947448 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e20e9-5021-49b0-a907-deb201ac042e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:34.949054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e20e9-5021-49b0-a907-deb201ac042e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:34.960934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1113/2260] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:35:34.963693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293d1e4-80aa-423e-ab28-12ac70b9b9d0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:34.971605 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:34.975843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293d1e4-80aa-423e-ab28-12ac70b9b9d0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:34.985716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848339eb-d7dc-492f-b963-3ba75a16d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:34.986352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848339eb-d7dc-492f-b963-3ba75a16d766 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:34.986633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848339eb-d7dc-492f-b963-3ba75a16d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:34.987012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848339eb-d7dc-492f-b963-3ba75a16d766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:34.987840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848339eb-d7dc-492f-b963-3ba75a16d766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:34.989539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848339eb-d7dc-492f-b963-3ba75a16d766 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:35.003716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1148/2261] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:35:35.007878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e20e9-5021-49b0-a907-deb201ac042e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:35.018693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e20e9-5021-49b0-a907-deb201ac042e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:35.024056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175402bd-c5d3-427c-9aa7-bac478f1123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:35.025291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175402bd-c5d3-427c-9aa7-bac478f1123e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:35.025569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175402bd-c5d3-427c-9aa7-bac478f1123e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:35.025839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175402bd-c5d3-427c-9aa7-bac478f1123e admin admin] PATH_INFO: `/v3/projects/706325c02bb34433bd826be0aa670a4a/users/e88105253dcc4c668780057047d42979/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:35.041712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175402bd-c5d3-427c-9aa7-bac478f1123e admin admin] RBAC: Authorizing `identity:create_grant(project_id=706325c02bb34433bd826be0aa670a4a, user_id=e88105253dcc4c668780057047d42979, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:35.044739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175402bd-c5d3-427c-9aa7-bac478f1123e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:35.058754 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1114/2262] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:35:35 2022] PUT /identity/v3/projects/706325c02bb34433bd826be0aa670a4a/users/e88105253dcc4c668780057047d42979/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:35:35.069271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a53d08-9de8-475e-adcf-c33774d0c4c1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:35.069395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a53d08-9de8-475e-adcf-c33774d0c4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:35.069663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a53d08-9de8-475e-adcf-c33774d0c4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:35.098971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f3a53d08-9de8-475e-adcf-c33774d0c4c1 None None] MFA Rules not processed for user `e88105253dcc4c668780057047d42979`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:35.100190 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f3a53d08-9de8-475e-adcf-c33774d0c4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:35.169202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1149/2263] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:35.180264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175402bd-c5d3-427c-9aa7-bac478f1123e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:35.182905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-175402bd-c5d3-427c-9aa7-bac478f1123e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:35.246494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175402bd-c5d3-427c-9aa7-bac478f1123e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:35.250247 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e4bc4-e9e3-43d4-abfa-dc63d78426a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:35.250877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e4bc4-e9e3-43d4-abfa-dc63d78426a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:35.251164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e4bc4-e9e3-43d4-abfa-dc63d78426a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:35.251442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e4bc4-e9e3-43d4-abfa-dc63d78426a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:35.260403 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e4bc4-e9e3-43d4-abfa-dc63d78426a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:35.261879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e4bc4-e9e3-43d4-abfa-dc63d78426a0 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:35.270984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1115/2264] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:35:36.640501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e56fce-639a-4821-b5a0-5e6d5d2b24fc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:36.641111 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e56fce-639a-4821-b5a0-5e6d5d2b24fc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:36.641111 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e56fce-639a-4821-b5a0-5e6d5d2b24fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:36.663803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-77e56fce-639a-4821-b5a0-5e6d5d2b24fc None None] MFA Rules not processed for user `e88105253dcc4c668780057047d42979`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:36.665060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-77e56fce-639a-4821-b5a0-5e6d5d2b24fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:36.671903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1150/2265] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:35:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:38.157119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881a26-3518-47d4-9418-2731b3f1334a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:38.157631 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881a26-3518-47d4-9418-2731b3f1334a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:38.157730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881a26-3518-47d4-9418-2731b3f1334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:38.177054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9b881a26-3518-47d4-9418-2731b3f1334a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:38.178261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9b881a26-3518-47d4-9418-2731b3f1334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:38.248628 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1116/2266] 10.222.0.43 () {58 vars in 1016 bytes} [Sat Aug 6 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:38.270157 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e56fce-639a-4821-b5a0-5e6d5d2b24fc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:38.272574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-77e56fce-639a-4821-b5a0-5e6d5d2b24fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:38.357024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e56fce-639a-4821-b5a0-5e6d5d2b24fc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:38.362988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41e9bf-cbf0-4ec6-a4bd-523d373aa389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:38.363624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41e9bf-cbf0-4ec6-a4bd-523d373aa389 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:38.363907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41e9bf-cbf0-4ec6-a4bd-523d373aa389 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:38.364178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41e9bf-cbf0-4ec6-a4bd-523d373aa389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:38.374589 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41e9bf-cbf0-4ec6-a4bd-523d373aa389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:38.376183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41e9bf-cbf0-4ec6-a4bd-523d373aa389 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:38.389079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1151/2267] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:35:43.382760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c0da8-f3b6-4437-9fc0-7c6029fdb558 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:43.383186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c0da8-f3b6-4437-9fc0-7c6029fdb558 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:43.383358 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c0da8-f3b6-4437-9fc0-7c6029fdb558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:43.402853 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ee1c0da8-f3b6-4437-9fc0-7c6029fdb558 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:43.404057 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ee1c0da8-f3b6-4437-9fc0-7c6029fdb558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:43.411811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1117/2268] 10.222.0.43 () {58 vars in 1016 bytes} [Sat Aug 6 01:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:43.434620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41e9bf-cbf0-4ec6-a4bd-523d373aa389 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:43.436065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-da41e9bf-cbf0-4ec6-a4bd-523d373aa389 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:43.450438 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41e9bf-cbf0-4ec6-a4bd-523d373aa389 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:43.456178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a350e-2ac2-4e8e-a6f8-573585ff807f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:43.456790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a350e-2ac2-4e8e-a6f8-573585ff807f service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:43.457106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a350e-2ac2-4e8e-a6f8-573585ff807f service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:43.457464 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a350e-2ac2-4e8e-a6f8-573585ff807f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:43.465850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a350e-2ac2-4e8e-a6f8-573585ff807f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:43.467423 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a350e-2ac2-4e8e-a6f8-573585ff807f service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:43.477627 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1152/2269] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:35:53.397510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=1,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:53.472664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=78 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:35:53.801078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ee800-854d-4ebe-a107-00fea8fb5026 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:53.801374 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ee800-854d-4ebe-a107-00fea8fb5026 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:53.801658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ee800-854d-4ebe-a107-00fea8fb5026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:53.841579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e99ee800-854d-4ebe-a107-00fea8fb5026 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:35:53.842820 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e99ee800-854d-4ebe-a107-00fea8fb5026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:35:53.861239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1118/2270] 10.222.0.43 () {58 vars in 1016 bytes} [Sat Aug 6 01:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:35:53.884994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a350e-2ac2-4e8e-a6f8-573585ff807f service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:35:53.896627 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a350e-2ac2-4e8e-a6f8-573585ff807f service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:35:53.905720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc68391-b389-4fcc-baf5-1ef1476fd4af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:35:53.906686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68391-b389-4fcc-baf5-1ef1476fd4af service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:35:53.907165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68391-b389-4fcc-baf5-1ef1476fd4af service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:35:53.907588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68391-b389-4fcc-baf5-1ef1476fd4af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:35:53.918523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc68391-b389-4fcc-baf5-1ef1476fd4af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:35:53.920752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc68391-b389-4fcc-baf5-1ef1476fd4af service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:35:53.938125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1153/2271] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:36:00.954186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ee800-854d-4ebe-a107-00fea8fb5026 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:00.955546 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e99ee800-854d-4ebe-a107-00fea8fb5026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:01.054450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ee800-854d-4ebe-a107-00fea8fb5026 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:01.060451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ee531-c915-4151-a2f9-b1ab5b6e04c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:01.061117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee531-c915-4151-a2f9-b1ab5b6e04c8 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:01.061398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee531-c915-4151-a2f9-b1ab5b6e04c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:01.061673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ee531-c915-4151-a2f9-b1ab5b6e04c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:01.063469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-108ee531-c915-4151-a2f9-b1ab5b6e04c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:01.076446 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ee531-c915-4151-a2f9-b1ab5b6e04c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:01.078067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ee531-c915-4151-a2f9-b1ab5b6e04c8 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:01.089017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1119/2272] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:36:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:36:03.932422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:07.202768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ed9de-6c75-4898-a53e-9f0a211ab940 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:07.203347 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ed9de-6c75-4898-a53e-9f0a211ab940 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:07.203347 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ed9de-6c75-4898-a53e-9f0a211ab940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:07.223109 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-479ed9de-6c75-4898-a53e-9f0a211ab940 None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:07.224303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-479ed9de-6c75-4898-a53e-9f0a211ab940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:07.279308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1154/2273] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:36:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:07.320580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ee531-c915-4151-a2f9-b1ab5b6e04c8 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:07.322043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-108ee531-c915-4151-a2f9-b1ab5b6e04c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:07.394161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ee531-c915-4151-a2f9-b1ab5b6e04c8 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:07.399069 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f2366-53fa-47c6-b53b-4902252c5b29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:07.399683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f2366-53fa-47c6-b53b-4902252c5b29 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:07.399960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f2366-53fa-47c6-b53b-4902252c5b29 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:07.400259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f2366-53fa-47c6-b53b-4902252c5b29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:07.408255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f2366-53fa-47c6-b53b-4902252c5b29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:07.409969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f2366-53fa-47c6-b53b-4902252c5b29 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:07.420643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1120/2274] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:36:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:36:13.147599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aff9b-57f5-45ca-b8f0-eacfe500a475 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:13.148542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aff9b-57f5-45ca-b8f0-eacfe500a475 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:13.148828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aff9b-57f5-45ca-b8f0-eacfe500a475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:13.171192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-cb0aff9b-57f5-45ca-b8f0-eacfe500a475 None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:13.172494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cb0aff9b-57f5-45ca-b8f0-eacfe500a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:13.180425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1155/2275] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:36:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:13.199110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f2366-53fa-47c6-b53b-4902252c5b29 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:13.210652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f2366-53fa-47c6-b53b-4902252c5b29 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:13.217716 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9488b-36c1-43d2-a7ee-37c1c513708b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:13.218639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9488b-36c1-43d2-a7ee-37c1c513708b service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:13.218993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9488b-36c1-43d2-a7ee-37c1c513708b service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:13.219342 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9488b-36c1-43d2-a7ee-37c1c513708b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:13.230192 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9488b-36c1-43d2-a7ee-37c1c513708b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:13.232070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9488b-36c1-43d2-a7ee-37c1c513708b service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:13.245700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1121/2276] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:36:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:36:14.129072 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f710e-b214-4e72-b318-bc286548d1a4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:14.129387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f710e-b214-4e72-b318-bc286548d1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:14.129719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f710e-b214-4e72-b318-bc286548d1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:14.153418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6e8f710e-b214-4e72-b318-bc286548d1a4 None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:14.155156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6e8f710e-b214-4e72-b318-bc286548d1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:14.174738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1156/2277] 10.222.0.15 () {58 vars in 967 bytes} [Sat Aug 6 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:14.199543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9488b-36c1-43d2-a7ee-37c1c513708b service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:14.210540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9488b-36c1-43d2-a7ee-37c1c513708b service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:14.217167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec5d3f-6cc6-4b9d-b3d5-d1db9392b399 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:14.218035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec5d3f-6cc6-4b9d-b3d5-d1db9392b399 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:14.218389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec5d3f-6cc6-4b9d-b3d5-d1db9392b399 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:14.218668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec5d3f-6cc6-4b9d-b3d5-d1db9392b399 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:14.235193 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec5d3f-6cc6-4b9d-b3d5-d1db9392b399 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:14.236884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec5d3f-6cc6-4b9d-b3d5-d1db9392b399 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:14.260202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1122/2278] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:36:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 01:36:14.665051 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f78d34-57bb-409f-9800-a61c7b16d08b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:14.665742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f78d34-57bb-409f-9800-a61c7b16d08b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:14.666905 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f78d34-57bb-409f-9800-a61c7b16d08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:14.691815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-91f78d34-57bb-409f-9800-a61c7b16d08b None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:14.693553 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-91f78d34-57bb-409f-9800-a61c7b16d08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:14.701140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1157/2279] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:14.732117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec5d3f-6cc6-4b9d-b3d5-d1db9392b399 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:14.747659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec5d3f-6cc6-4b9d-b3d5-d1db9392b399 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:14.753476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5004ac1-021d-4c18-a43b-b0c080b074cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:14.754303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5004ac1-021d-4c18-a43b-b0c080b074cb service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:14.754747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5004ac1-021d-4c18-a43b-b0c080b074cb service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:14.755336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5004ac1-021d-4c18-a43b-b0c080b074cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:14.767081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5004ac1-021d-4c18-a43b-b0c080b074cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:14.769991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5004ac1-021d-4c18-a43b-b0c080b074cb service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:14.788204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1123/2280] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:36:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:36:15.306776 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189453bd-9aaf-4eca-8e39-57afb80d525b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:15.307417 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189453bd-9aaf-4eca-8e39-57afb80d525b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:15.308006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189453bd-9aaf-4eca-8e39-57afb80d525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:15.336883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-189453bd-9aaf-4eca-8e39-57afb80d525b None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:15.339245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-189453bd-9aaf-4eca-8e39-57afb80d525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:15.349806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1158/2281] 10.222.0.15 () {58 vars in 967 bytes} [Sat Aug 6 01:36:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:36:15.368645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5004ac1-021d-4c18-a43b-b0c080b074cb service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:15.391874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5004ac1-021d-4c18-a43b-b0c080b074cb service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:15.398976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a2a57-3839-4694-acdc-d25211fdbd66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:15.399782 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a2a57-3839-4694-acdc-d25211fdbd66 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:15.400752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a2a57-3839-4694-acdc-d25211fdbd66 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:15.402123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a2a57-3839-4694-acdc-d25211fdbd66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:15.414715 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a2a57-3839-4694-acdc-d25211fdbd66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:15.418204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a2a57-3839-4694-acdc-d25211fdbd66 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:15.429052 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1124/2282] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:36:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:36:18.195405 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa1e21-ebf4-4b5d-9a93-e887192ada54 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:18.196613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa1e21-ebf4-4b5d-9a93-e887192ada54 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:18.197046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa1e21-ebf4-4b5d-9a93-e887192ada54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:18.223822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a2a57-3839-4694-acdc-d25211fdbd66 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:18.242457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a2a57-3839-4694-acdc-d25211fdbd66 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:18.247922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:18.248823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:18.249302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:18.250047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] PATH_INFO: `/v3/users/e88105253dcc4c668780057047d42979` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:18.251508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-99aa1e21-ebf4-4b5d-9a93-e887192ada54 None None] MFA Rules not processed for user `e9f545fde2d94e03b9b8336f53122177`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:18.251929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88105253dcc4c668780057047d42979)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:18.253433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-99aa1e21-ebf4-4b5d-9a93-e887192ada54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:18.255384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:18.277291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:18.342860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88105253dcc4c668780057047d42979'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:18.352263 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88105253dcc4c668780057047d42979'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:18.363411 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1159/2283] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:36:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:18.386476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88105253dcc4c668780057047d42979'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:18.387627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88105253dcc4c668780057047d42979'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:18.388764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88105253dcc4c668780057047d42979'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:18.418586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1125/2284] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:36:18 2022] DELETE /identity/v3/users/e88105253dcc4c668780057047d42979 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:36:18.422762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558dab7-a315-40a7-b09e-0515336d5723 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:18.423057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558dab7-a315-40a7-b09e-0515336d5723 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:18.423338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558dab7-a315-40a7-b09e-0515336d5723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:18.443518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6558dab7-a315-40a7-b09e-0515336d5723 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:18.444730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6558dab7-a315-40a7-b09e-0515336d5723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:18.545959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1160/2285] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:18.561916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:18.563514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:18.644108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49960b0b-120c-4ff1-857b-117f89dbe770 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:18.651566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56feec9-db1a-4771-9871-f7008fe573ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:18.652588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56feec9-db1a-4771-9871-f7008fe573ff service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:18.653049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56feec9-db1a-4771-9871-f7008fe573ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:18.653561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56feec9-db1a-4771-9871-f7008fe573ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:18.663466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56feec9-db1a-4771-9871-f7008fe573ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:18.665942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56feec9-db1a-4771-9871-f7008fe573ff service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:18.678282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1126/2286] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:36:18.979957 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558dab7-a315-40a7-b09e-0515336d5723 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:18.982214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6558dab7-a315-40a7-b09e-0515336d5723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:18.999103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558dab7-a315-40a7-b09e-0515336d5723 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:19.005761 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:19.006687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:19.007765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:19.008207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6 admin admin] PATH_INFO: `/v3/projects/706325c02bb34433bd826be0aa670a4a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:19.010198 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706325c02bb34433bd826be0aa670a4a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:19.013378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:19.044971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:19.081444 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706325c02bb34433bd826be0aa670a4a', 'request_id': 'req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:19.088706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706325c02bb34433bd826be0aa670a4a', 'request_id': 'req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:19.101374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706325c02bb34433bd826be0aa670a4a', 'request_id': 'req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:19.120933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6 admin admin] The token cache is being invalidate because project 706325c02bb34433bd826be0aa670a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:36:19.121331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:19.122473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05eb2d3b-0a0a-4d4a-b975-097b199b8db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:19.124360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1161/2287] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:36:18 2022] DELETE /identity/v3/projects/706325c02bb34433bd826be0aa670a4a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:36:19.589540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda8b04-b330-4294-8298-b2bedd05447f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:19.590092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda8b04-b330-4294-8298-b2bedd05447f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:19.590092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda8b04-b330-4294-8298-b2bedd05447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:19.614343 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-afda8b04-b330-4294-8298-b2bedd05447f None None] MFA Rules not processed for user `7fc6d933ef05408b8681a08de7b2b4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:19.616011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-afda8b04-b330-4294-8298-b2bedd05447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:19.713517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1127/2288] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:36:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:26.046202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d9d9e-65f9-4877-808a-8701dbe0078d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:26.046755 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d9d9e-65f9-4877-808a-8701dbe0078d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:26.046853 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d9d9e-65f9-4877-808a-8701dbe0078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:26.067412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-983d9d9e-65f9-4877-808a-8701dbe0078d None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:26.068627 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-983d9d9e-65f9-4877-808a-8701dbe0078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:26.126419 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1162/2289] 10.222.0.15 () {58 vars in 967 bytes} [Sat Aug 6 01:36:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:36:26.139727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda8b04-b330-4294-8298-b2bedd05447f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:26.141304 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-afda8b04-b330-4294-8298-b2bedd05447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:26.184888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:26.212653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda8b04-b330-4294-8298-b2bedd05447f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:26.217881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bef90-668e-4eb9-963e-02ce0f16df8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:26.218606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bef90-668e-4eb9-963e-02ce0f16df8e service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:26.218895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bef90-668e-4eb9-963e-02ce0f16df8e service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:26.219174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bef90-668e-4eb9-963e-02ce0f16df8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:26.227482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bef90-668e-4eb9-963e-02ce0f16df8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:26.229624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bef90-668e-4eb9-963e-02ce0f16df8e service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:26.237733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1128/2290] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:36:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:36:28.722108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d9d9e-65f9-4877-808a-8701dbe0078d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:28.724246 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-983d9d9e-65f9-4877-808a-8701dbe0078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:28.819013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d9d9e-65f9-4877-808a-8701dbe0078d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:28.824651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ec08c-aaf3-4e24-9a8d-462485d33559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:28.825712 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec08c-aaf3-4e24-9a8d-462485d33559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:28.826688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec08c-aaf3-4e24-9a8d-462485d33559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:28.827127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec08c-aaf3-4e24-9a8d-462485d33559 admin admin] PATH_INFO: `/v3/users/ada164ddadcb44da955c7360c5eeef54` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:28.828508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ec08c-aaf3-4e24-9a8d-462485d33559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada164ddadcb44da955c7360c5eeef54)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:28.830637 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ec08c-aaf3-4e24-9a8d-462485d33559 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:28.888215 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bb6ec08c-aaf3-4e24-9a8d-462485d33559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada164ddadcb44da955c7360c5eeef54'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:28.894398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:28.903758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bb6ec08c-aaf3-4e24-9a8d-462485d33559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada164ddadcb44da955c7360c5eeef54'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:28.904557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bb6ec08c-aaf3-4e24-9a8d-462485d33559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada164ddadcb44da955c7360c5eeef54'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:28.905249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bb6ec08c-aaf3-4e24-9a8d-462485d33559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada164ddadcb44da955c7360c5eeef54'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:28.914250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bb6ec08c-aaf3-4e24-9a8d-462485d33559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada164ddadcb44da955c7360c5eeef54'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:28.929699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1163/2291] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:36:28 2022] DELETE /identity/v3/users/ada164ddadcb44da955c7360c5eeef54 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:36:29.150969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bef90-668e-4eb9-963e-02ce0f16df8e service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:29.169699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bef90-668e-4eb9-963e-02ce0f16df8e service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:29.254613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:29.255270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:29.255556 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:29.256194 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] PATH_INFO: `/v3/projects/54a54142f064443e961f2e6519d2392d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:29.257469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a54142f064443e961f2e6519d2392d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:29.259871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:29.316140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a54142f064443e961f2e6519d2392d', 'request_id': 'req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:29.324240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a54142f064443e961f2e6519d2392d', 'request_id': 'req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:29.331781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a54142f064443e961f2e6519d2392d', 'request_id': 'req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:29.346170 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] The token cache is being invalidate because project 54a54142f064443e961f2e6519d2392d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:36:29.346459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:29.347101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:36:29.348633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1129/2292] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:36:29 2022] DELETE /identity/v3/projects/54a54142f064443e961f2e6519d2392d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:36:37.607943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6f0cc-99c8-47e3-889b-8c92796f8c52 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:37.608459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6f0cc-99c8-47e3-889b-8c92796f8c52 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:37.608545 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6f0cc-99c8-47e3-889b-8c92796f8c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:37.629636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-50f6f0cc-99c8-47e3-889b-8c92796f8c52 None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:37.630848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-50f6f0cc-99c8-47e3-889b-8c92796f8c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:37.698033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1164/2293] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:37.713474 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:37.719207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:37.794897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:37.802407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f7e5b-1f70-47b1-ae7f-afdbc2c238c4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:37.809881 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49185-5015-49de-be83-10051c29f45b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:37.810648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49185-5015-49de-be83-10051c29f45b service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:37.811296 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49185-5015-49de-be83-10051c29f45b service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:37.811957 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49185-5015-49de-be83-10051c29f45b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:37.821979 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b49185-5015-49de-be83-10051c29f45b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:37.823608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b49185-5015-49de-be83-10051c29f45b service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:37.832105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1130/2294] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:36:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:36:45.155771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ce344-5d7a-426d-9536-79310e426ba9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:45.156348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ce344-5d7a-426d-9536-79310e426ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:45.156348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ce344-5d7a-426d-9536-79310e426ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:45.183108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-749ce344-5d7a-426d-9536-79310e426ba9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:45.184513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-749ce344-5d7a-426d-9536-79310e426ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:45.265837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1165/2295] 10.222.0.43 () {58 vars in 1016 bytes} [Sat Aug 6 01:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:45.288639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49185-5015-49de-be83-10051c29f45b service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:45.290223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a8b49185-5015-49de-be83-10051c29f45b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:45.387022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b49185-5015-49de-be83-10051c29f45b service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:45.393294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8db21-7a0a-4702-9be6-702d847f551e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:45.394153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8db21-7a0a-4702-9be6-702d847f551e service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:45.394764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8db21-7a0a-4702-9be6-702d847f551e service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:45.395108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8db21-7a0a-4702-9be6-702d847f551e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:45.407624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8db21-7a0a-4702-9be6-702d847f551e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:45.410176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8db21-7a0a-4702-9be6-702d847f551e service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:45.424969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1131/2296] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:36:49.442147 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ead5d-accd-488b-918f-40a20b32280e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:49.442734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ead5d-accd-488b-918f-40a20b32280e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:49.442847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ead5d-accd-488b-918f-40a20b32280e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:49.464169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-581ead5d-accd-488b-918f-40a20b32280e None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:49.465415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-581ead5d-accd-488b-918f-40a20b32280e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:49.473258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1166/2297] 10.222.0.43 () {58 vars in 1016 bytes} [Sat Aug 6 01:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:49.494205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8db21-7a0a-4702-9be6-702d847f551e service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:49.495791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c0c8db21-7a0a-4702-9be6-702d847f551e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:49.511654 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8db21-7a0a-4702-9be6-702d847f551e service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:49.517481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79416d0e-a588-4b95-a3e9-ea32f3262425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:49.518126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416d0e-a588-4b95-a3e9-ea32f3262425 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:49.518404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416d0e-a588-4b95-a3e9-ea32f3262425 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:49.518678 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79416d0e-a588-4b95-a3e9-ea32f3262425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:49.527980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79416d0e-a588-4b95-a3e9-ea32f3262425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:49.529641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79416d0e-a588-4b95-a3e9-ea32f3262425 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:49.540495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1132/2298] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:36:54.534546 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0b6c6-9d5b-46a6-a188-b07139b5b87d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:54.535135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0b6c6-9d5b-46a6-a188-b07139b5b87d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:54.535244 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0b6c6-9d5b-46a6-a188-b07139b5b87d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:54.536566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1167/2299] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:36:54.543527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeb803-7973-4f3d-9a32-527e3d7b6956 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:54.544023 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeb803-7973-4f3d-9a32-527e3d7b6956 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:54.544284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeb803-7973-4f3d-9a32-527e3d7b6956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:54.566708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-74aeb803-7973-4f3d-9a32-527e3d7b6956 None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:54.567959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-74aeb803-7973-4f3d-9a32-527e3d7b6956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:54.578357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1133/2300] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:54.591199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0b6c6-9d5b-46a6-a188-b07139b5b87d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:54.593113 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2cb0b6c6-9d5b-46a6-a188-b07139b5b87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:54.654598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0b6c6-9d5b-46a6-a188-b07139b5b87d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:54.658591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c817d-c746-4120-b50b-748a6932fb8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da39170a654d4d52a39b4b2c8cfd8906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:54.658701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c817d-c746-4120-b50b-748a6932fb8c service glance] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:54.658998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c817d-c746-4120-b50b-748a6932fb8c service glance] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:54.659270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c817d-c746-4120-b50b-748a6932fb8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:54.669769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c817d-c746-4120-b50b-748a6932fb8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:54.671180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c817d-c746-4120-b50b-748a6932fb8c service glance] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:54.682547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1168/2301] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:36:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:36:54.751911 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bbdfd-414a-4b95-bca9-e957ed0aaa50 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:54.752119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bbdfd-414a-4b95-bca9-e957ed0aaa50 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:54.752400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bbdfd-414a-4b95-bca9-e957ed0aaa50 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:54.753887 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1134/2302] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:36:54.760286 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b394244-79fc-46b4-8ff3-eaf4647d13b5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:54.760573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b394244-79fc-46b4-8ff3-eaf4647d13b5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:54.760850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b394244-79fc-46b4-8ff3-eaf4647d13b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:54.780734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3b394244-79fc-46b4-8ff3-eaf4647d13b5 None None] MFA Rules not processed for user `403beb9eb6c04cc69579361138bea12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:54.781979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3b394244-79fc-46b4-8ff3-eaf4647d13b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:54.791327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:36:54.836481 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1169/2303] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:54.848741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bbdfd-414a-4b95-bca9-e957ed0aaa50 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:54.850707 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-604bbdfd-414a-4b95-bca9-e957ed0aaa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:54.871897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bbdfd-414a-4b95-bca9-e957ed0aaa50 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:54.875441 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b9ddb-65cc-4b60-8d2d-9bd376f65cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:54.876054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b9ddb-65cc-4b60-8d2d-9bd376f65cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:54.876339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b9ddb-65cc-4b60-8d2d-9bd376f65cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:54.876612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b9ddb-65cc-4b60-8d2d-9bd376f65cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:54.884608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b9ddb-65cc-4b60-8d2d-9bd376f65cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:54.886043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b9ddb-65cc-4b60-8d2d-9bd376f65cc5 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:54.893609 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1135/2304] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:36:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:36:54.981828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443d6f-9966-46f7-81d1-7d2c96af32c9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:54.982118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443d6f-9966-46f7-81d1-7d2c96af32c9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:54.982391 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443d6f-9966-46f7-81d1-7d2c96af32c9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:54.983776 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1170/2305] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:36:54.989257 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459c327-8968-4a93-a703-266191e3d953 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:54.989688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459c327-8968-4a93-a703-266191e3d953 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:54.989823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459c327-8968-4a93-a703-266191e3d953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:55.014145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a459c327-8968-4a93-a703-266191e3d953 None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:55.015267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a459c327-8968-4a93-a703-266191e3d953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:55.025350 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1136/2306] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:55.036242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4443d6f-9966-46f7-81d1-7d2c96af32c9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:55.038187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e4443d6f-9966-46f7-81d1-7d2c96af32c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:55.052355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4443d6f-9966-46f7-81d1-7d2c96af32c9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:55.056870 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18a4eb-5949-4608-bfc0-490d45a0aca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:55.057504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18a4eb-5949-4608-bfc0-490d45a0aca6 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:55.057787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18a4eb-5949-4608-bfc0-490d45a0aca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:55.058063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18a4eb-5949-4608-bfc0-490d45a0aca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:55.068014 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18a4eb-5949-4608-bfc0-490d45a0aca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:55.069473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18a4eb-5949-4608-bfc0-490d45a0aca6 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:55.080421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1171/2307] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:36:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:36:55.654595 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd96b85-b6de-49d8-8c91-4d94fe077fe2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:55.655090 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd96b85-b6de-49d8-8c91-4d94fe077fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:55.655196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd96b85-b6de-49d8-8c91-4d94fe077fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:55.674496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cdd96b85-b6de-49d8-8c91-4d94fe077fe2 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:55.675680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cdd96b85-b6de-49d8-8c91-4d94fe077fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:55.684332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1137/2308] 10.222.0.43 () {58 vars in 1016 bytes} [Sat Aug 6 01:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:55.709257 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18a4eb-5949-4608-bfc0-490d45a0aca6 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:55.720523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18a4eb-5949-4608-bfc0-490d45a0aca6 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:55.726011 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3860c9-f09f-4fd3-9b25-4c81a49382c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:55.726680 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3860c9-f09f-4fd3-9b25-4c81a49382c2 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:55.727113 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3860c9-f09f-4fd3-9b25-4c81a49382c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:55.728134 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3860c9-f09f-4fd3-9b25-4c81a49382c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:55.736619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3860c9-f09f-4fd3-9b25-4c81a49382c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:55.738319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3860c9-f09f-4fd3-9b25-4c81a49382c2 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:55.748837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1172/2309] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:36:59.861567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a82386-ba53-4994-8121-dd3a9a48bc87 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:59.862126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a82386-ba53-4994-8121-dd3a9a48bc87 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:59.862126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a82386-ba53-4994-8121-dd3a9a48bc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:59.883027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f7a82386-ba53-4994-8121-dd3a9a48bc87 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:36:59.885558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f7a82386-ba53-4994-8121-dd3a9a48bc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:36:59.893638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1138/2310] 10.222.0.43 () {58 vars in 1016 bytes} [Sat Aug 6 01:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:36:59.935893 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3860c9-f09f-4fd3-9b25-4c81a49382c2 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:36:59.952528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3860c9-f09f-4fd3-9b25-4c81a49382c2 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:36:59.958619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceeef43-12b1-4643-bea6-94c7fa42cd50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:36:59.959305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeef43-12b1-4643-bea6-94c7fa42cd50 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:36:59.959655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeef43-12b1-4643-bea6-94c7fa42cd50 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:36:59.959996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeef43-12b1-4643-bea6-94c7fa42cd50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:36:59.969691 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceeef43-12b1-4643-bea6-94c7fa42cd50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:36:59.971569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceeef43-12b1-4643-bea6-94c7fa42cd50 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:36:59.982121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1173/2311] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:37:01.863854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337e8df-2006-440c-b980-8c68328dc602 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:37:01.864305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337e8df-2006-440c-b980-8c68328dc602 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:37:01.864404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337e8df-2006-440c-b980-8c68328dc602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:37:01.884454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0337e8df-2006-440c-b980-8c68328dc602 None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:37:01.885703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0337e8df-2006-440c-b980-8c68328dc602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:37:01.893120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1139/2312] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:37:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:37:01.905344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceeef43-12b1-4643-bea6-94c7fa42cd50 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:37:01.917912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceeef43-12b1-4643-bea6-94c7fa42cd50 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:37:01.922973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a903e-3ad1-4da3-9450-52ea17628a1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:37:01.923593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a903e-3ad1-4da3-9450-52ea17628a1f service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:37:01.923874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a903e-3ad1-4da3-9450-52ea17628a1f service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:37:01.924150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a903e-3ad1-4da3-9450-52ea17628a1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:37:01.933451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a903e-3ad1-4da3-9450-52ea17628a1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:37:01.935032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a903e-3ad1-4da3-9450-52ea17628a1f service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:37:01.943225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1174/2313] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:37:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:37:11.878652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=66 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:11.939863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=41 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:18.501505 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3454f-a1e0-43ce-bec1-705ca5553003 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:37:18.502037 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3454f-a1e0-43ce-bec1-705ca5553003 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:37:18.502037 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3454f-a1e0-43ce-bec1-705ca5553003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:37:18.521529 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-baf3454f-a1e0-43ce-bec1-705ca5553003 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:37:18.522742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-baf3454f-a1e0-43ce-bec1-705ca5553003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:37:18.531341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1140/2314] 10.222.0.43 () {58 vars in 1016 bytes} [Sat Aug 6 01:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:37:18.553777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a903e-3ad1-4da3-9450-52ea17628a1f service swift] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:37:18.565954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a903e-3ad1-4da3-9450-52ea17628a1f service swift] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:37:18.571358 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53036eeb-28a8-485d-acec-9462030189f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:37:18.571948 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53036eeb-28a8-485d-acec-9462030189f4 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:37:18.572226 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53036eeb-28a8-485d-acec-9462030189f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:37:18.572499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53036eeb-28a8-485d-acec-9462030189f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:37:18.580436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53036eeb-28a8-485d-acec-9462030189f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:37:18.582005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53036eeb-28a8-485d-acec-9462030189f4 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:37:18.591644 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1175/2315] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:37:28.360691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691af2-9b99-44fc-802e-0931597e49c2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:37:28.361218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691af2-9b99-44fc-802e-0931597e49c2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:37:28.361334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691af2-9b99-44fc-802e-0931597e49c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:37:28.380469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-68691af2-9b99-44fc-802e-0931597e49c2 None None] MFA Rules not processed for user `02a1682847df4bd99bf09c8216a44850`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:37:28.381680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-68691af2-9b99-44fc-802e-0931597e49c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:37:28.436697 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1141/2316] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:37:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:37:28.587581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:28.938498 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a893cd-b5f5-4482-baff-bf6e8b69ef0b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:37:28.938788 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a893cd-b5f5-4482-baff-bf6e8b69ef0b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:37:28.939070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a893cd-b5f5-4482-baff-bf6e8b69ef0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:37:28.957902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-75a893cd-b5f5-4482-baff-bf6e8b69ef0b None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:37:28.959094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-75a893cd-b5f5-4482-baff-bf6e8b69ef0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:37:28.967034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1176/2317] 10.222.0.15 () {58 vars in 967 bytes} [Sat Aug 6 01:37:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:37:28.990056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691af2-9b99-44fc-802e-0931597e49c2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:37:29.002815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691af2-9b99-44fc-802e-0931597e49c2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:37:29.010017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7003b54-e382-4deb-9458-5800ca63ec31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:37:29.011976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7003b54-e382-4deb-9458-5800ca63ec31 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:37:29.011976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7003b54-e382-4deb-9458-5800ca63ec31 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:37:29.011976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7003b54-e382-4deb-9458-5800ca63ec31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:37:29.020831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7003b54-e382-4deb-9458-5800ca63ec31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:37:29.023341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7003b54-e382-4deb-9458-5800ca63ec31 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:37:29.033501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1142/2318] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:37:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:37:38.953266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:39.029804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=34 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:37:51.985336 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a893cd-b5f5-4482-baff-bf6e8b69ef0b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:37:51.986727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-75a893cd-b5f5-4482-baff-bf6e8b69ef0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:37:52.043855 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a893cd-b5f5-4482-baff-bf6e8b69ef0b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:37:52.047601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41477af2-025a-4dbf-ad9b-b208ec4f56a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:37:52.048221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477af2-025a-4dbf-ad9b-b208ec4f56a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:37:52.048505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477af2-025a-4dbf-ad9b-b208ec4f56a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:37:52.048780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477af2-025a-4dbf-ad9b-b208ec4f56a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:37:52.050585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-41477af2-025a-4dbf-ad9b-b208ec4f56a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:37:52.064803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41477af2-025a-4dbf-ad9b-b208ec4f56a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:37:52.066264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41477af2-025a-4dbf-ad9b-b208ec4f56a9 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:37:52.078114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1177/2319] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:37:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:37:54.682404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7003b54-e382-4deb-9458-5800ca63ec31 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:37:54.691583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7003b54-e382-4deb-9458-5800ca63ec31 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:37:54.695261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807607f-e8e1-4bf8-b726-012eaf47cefa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:37:54.695784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807607f-e8e1-4bf8-b726-012eaf47cefa service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:37:54.696063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807607f-e8e1-4bf8-b726-012eaf47cefa service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:37:54.696778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807607f-e8e1-4bf8-b726-012eaf47cefa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:37:54.698952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c807607f-e8e1-4bf8-b726-012eaf47cefa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:37:54.713049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807607f-e8e1-4bf8-b726-012eaf47cefa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:37:54.714531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807607f-e8e1-4bf8-b726-012eaf47cefa service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:37:54.725565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1143/2320] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:37:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:00.370015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41477af2-025a-4dbf-ad9b-b208ec4f56a9 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:00.371604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-41477af2-025a-4dbf-ad9b-b208ec4f56a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:00.387628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41477af2-025a-4dbf-ad9b-b208ec4f56a9 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:00.393812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8cfbe-a5ff-4ce0-85f2-62e3364af219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:00.394628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8cfbe-a5ff-4ce0-85f2-62e3364af219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:00.395071 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8cfbe-a5ff-4ce0-85f2-62e3364af219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:00.395511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8cfbe-a5ff-4ce0-85f2-62e3364af219 admin admin] PATH_INFO: `/v3/users/7fc6d933ef05408b8681a08de7b2b4c8` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:00.396811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8cfbe-a5ff-4ce0-85f2-62e3364af219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc6d933ef05408b8681a08de7b2b4c8)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:00.399005 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8cfbe-a5ff-4ce0-85f2-62e3364af219 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:00.444452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-46e8cfbe-a5ff-4ce0-85f2-62e3364af219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc6d933ef05408b8681a08de7b2b4c8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:38:00.456604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-46e8cfbe-a5ff-4ce0-85f2-62e3364af219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc6d933ef05408b8681a08de7b2b4c8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:38:00.457292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-46e8cfbe-a5ff-4ce0-85f2-62e3364af219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc6d933ef05408b8681a08de7b2b4c8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:38:00.457897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-46e8cfbe-a5ff-4ce0-85f2-62e3364af219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc6d933ef05408b8681a08de7b2b4c8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:38:00.466425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-46e8cfbe-a5ff-4ce0-85f2-62e3364af219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc6d933ef05408b8681a08de7b2b4c8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:38:00.478491 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1178/2321] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:38:00 2022] DELETE /identity/v3/users/7fc6d933ef05408b8681a08de7b2b4c8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:38:00.651321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807607f-e8e1-4bf8-b726-012eaf47cefa service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:00.663058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807607f-e8e1-4bf8-b726-012eaf47cefa service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:00.729842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb8d93-9ef8-4929-8e42-1565edc589bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:00.730487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb8d93-9ef8-4929-8e42-1565edc589bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:00.730771 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb8d93-9ef8-4929-8e42-1565edc589bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:00.731047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb8d93-9ef8-4929-8e42-1565edc589bd admin admin] PATH_INFO: `/v3/projects/5b9e2d0636404622949975c57f76780d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:00.732252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb8d93-9ef8-4929-8e42-1565edc589bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9e2d0636404622949975c57f76780d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:00.734128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb8d93-9ef8-4929-8e42-1565edc589bd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:00.779766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fedb8d93-9ef8-4929-8e42-1565edc589bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9e2d0636404622949975c57f76780d', 'request_id': 'req-fedb8d93-9ef8-4929-8e42-1565edc589bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:38:00.785240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fedb8d93-9ef8-4929-8e42-1565edc589bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9e2d0636404622949975c57f76780d', 'request_id': 'req-fedb8d93-9ef8-4929-8e42-1565edc589bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:38:00.792477 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fedb8d93-9ef8-4929-8e42-1565edc589bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9e2d0636404622949975c57f76780d', 'request_id': 'req-fedb8d93-9ef8-4929-8e42-1565edc589bd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:38:00.803322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fedb8d93-9ef8-4929-8e42-1565edc589bd admin admin] The token cache is being invalidate because project 5b9e2d0636404622949975c57f76780d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:38:00.803624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fedb8d93-9ef8-4929-8e42-1565edc589bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:38:00.804249 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fedb8d93-9ef8-4929-8e42-1565edc589bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:38:00.805793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1144/2322] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:38:00 2022] DELETE /identity/v3/projects/5b9e2d0636404622949975c57f76780d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:38:00.811426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45901ca-0caf-4466-ba46-eb070e397d07 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:00.811719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45901ca-0caf-4466-ba46-eb070e397d07 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:00.812001 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45901ca-0caf-4466-ba46-eb070e397d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:00.831966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a45901ca-0caf-4466-ba46-eb070e397d07 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:38:00.833192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a45901ca-0caf-4466-ba46-eb070e397d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:00.891150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1179/2323] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:38:00.899021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1cdff-85b3-4e22-8c83-ec1ed0ed0927 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:00.899301 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1cdff-85b3-4e22-8c83-ec1ed0ed0927 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:00.899571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1cdff-85b3-4e22-8c83-ec1ed0ed0927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:00.919144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3ba1cdff-85b3-4e22-8c83-ec1ed0ed0927 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:38:00.920368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3ba1cdff-85b3-4e22-8c83-ec1ed0ed0927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:00.928239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1145/2324] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:38:00.933131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45901ca-0caf-4466-ba46-eb070e397d07 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:00.942652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45901ca-0caf-4466-ba46-eb070e397d07 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:00.947872 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb78ad8-ab8d-4aed-9fff-570e8acf0753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:00.948473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb78ad8-ab8d-4aed-9fff-570e8acf0753 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:00.948755 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb78ad8-ab8d-4aed-9fff-570e8acf0753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:00.949059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb78ad8-ab8d-4aed-9fff-570e8acf0753 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:00.949752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb78ad8-ab8d-4aed-9fff-570e8acf0753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:38:00.950058 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb78ad8-ab8d-4aed-9fff-570e8acf0753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:00.951640 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb78ad8-ab8d-4aed-9fff-570e8acf0753 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:00.964414 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1180/2325] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:38:00.968547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1cdff-85b3-4e22-8c83-ec1ed0ed0927 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:00.977792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1cdff-85b3-4e22-8c83-ec1ed0ed0927 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:00.982988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7f24-0811-45b9-bf5d-71c88e029515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:00.983530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7f24-0811-45b9-bf5d-71c88e029515 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:00.983811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7f24-0811-45b9-bf5d-71c88e029515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:00.984151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7f24-0811-45b9-bf5d-71c88e029515 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:00.984818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea7f24-0811-45b9-bf5d-71c88e029515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:00.986728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea7f24-0811-45b9-bf5d-71c88e029515 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:01.016571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1146/2326] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:38:00 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:38:01.021082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb78ad8-ab8d-4aed-9fff-570e8acf0753 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:01.026159 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:01.032320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb78ad8-ab8d-4aed-9fff-570e8acf0753 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:01.089565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db50b6a-59fd-4797-92b1-f767a7d4137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:01.090173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db50b6a-59fd-4797-92b1-f767a7d4137c admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:01.090455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db50b6a-59fd-4797-92b1-f767a7d4137c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:01.090747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db50b6a-59fd-4797-92b1-f767a7d4137c admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:01.091399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db50b6a-59fd-4797-92b1-f767a7d4137c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:01.093317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db50b6a-59fd-4797-92b1-f767a7d4137c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:01.114876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1181/2327] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:38:01 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:38:01.119594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7f24-0811-45b9-bf5d-71c88e029515 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:01.129682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7f24-0811-45b9-bf5d-71c88e029515 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:01.135204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27398a-05a0-4464-b296-6ac2a295abf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:01.135801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27398a-05a0-4464-b296-6ac2a295abf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:01.136081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27398a-05a0-4464-b296-6ac2a295abf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:01.136354 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27398a-05a0-4464-b296-6ac2a295abf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:01.137077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27398a-05a0-4464-b296-6ac2a295abf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:01.138656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27398a-05a0-4464-b296-6ac2a295abf7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:01.149274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1147/2328] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:38:01.153266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db50b6a-59fd-4797-92b1-f767a7d4137c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:01.163306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db50b6a-59fd-4797-92b1-f767a7d4137c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:01.168433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b7369-91d1-4d3c-9435-a596493a4870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:01.169068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b7369-91d1-4d3c-9435-a596493a4870 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:01.169356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b7369-91d1-4d3c-9435-a596493a4870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:01.169635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b7369-91d1-4d3c-9435-a596493a4870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:01.170456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b7369-91d1-4d3c-9435-a596493a4870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:01.172038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b7369-91d1-4d3c-9435-a596493a4870 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:01.183573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1182/2329] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:38:01.187576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27398a-05a0-4464-b296-6ac2a295abf7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:01.197558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27398a-05a0-4464-b296-6ac2a295abf7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:01.202087 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e54a12-9744-4c19-8c44-325d4169a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:01.202737 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54a12-9744-4c19-8c44-325d4169a4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:01.203018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54a12-9744-4c19-8c44-325d4169a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:01.203296 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54a12-9744-4c19-8c44-325d4169a4e4 admin admin] PATH_INFO: `/v3/projects/e0147db6e37944e19652505e1117da64/users/60b46017e2d24b0c89ba54ba610d59fd/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:01.217445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e54a12-9744-4c19-8c44-325d4169a4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0147db6e37944e19652505e1117da64, user_id=60b46017e2d24b0c89ba54ba610d59fd, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:01.220061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e54a12-9744-4c19-8c44-325d4169a4e4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:01.233991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1148/2330] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:38:01 2022] PUT /identity/v3/projects/e0147db6e37944e19652505e1117da64/users/60b46017e2d24b0c89ba54ba610d59fd/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:38:01.238841 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfca951-2de3-4365-829f-fb21d7476a95 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:01.239155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfca951-2de3-4365-829f-fb21d7476a95 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:01.239437 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfca951-2de3-4365-829f-fb21d7476a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:01.258744 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fcfca951-2de3-4365-829f-fb21d7476a95 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:38:01.259953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fcfca951-2de3-4365-829f-fb21d7476a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:01.319383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1183/2331] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:38:01.329054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e54a12-9744-4c19-8c44-325d4169a4e4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:01.330813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f2e54a12-9744-4c19-8c44-325d4169a4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:01.344750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:01.392525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e54a12-9744-4c19-8c44-325d4169a4e4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:01.396197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c47ad-f36b-4c7e-b817-641b6dc6df32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:01.396842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c47ad-f36b-4c7e-b817-641b6dc6df32 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:01.397154 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c47ad-f36b-4c7e-b817-641b6dc6df32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:01.397429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c47ad-f36b-4c7e-b817-641b6dc6df32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:01.406276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c47ad-f36b-4c7e-b817-641b6dc6df32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:01.407695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c47ad-f36b-4c7e-b817-641b6dc6df32 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:01.417449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1149/2332] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:06.194033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed7d19-0f0f-4ea1-a1a2-d323201f6928 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:06.194519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed7d19-0f0f-4ea1-a1a2-d323201f6928 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:06.194627 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed7d19-0f0f-4ea1-a1a2-d323201f6928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:06.235922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-72ed7d19-0f0f-4ea1-a1a2-d323201f6928 None None] MFA Rules not processed for user `60b46017e2d24b0c89ba54ba610d59fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:38:06.237319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-72ed7d19-0f0f-4ea1-a1a2-d323201f6928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:06.317270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1184/2333] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:38:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:38:06.323040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c47ad-f36b-4c7e-b817-641b6dc6df32 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:06.333938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c47ad-f36b-4c7e-b817-641b6dc6df32 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:06.338587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278da87a-f09e-44be-bb0c-e2485e3e3984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:06.339195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da87a-f09e-44be-bb0c-e2485e3e3984 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:06.339477 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da87a-f09e-44be-bb0c-e2485e3e3984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:06.339754 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da87a-f09e-44be-bb0c-e2485e3e3984 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:06.340434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278da87a-f09e-44be-bb0c-e2485e3e3984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:06.342364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278da87a-f09e-44be-bb0c-e2485e3e3984 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:06.378488 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1150/2334] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:38:06 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:38:06.382967 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed7d19-0f0f-4ea1-a1a2-d323201f6928 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:06.395409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed7d19-0f0f-4ea1-a1a2-d323201f6928 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:06.404299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:06.461220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874eb2b-0a02-4a28-a930-f57034ca3582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:06.461844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874eb2b-0a02-4a28-a930-f57034ca3582 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:06.462852 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874eb2b-0a02-4a28-a930-f57034ca3582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:06.463171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874eb2b-0a02-4a28-a930-f57034ca3582 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:06.463820 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874eb2b-0a02-4a28-a930-f57034ca3582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:06.465763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874eb2b-0a02-4a28-a930-f57034ca3582 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:06.488641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1185/2335] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:38:06 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:38:06.492749 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278da87a-f09e-44be-bb0c-e2485e3e3984 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:06.505018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278da87a-f09e-44be-bb0c-e2485e3e3984 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:06.510746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdd565-45d3-4eda-94bd-0a4024a226ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:06.511386 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdd565-45d3-4eda-94bd-0a4024a226ed admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:06.511722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdd565-45d3-4eda-94bd-0a4024a226ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:06.512029 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdd565-45d3-4eda-94bd-0a4024a226ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:06.512709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdd565-45d3-4eda-94bd-0a4024a226ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:06.514528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdd565-45d3-4eda-94bd-0a4024a226ed admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:06.530136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1151/2336] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:38:06.531413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874eb2b-0a02-4a28-a930-f57034ca3582 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:06.542897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874eb2b-0a02-4a28-a930-f57034ca3582 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:06.548101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b9ac-17f6-4bff-a867-57aeda54d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:06.549125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b9ac-17f6-4bff-a867-57aeda54d9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:06.549424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b9ac-17f6-4bff-a867-57aeda54d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:06.549703 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254b9ac-17f6-4bff-a867-57aeda54d9ea admin admin] PATH_INFO: `/v3/projects/0e101c722b974cedaea873a85546f594/users/2a153113326340218a5e398a6caa3cb5/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:06.566124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254b9ac-17f6-4bff-a867-57aeda54d9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e101c722b974cedaea873a85546f594, user_id=2a153113326340218a5e398a6caa3cb5, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:06.568862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254b9ac-17f6-4bff-a867-57aeda54d9ea admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:06.583061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1186/2337] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:38:06 2022] PUT /identity/v3/projects/0e101c722b974cedaea873a85546f594/users/2a153113326340218a5e398a6caa3cb5/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:38:06.587107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdd565-45d3-4eda-94bd-0a4024a226ed admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:06.597549 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdd565-45d3-4eda-94bd-0a4024a226ed admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:06.657314 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d82d91-bb2c-4e25-a48e-2c0b18fb328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:06.657952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d82d91-bb2c-4e25-a48e-2c0b18fb328f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:06.658236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d82d91-bb2c-4e25-a48e-2c0b18fb328f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:06.658509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d82d91-bb2c-4e25-a48e-2c0b18fb328f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:06.659210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d82d91-bb2c-4e25-a48e-2c0b18fb328f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:06.660796 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d82d91-bb2c-4e25-a48e-2c0b18fb328f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:06.671745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1152/2338] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:38:06.675860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b9ac-17f6-4bff-a867-57aeda54d9ea admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:06.687227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254b9ac-17f6-4bff-a867-57aeda54d9ea admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:06.691756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fab76e-6722-422e-b6d3-db8b834102c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:06.692412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fab76e-6722-422e-b6d3-db8b834102c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:06.692699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fab76e-6722-422e-b6d3-db8b834102c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:06.693007 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fab76e-6722-422e-b6d3-db8b834102c7 admin admin] PATH_INFO: `/v3/projects/0e101c722b974cedaea873a85546f594/users/2a153113326340218a5e398a6caa3cb5/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:06.694904 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fab76e-6722-422e-b6d3-db8b834102c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e101c722b974cedaea873a85546f594, user_id=2a153113326340218a5e398a6caa3cb5, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:06.698378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fab76e-6722-422e-b6d3-db8b834102c7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:06.708924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1187/2339] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:38:06 2022] PUT /identity/v3/projects/0e101c722b974cedaea873a85546f594/users/2a153113326340218a5e398a6caa3cb5/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:38:11.178382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d763d-10b6-44ad-8f8b-1330cdbda9be None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:11.178885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d763d-10b6-44ad-8f8b-1330cdbda9be None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:11.179132 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d763d-10b6-44ad-8f8b-1330cdbda9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:11.218797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-eb3d763d-10b6-44ad-8f8b-1330cdbda9be None None] MFA Rules not processed for user `2a153113326340218a5e398a6caa3cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:38:11.220046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eb3d763d-10b6-44ad-8f8b-1330cdbda9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:11.293845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1153/2340] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:38:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:38:11.308470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fab76e-6722-422e-b6d3-db8b834102c7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:11.310418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-24fab76e-6722-422e-b6d3-db8b834102c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:11.394764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fab76e-6722-422e-b6d3-db8b834102c7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:11.401044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77669d94-ac50-4033-a199-9990a7c75a88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:11.401673 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77669d94-ac50-4033-a199-9990a7c75a88 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:11.401957 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77669d94-ac50-4033-a199-9990a7c75a88 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:11.402230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77669d94-ac50-4033-a199-9990a7c75a88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:11.459486 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77669d94-ac50-4033-a199-9990a7c75a88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:11.461086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77669d94-ac50-4033-a199-9990a7c75a88 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:11.466468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:11.471079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1188/2341] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:12.059947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d763d-10b6-44ad-8f8b-1330cdbda9be None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:12.061691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eb3d763d-10b6-44ad-8f8b-1330cdbda9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:12.070645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:12.139975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d763d-10b6-44ad-8f8b-1330cdbda9be None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:12.144222 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fbae0-a1ed-4647-a200-7227eb07ce50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:12.145250 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fbae0-a1ed-4647-a200-7227eb07ce50 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:12.145623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fbae0-a1ed-4647-a200-7227eb07ce50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:12.145977 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fbae0-a1ed-4647-a200-7227eb07ce50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:12.148143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f44fbae0-a1ed-4647-a200-7227eb07ce50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:12.236636 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fbae0-a1ed-4647-a200-7227eb07ce50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:12.238832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fbae0-a1ed-4647-a200-7227eb07ce50 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:12.277206 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1154/2342] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:12.558466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32acd97-255b-423a-8615-5b118c738d9e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:12.559044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32acd97-255b-423a-8615-5b118c738d9e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:12.559044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32acd97-255b-423a-8615-5b118c738d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:12.581207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a32acd97-255b-423a-8615-5b118c738d9e None None] MFA Rules not processed for user `60b46017e2d24b0c89ba54ba610d59fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:38:12.582472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a32acd97-255b-423a-8615-5b118c738d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:12.590104 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1189/2343] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:38:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:38:22.246050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=46 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:22.575078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:24.261269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f6109-88d0-49ed-899f-ad08f2fa7af5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:24.261746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f6109-88d0-49ed-899f-ad08f2fa7af5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:24.262024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f6109-88d0-49ed-899f-ad08f2fa7af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:24.281241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-268f6109-88d0-49ed-899f-ad08f2fa7af5 None None] MFA Rules not processed for user `e9f545fde2d94e03b9b8336f53122177`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:38:24.282459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-268f6109-88d0-49ed-899f-ad08f2fa7af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:24.289383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1155/2344] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:38:24.603991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32acd97-255b-423a-8615-5b118c738d9e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:24.614072 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32acd97-255b-423a-8615-5b118c738d9e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:24.617652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bacb1b-26e0-41e5-80f8-8ae4caabdaee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:24.619008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bacb1b-26e0-41e5-80f8-8ae4caabdaee service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:24.619299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bacb1b-26e0-41e5-80f8-8ae4caabdaee service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:24.619568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bacb1b-26e0-41e5-80f8-8ae4caabdaee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:24.621371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-39bacb1b-26e0-41e5-80f8-8ae4caabdaee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:24.632282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bacb1b-26e0-41e5-80f8-8ae4caabdaee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:24.633803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bacb1b-26e0-41e5-80f8-8ae4caabdaee service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:24.642189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1190/2345] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:24.958677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f6109-88d0-49ed-899f-ad08f2fa7af5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:24.960185 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-268f6109-88d0-49ed-899f-ad08f2fa7af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:25.032357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f6109-88d0-49ed-899f-ad08f2fa7af5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:25.037332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572bdd3-2aca-4e89-a533-23eaea987845 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:25.037951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572bdd3-2aca-4e89-a533-23eaea987845 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:25.038234 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572bdd3-2aca-4e89-a533-23eaea987845 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:25.038508 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572bdd3-2aca-4e89-a533-23eaea987845 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:25.040815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2572bdd3-2aca-4e89-a533-23eaea987845 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:25.052762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572bdd3-2aca-4e89-a533-23eaea987845 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:25.054371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572bdd3-2aca-4e89-a533-23eaea987845 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:25.064304 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1156/2346] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:27.102939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bacb1b-26e0-41e5-80f8-8ae4caabdaee service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:27.111933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bacb1b-26e0-41e5-80f8-8ae4caabdaee service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:27.115637 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c18f8-bcc3-4aeb-bbb6-da2418a6680c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:27.116386 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c18f8-bcc3-4aeb-bbb6-da2418a6680c service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:27.116848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c18f8-bcc3-4aeb-bbb6-da2418a6680c service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:27.117092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c18f8-bcc3-4aeb-bbb6-da2418a6680c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:27.119534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7f5c18f8-bcc3-4aeb-bbb6-da2418a6680c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:27.131100 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c18f8-bcc3-4aeb-bbb6-da2418a6680c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:27.132984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c18f8-bcc3-4aeb-bbb6-da2418a6680c service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:27.142708 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1191/2347] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:27.728033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572bdd3-2aca-4e89-a533-23eaea987845 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:27.730035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2572bdd3-2aca-4e89-a533-23eaea987845 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:27.748063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572bdd3-2aca-4e89-a533-23eaea987845 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:27.753429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1f5ab-ae2f-4020-9005-a53e5126298a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:27.754044 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1f5ab-ae2f-4020-9005-a53e5126298a service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:27.754327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1f5ab-ae2f-4020-9005-a53e5126298a service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:27.755231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1f5ab-ae2f-4020-9005-a53e5126298a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:27.757271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0cf1f5ab-ae2f-4020-9005-a53e5126298a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:27.778838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1f5ab-ae2f-4020-9005-a53e5126298a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:27.780565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1f5ab-ae2f-4020-9005-a53e5126298a service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:27.792329 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1157/2348] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:37.138300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=12 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:37.417226 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c18f8-bcc3-4aeb-bbb6-da2418a6680c service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:37.430916 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c18f8-bcc3-4aeb-bbb6-da2418a6680c service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:37.436408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8e54b-2e10-45c3-91b6-059d6b994da0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:37.437038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8e54b-2e10-45c3-91b6-059d6b994da0 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:37.437322 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8e54b-2e10-45c3-91b6-059d6b994da0 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:37.437595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8e54b-2e10-45c3-91b6-059d6b994da0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:37.439324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fcf8e54b-2e10-45c3-91b6-059d6b994da0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:37.497293 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8e54b-2e10-45c3-91b6-059d6b994da0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:37.499142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8e54b-2e10-45c3-91b6-059d6b994da0 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:37.508851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1192/2349] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:37.787118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=41 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:41.487167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1f5ab-ae2f-4020-9005-a53e5126298a service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:41.498952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1f5ab-ae2f-4020-9005-a53e5126298a service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:41.504554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39f866-8dc4-4017-aed3-c6427913692f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:41.505197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f866-8dc4-4017-aed3-c6427913692f service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:41.505568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f866-8dc4-4017-aed3-c6427913692f service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:41.505735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f866-8dc4-4017-aed3-c6427913692f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:41.507794 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7a39f866-8dc4-4017-aed3-c6427913692f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:41.519815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39f866-8dc4-4017-aed3-c6427913692f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:41.521419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39f866-8dc4-4017-aed3-c6427913692f service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:41.533816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1158/2350] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:42.782214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8e54b-2e10-45c3-91b6-059d6b994da0 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:42.784387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fcf8e54b-2e10-45c3-91b6-059d6b994da0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:42.855168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8e54b-2e10-45c3-91b6-059d6b994da0 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:42.858916 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bee013-f822-40e2-8a6c-6268aa424860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:42.859527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bee013-f822-40e2-8a6c-6268aa424860 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:42.859810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bee013-f822-40e2-8a6c-6268aa424860 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:42.860081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bee013-f822-40e2-8a6c-6268aa424860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:42.861846 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a7bee013-f822-40e2-8a6c-6268aa424860 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:42.938705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bee013-f822-40e2-8a6c-6268aa424860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:42.940418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bee013-f822-40e2-8a6c-6268aa424860 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:42.950796 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1193/2351] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:45.509863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39f866-8dc4-4017-aed3-c6427913692f service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:45.524514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39f866-8dc4-4017-aed3-c6427913692f service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:45.528596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ad86a-f693-42d9-bff7-21f471e9d46b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:45.532404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ad86a-f693-42d9-bff7-21f471e9d46b service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:45.534147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ad86a-f693-42d9-bff7-21f471e9d46b service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:45.534676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ad86a-f693-42d9-bff7-21f471e9d46b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:45.578056 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ad86a-f693-42d9-bff7-21f471e9d46b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:45.580999 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ad86a-f693-42d9-bff7-21f471e9d46b service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:45.596574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1159/2352] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:47.572294 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bee013-f822-40e2-8a6c-6268aa424860 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:47.586094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bee013-f822-40e2-8a6c-6268aa424860 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:47.592566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18dae71-693c-4c12-a995-fe2e8dd67969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:47.593686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dae71-693c-4c12-a995-fe2e8dd67969 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:47.594038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dae71-693c-4c12-a995-fe2e8dd67969 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:47.594629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dae71-693c-4c12-a995-fe2e8dd67969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:47.596685 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b18dae71-693c-4c12-a995-fe2e8dd67969 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:47.612330 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18dae71-693c-4c12-a995-fe2e8dd67969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:47.614440 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18dae71-693c-4c12-a995-fe2e8dd67969 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:47.628740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1194/2353] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:48.357818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f00e8-a930-4d37-bf68-91d4f204c3e8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:48.358393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f00e8-a930-4d37-bf68-91d4f204c3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:48.358500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f00e8-a930-4d37-bf68-91d4f204c3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:48.380254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0c0f00e8-a930-4d37-bf68-91d4f204c3e8 None None] MFA Rules not processed for user `3a7f87ccbd674c54807786d55eba2a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:38:48.381579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0c0f00e8-a930-4d37-bf68-91d4f204c3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:48.389932 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1160/2354] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:38:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:38:48.707207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18dae71-693c-4c12-a995-fe2e8dd67969 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:38:48.717330 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18dae71-693c-4c12-a995-fe2e8dd67969 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:38:48.720893 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d332013-7ad3-412f-85ba-2a4e7534cd7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:38:48.721521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d332013-7ad3-412f-85ba-2a4e7534cd7d service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:38:48.721803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d332013-7ad3-412f-85ba-2a4e7534cd7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:38:48.722080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d332013-7ad3-412f-85ba-2a4e7534cd7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:38:48.723808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2d332013-7ad3-412f-85ba-2a4e7534cd7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:38:48.734378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d332013-7ad3-412f-85ba-2a4e7534cd7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:38:48.735781 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d332013-7ad3-412f-85ba-2a4e7534cd7d service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:38:48.744664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1195/2355] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:38:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:38:58.375187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=15 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:38:58.740343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:05.675281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f00e8-a930-4d37-bf68-91d4f204c3e8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:05.685418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f00e8-a930-4d37-bf68-91d4f204c3e8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:05.688949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0265d-baff-4a4e-9989-878aad40e063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:05.689560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0265d-baff-4a4e-9989-878aad40e063 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:05.689835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0265d-baff-4a4e-9989-878aad40e063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:05.690105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0265d-baff-4a4e-9989-878aad40e063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:05.691827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b6a0265d-baff-4a4e-9989-878aad40e063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:05.764500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0265d-baff-4a4e-9989-878aad40e063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:05.765993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0265d-baff-4a4e-9989-878aad40e063 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:05.775801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1161/2356] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:09.161356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d332013-7ad3-412f-85ba-2a4e7534cd7d service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:09.163919 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2d332013-7ad3-412f-85ba-2a4e7534cd7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:09.179214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d332013-7ad3-412f-85ba-2a4e7534cd7d service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:09.184369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427c96b-24e0-47d0-b078-b033ed8fc2cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:09.185018 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427c96b-24e0-47d0-b078-b033ed8fc2cb service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:09.185303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427c96b-24e0-47d0-b078-b033ed8fc2cb service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:09.185578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427c96b-24e0-47d0-b078-b033ed8fc2cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:09.187355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8427c96b-24e0-47d0-b078-b033ed8fc2cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:09.200087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427c96b-24e0-47d0-b078-b033ed8fc2cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:09.201771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427c96b-24e0-47d0-b078-b033ed8fc2cb service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:09.212753 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1196/2357] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:09.223151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0265d-baff-4a4e-9989-878aad40e063 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:09.224733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b6a0265d-baff-4a4e-9989-878aad40e063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:09.238625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0265d-baff-4a4e-9989-878aad40e063 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:09.244457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6e0b3-eb51-4034-aa6b-f832bd77ee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:09.245266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6e0b3-eb51-4034-aa6b-f832bd77ee29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:09.245551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6e0b3-eb51-4034-aa6b-f832bd77ee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:09.245844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6e0b3-eb51-4034-aa6b-f832bd77ee29 admin admin] PATH_INFO: `/v3/users/02a1682847df4bd99bf09c8216a44850` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:09.246991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6e0b3-eb51-4034-aa6b-f832bd77ee29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a1682847df4bd99bf09c8216a44850)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:09.248883 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6e0b3-eb51-4034-aa6b-f832bd77ee29 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:09.297856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-77e6e0b3-eb51-4034-aa6b-f832bd77ee29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a1682847df4bd99bf09c8216a44850'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:09.304688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-77e6e0b3-eb51-4034-aa6b-f832bd77ee29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a1682847df4bd99bf09c8216a44850'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:09.316252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-77e6e0b3-eb51-4034-aa6b-f832bd77ee29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a1682847df4bd99bf09c8216a44850'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:09.316955 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-77e6e0b3-eb51-4034-aa6b-f832bd77ee29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a1682847df4bd99bf09c8216a44850'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:09.317568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-77e6e0b3-eb51-4034-aa6b-f832bd77ee29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a1682847df4bd99bf09c8216a44850'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:09.330290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1162/2358] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:39:09 2022] DELETE /identity/v3/users/02a1682847df4bd99bf09c8216a44850 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:09.508684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427c96b-24e0-47d0-b078-b033ed8fc2cb service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:09.520136 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427c96b-24e0-47d0-b078-b033ed8fc2cb service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:09.581025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafa684-8067-4255-b9c2-3bd7a9bc127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:09.581703 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafa684-8067-4255-b9c2-3bd7a9bc127f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:09.581989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafa684-8067-4255-b9c2-3bd7a9bc127f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:09.582268 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafa684-8067-4255-b9c2-3bd7a9bc127f admin admin] PATH_INFO: `/v3/projects/d193260942ee4b468e236804350116fc` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:09.583501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafa684-8067-4255-b9c2-3bd7a9bc127f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d193260942ee4b468e236804350116fc)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:09.585519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafa684-8067-4255-b9c2-3bd7a9bc127f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:09.631641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8dafa684-8067-4255-b9c2-3bd7a9bc127f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd193260942ee4b468e236804350116fc', 'request_id': 'req-8dafa684-8067-4255-b9c2-3bd7a9bc127f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:09.637242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8dafa684-8067-4255-b9c2-3bd7a9bc127f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd193260942ee4b468e236804350116fc', 'request_id': 'req-8dafa684-8067-4255-b9c2-3bd7a9bc127f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:09.644543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8dafa684-8067-4255-b9c2-3bd7a9bc127f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd193260942ee4b468e236804350116fc', 'request_id': 'req-8dafa684-8067-4255-b9c2-3bd7a9bc127f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:09.656211 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8dafa684-8067-4255-b9c2-3bd7a9bc127f admin admin] The token cache is being invalidate because project d193260942ee4b468e236804350116fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:09.656529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8dafa684-8067-4255-b9c2-3bd7a9bc127f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:09.657219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8dafa684-8067-4255-b9c2-3bd7a9bc127f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:09.658712 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1197/2359] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:09 2022] DELETE /identity/v3/projects/d193260942ee4b468e236804350116fc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:39:09.664392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474b764-ca1f-429d-9b2d-75ae67c118da None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:09.664708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474b764-ca1f-429d-9b2d-75ae67c118da None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:09.665018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474b764-ca1f-429d-9b2d-75ae67c118da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:09.686325 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1474b764-ca1f-429d-9b2d-75ae67c118da None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:09.687523 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1474b764-ca1f-429d-9b2d-75ae67c118da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:09.745981 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1163/2360] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:09.753743 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de2fdc-9b52-43a4-834c-9e4a7481891c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:09.754064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de2fdc-9b52-43a4-834c-9e4a7481891c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:09.754343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de2fdc-9b52-43a4-834c-9e4a7481891c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:09.774725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-09de2fdc-9b52-43a4-834c-9e4a7481891c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:09.775934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-09de2fdc-9b52-43a4-834c-9e4a7481891c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:09.783777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1198/2361] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:09.787986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474b764-ca1f-429d-9b2d-75ae67c118da None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:09.797627 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474b764-ca1f-429d-9b2d-75ae67c118da None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:09.802143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef900f9-7acd-4126-ba27-ce07472a2d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:09.802746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef900f9-7acd-4126-ba27-ce07472a2d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:09.803656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef900f9-7acd-4126-ba27-ce07472a2d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:09.803934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef900f9-7acd-4126-ba27-ce07472a2d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:09.804635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef900f9-7acd-4126-ba27-ce07472a2d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:39:09.804969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef900f9-7acd-4126-ba27-ce07472a2d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:09.806551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef900f9-7acd-4126-ba27-ce07472a2d79 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:09.808025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:09.822758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1164/2362] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:39:09.823732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de2fdc-9b52-43a4-834c-9e4a7481891c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:09.832802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de2fdc-9b52-43a4-834c-9e4a7481891c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:09.837465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaa9da-ea65-4e2e-bfb7-29e5cc38d88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:09.838064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaa9da-ea65-4e2e-bfb7-29e5cc38d88b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:09.838344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaa9da-ea65-4e2e-bfb7-29e5cc38d88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:09.838617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaa9da-ea65-4e2e-bfb7-29e5cc38d88b admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:09.839284 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eaa9da-ea65-4e2e-bfb7-29e5cc38d88b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:09.841199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eaa9da-ea65-4e2e-bfb7-29e5cc38d88b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:09.869652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1199/2363] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:09 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:09.873757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef900f9-7acd-4126-ba27-ce07472a2d79 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:09.884700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef900f9-7acd-4126-ba27-ce07472a2d79 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:09.939539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bccb69-419c-4e35-80e9-3f9dd7228963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:09.940152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bccb69-419c-4e35-80e9-3f9dd7228963 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:09.940437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bccb69-419c-4e35-80e9-3f9dd7228963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:09.940712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bccb69-419c-4e35-80e9-3f9dd7228963 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:09.941413 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bccb69-419c-4e35-80e9-3f9dd7228963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:09.943314 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bccb69-419c-4e35-80e9-3f9dd7228963 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:09.965682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1165/2364] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:39:09 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:09.969791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaa9da-ea65-4e2e-bfb7-29e5cc38d88b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:09.980368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaa9da-ea65-4e2e-bfb7-29e5cc38d88b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:09.984961 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0f271-ef29-4ced-be1d-9a093208fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:09.985564 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0f271-ef29-4ced-be1d-9a093208fc3a admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:09.985847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0f271-ef29-4ced-be1d-9a093208fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:09.986118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0f271-ef29-4ced-be1d-9a093208fc3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:09.986804 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0f271-ef29-4ced-be1d-9a093208fc3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:09.988379 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0f271-ef29-4ced-be1d-9a093208fc3a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:09.998941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1200/2365] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:10.002750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bccb69-419c-4e35-80e9-3f9dd7228963 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:10.013525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bccb69-419c-4e35-80e9-3f9dd7228963 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:10.018123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e87f9-5d29-4a88-a529-d14a9505b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:10.018751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e87f9-5d29-4a88-a529-d14a9505b8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:10.019033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e87f9-5d29-4a88-a529-d14a9505b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:10.019306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e87f9-5d29-4a88-a529-d14a9505b8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:10.019994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e87f9-5d29-4a88-a529-d14a9505b8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:10.023274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e87f9-5d29-4a88-a529-d14a9505b8c3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:10.033837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1166/2366] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:10.037990 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0f271-ef29-4ced-be1d-9a093208fc3a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:10.048654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0f271-ef29-4ced-be1d-9a093208fc3a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:10.055987 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b69743-aa43-41a1-b944-f0b3788f7bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:10.056685 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b69743-aa43-41a1-b944-f0b3788f7bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:10.057002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b69743-aa43-41a1-b944-f0b3788f7bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:10.057283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b69743-aa43-41a1-b944-f0b3788f7bbc admin admin] PATH_INFO: `/v3/projects/356078418146462bbace158d02c55118/users/581c5df864af41ec9946e800014decac/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:10.072497 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b69743-aa43-41a1-b944-f0b3788f7bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=356078418146462bbace158d02c55118, user_id=581c5df864af41ec9946e800014decac, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:10.075402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b69743-aa43-41a1-b944-f0b3788f7bbc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:10.088078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1201/2367] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:10 2022] PUT /identity/v3/projects/356078418146462bbace158d02c55118/users/581c5df864af41ec9946e800014decac/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:10.097926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65540f-f173-4675-b3b6-7bf4f3219e35 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:10.098239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65540f-f173-4675-b3b6-7bf4f3219e35 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:10.098536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65540f-f173-4675-b3b6-7bf4f3219e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:10.125605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bf65540f-f173-4675-b3b6-7bf4f3219e35 None None] MFA Rules not processed for user `581c5df864af41ec9946e800014decac`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:10.126791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bf65540f-f173-4675-b3b6-7bf4f3219e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:10.194406 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1167/2368] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:10.205993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b69743-aa43-41a1-b944-f0b3788f7bbc admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:10.207755 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f1b69743-aa43-41a1-b944-f0b3788f7bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:10.222448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:10.286843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b69743-aa43-41a1-b944-f0b3788f7bbc admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:10.292865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dae15d-c32f-4b4f-88d3-ad41a1fb0c18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:10.293512 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dae15d-c32f-4b4f-88d3-ad41a1fb0c18 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:10.293790 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dae15d-c32f-4b4f-88d3-ad41a1fb0c18 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:10.294061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dae15d-c32f-4b4f-88d3-ad41a1fb0c18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:10.301581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dae15d-c32f-4b4f-88d3-ad41a1fb0c18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:10.303740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dae15d-c32f-4b4f-88d3-ad41a1fb0c18 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:10.312618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1202/2369] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:10.904322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65540f-f173-4675-b3b6-7bf4f3219e35 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:10.905784 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bf65540f-f173-4675-b3b6-7bf4f3219e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:10.961772 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65540f-f173-4675-b3b6-7bf4f3219e35 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:10.965333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fb94d-9bf0-43b1-aef5-8a3960a8e698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:10.965944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fb94d-9bf0-43b1-aef5-8a3960a8e698 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:10.966224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fb94d-9bf0-43b1-aef5-8a3960a8e698 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:10.966501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fb94d-9bf0-43b1-aef5-8a3960a8e698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:10.968194 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eb4fb94d-9bf0-43b1-aef5-8a3960a8e698 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:10.981758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:11.029118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4fb94d-9bf0-43b1-aef5-8a3960a8e698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:11.030549 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4fb94d-9bf0-43b1-aef5-8a3960a8e698 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:11.039882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1168/2370] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:15.529594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dae15d-c32f-4b4f-88d3-ad41a1fb0c18 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:15.595422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dae15d-c32f-4b4f-88d3-ad41a1fb0c18 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:15.600470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:15.601168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:15.601451 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:15.601730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] PATH_INFO: `/v3/users/581c5df864af41ec9946e800014decac` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:15.602914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=581c5df864af41ec9946e800014decac)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:15.604832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:15.658747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581c5df864af41ec9946e800014decac'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:15.671964 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581c5df864af41ec9946e800014decac'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:15.672787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581c5df864af41ec9946e800014decac'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:15.673432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581c5df864af41ec9946e800014decac'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:15.682805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581c5df864af41ec9946e800014decac'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:15.696484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1203/2371] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:39:15 2022] DELETE /identity/v3/users/581c5df864af41ec9946e800014decac => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:15.700991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08990be1-7229-4ec0-bf97-aa9bbc4cae32 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:15.701471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08990be1-7229-4ec0-bf97-aa9bbc4cae32 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:15.701471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08990be1-7229-4ec0-bf97-aa9bbc4cae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:15.720814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-08990be1-7229-4ec0-bf97-aa9bbc4cae32 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:15.722052 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-08990be1-7229-4ec0-bf97-aa9bbc4cae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:15.787126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1169/2372] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:15.804027 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:15.805544 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:15.826571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:15.867354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05339a70-8938-4e38-8c19-e6c342736e0e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:15.871489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb57a2f-aecc-406b-bf63-4eaae81980c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:15.872185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb57a2f-aecc-406b-bf63-4eaae81980c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:15.872470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb57a2f-aecc-406b-bf63-4eaae81980c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:15.872752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb57a2f-aecc-406b-bf63-4eaae81980c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:15.882677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb57a2f-aecc-406b-bf63-4eaae81980c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:15.884200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb57a2f-aecc-406b-bf63-4eaae81980c5 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:15.894754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1204/2373] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:16.195948 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08990be1-7229-4ec0-bf97-aa9bbc4cae32 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:16.197699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-08990be1-7229-4ec0-bf97-aa9bbc4cae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:16.214942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08990be1-7229-4ec0-bf97-aa9bbc4cae32 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:16.228513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:16.229244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:16.229530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:16.229803 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8 admin admin] PATH_INFO: `/v3/projects/356078418146462bbace158d02c55118` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:16.230969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=356078418146462bbace158d02c55118)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:16.232858 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:16.282201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356078418146462bbace158d02c55118', 'request_id': 'req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:16.288435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356078418146462bbace158d02c55118', 'request_id': 'req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:16.296455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356078418146462bbace158d02c55118', 'request_id': 'req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:16.308786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8 admin admin] The token cache is being invalidate because project 356078418146462bbace158d02c55118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:16.309107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:16.309767 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ea4b54cb-0734-4f17-8adf-7e82c204b9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:16.311354 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1170/2374] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:16 2022] DELETE /identity/v3/projects/356078418146462bbace158d02c55118 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:16.316527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83849da4-a992-4cbe-80e4-1985f71d7f4d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:16.316929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83849da4-a992-4cbe-80e4-1985f71d7f4d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:16.317290 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83849da4-a992-4cbe-80e4-1985f71d7f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:16.337597 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-83849da4-a992-4cbe-80e4-1985f71d7f4d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:16.338897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-83849da4-a992-4cbe-80e4-1985f71d7f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:16.409471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1205/2375] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:16.419017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff631e-b9ca-4fd5-afeb-4a2daa061b0a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:16.419534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff631e-b9ca-4fd5-afeb-4a2daa061b0a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:16.419841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff631e-b9ca-4fd5-afeb-4a2daa061b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:16.440219 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8cff631e-b9ca-4fd5-afeb-4a2daa061b0a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:16.441727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8cff631e-b9ca-4fd5-afeb-4a2daa061b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:16.450259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1171/2376] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:16.454555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83849da4-a992-4cbe-80e4-1985f71d7f4d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:16.465149 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83849da4-a992-4cbe-80e4-1985f71d7f4d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:16.469644 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70539fb-7ced-4783-a6c5-6180656ab698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:16.470258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70539fb-7ced-4783-a6c5-6180656ab698 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:16.470568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70539fb-7ced-4783-a6c5-6180656ab698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:16.470813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70539fb-7ced-4783-a6c5-6180656ab698 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:16.471513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70539fb-7ced-4783-a6c5-6180656ab698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:39:16.471822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70539fb-7ced-4783-a6c5-6180656ab698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:16.473445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70539fb-7ced-4783-a6c5-6180656ab698 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:16.487068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1206/2377] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:39:16.491891 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff631e-b9ca-4fd5-afeb-4a2daa061b0a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:16.501259 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff631e-b9ca-4fd5-afeb-4a2daa061b0a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:16.506516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2c65d-1ff2-4059-9bf8-7723d5cc094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:16.507130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2c65d-1ff2-4059-9bf8-7723d5cc094c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:16.507415 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2c65d-1ff2-4059-9bf8-7723d5cc094c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:16.507693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2c65d-1ff2-4059-9bf8-7723d5cc094c admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:16.508400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2c65d-1ff2-4059-9bf8-7723d5cc094c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:16.510370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2c65d-1ff2-4059-9bf8-7723d5cc094c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:16.543673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1172/2378] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:16 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:39:16.544834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70539fb-7ced-4783-a6c5-6180656ab698 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:16.555273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70539fb-7ced-4783-a6c5-6180656ab698 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:16.614355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31513849-c808-4001-9d05-b55824881c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:16.614979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31513849-c808-4001-9d05-b55824881c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:16.615439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31513849-c808-4001-9d05-b55824881c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:16.615724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31513849-c808-4001-9d05-b55824881c48 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:16.616398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31513849-c808-4001-9d05-b55824881c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:16.618379 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31513849-c808-4001-9d05-b55824881c48 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:16.640248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1207/2379] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:39:16 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:16.644810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2c65d-1ff2-4059-9bf8-7723d5cc094c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:16.655825 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2c65d-1ff2-4059-9bf8-7723d5cc094c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:16.660666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d1239-3fa8-40ec-9514-d35cea1769f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:16.661334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d1239-3fa8-40ec-9514-d35cea1769f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:16.661602 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d1239-3fa8-40ec-9514-d35cea1769f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:16.661880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d1239-3fa8-40ec-9514-d35cea1769f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:16.662687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d1239-3fa8-40ec-9514-d35cea1769f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:16.664264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d1239-3fa8-40ec-9514-d35cea1769f4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:16.669939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:16.677472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1173/2380] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:16.683081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31513849-c808-4001-9d05-b55824881c48 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:16.693927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31513849-c808-4001-9d05-b55824881c48 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:16.698725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b185078-8e35-4976-95ac-cddfd76d0129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:16.699337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b185078-8e35-4976-95ac-cddfd76d0129 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:16.699620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b185078-8e35-4976-95ac-cddfd76d0129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:16.699898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b185078-8e35-4976-95ac-cddfd76d0129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:16.700598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b185078-8e35-4976-95ac-cddfd76d0129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:16.702232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b185078-8e35-4976-95ac-cddfd76d0129 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:16.718242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1208/2381] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:16.719331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d1239-3fa8-40ec-9514-d35cea1769f4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:16.731290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d1239-3fa8-40ec-9514-d35cea1769f4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:16.737120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982b6b5-1268-4406-84d3-34cc625401c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:16.737120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982b6b5-1268-4406-84d3-34cc625401c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:16.737352 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982b6b5-1268-4406-84d3-34cc625401c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:16.737444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982b6b5-1268-4406-84d3-34cc625401c3 admin admin] PATH_INFO: `/v3/projects/df625bda5c534397b85fa8d8a83c7c13/users/9a923a6cd9514aceb3cbabdfa37c80ae/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:16.743303 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442e5e9-d71c-4f6a-a1e7-8db2fa1c4e0e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:16.743591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442e5e9-d71c-4f6a-a1e7-8db2fa1c4e0e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:16.743865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442e5e9-d71c-4f6a-a1e7-8db2fa1c4e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:16.753741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982b6b5-1268-4406-84d3-34cc625401c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df625bda5c534397b85fa8d8a83c7c13, user_id=9a923a6cd9514aceb3cbabdfa37c80ae, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:16.757098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982b6b5-1268-4406-84d3-34cc625401c3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:16.763575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5442e5e9-d71c-4f6a-a1e7-8db2fa1c4e0e None None] MFA Rules not processed for user `e354e99370d64ec3a7624eb3e550021d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:16.764865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5442e5e9-d71c-4f6a-a1e7-8db2fa1c4e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:16.770429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1174/2382] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:16 2022] PUT /identity/v3/projects/df625bda5c534397b85fa8d8a83c7c13/users/9a923a6cd9514aceb3cbabdfa37c80ae/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:39:16.781495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9717e-a568-4498-9a15-0491fc0e5f1b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:16.781791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9717e-a568-4498-9a15-0491fc0e5f1b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:16.782070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9717e-a568-4498-9a15-0491fc0e5f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:16.792169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:16.810808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-86c9717e-a568-4498-9a15-0491fc0e5f1b None None] MFA Rules not processed for user `9a923a6cd9514aceb3cbabdfa37c80ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:16.812057 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-86c9717e-a568-4498-9a15-0491fc0e5f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:16.833043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1209/2383] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:16.880013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1175/2384] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:39:16.892387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442e5e9-d71c-4f6a-a1e7-8db2fa1c4e0e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:16.894032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5442e5e9-d71c-4f6a-a1e7-8db2fa1c4e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:16.953025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442e5e9-d71c-4f6a-a1e7-8db2fa1c4e0e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:16.956618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3913efb-2bb8-4fa5-be33-9da33d1ba78c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:16.957262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3913efb-2bb8-4fa5-be33-9da33d1ba78c service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:16.957545 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3913efb-2bb8-4fa5-be33-9da33d1ba78c service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:16.958901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3913efb-2bb8-4fa5-be33-9da33d1ba78c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:16.966666 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3913efb-2bb8-4fa5-be33-9da33d1ba78c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:16.968088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3913efb-2bb8-4fa5-be33-9da33d1ba78c service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:16.978539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1210/2385] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:39:25.442009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9717e-a568-4498-9a15-0491fc0e5f1b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:25.515271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9717e-a568-4498-9a15-0491fc0e5f1b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:25.519885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:25.520533 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:25.520822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:25.521142 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] PATH_INFO: `/v3/users/9a923a6cd9514aceb3cbabdfa37c80ae` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:25.522927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a923a6cd9514aceb3cbabdfa37c80ae)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:25.524861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:25.575830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a923a6cd9514aceb3cbabdfa37c80ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:25.585150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a923a6cd9514aceb3cbabdfa37c80ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:25.595520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:25.601340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a923a6cd9514aceb3cbabdfa37c80ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:25.602669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a923a6cd9514aceb3cbabdfa37c80ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:25.603288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a923a6cd9514aceb3cbabdfa37c80ae'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:25.620143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1176/2386] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:39:25 2022] DELETE /identity/v3/users/9a923a6cd9514aceb3cbabdfa37c80ae => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:39:25.624697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf043ee-2d09-4087-b64e-efc694bcdf2d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:25.625249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf043ee-2d09-4087-b64e-efc694bcdf2d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:25.625249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf043ee-2d09-4087-b64e-efc694bcdf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:25.645214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7cf043ee-2d09-4087-b64e-efc694bcdf2d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:25.646418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7cf043ee-2d09-4087-b64e-efc694bcdf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:25.707126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1211/2387] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:25.717567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:25.719157 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:25.779765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c1fe-4838-4c56-98d3-f287a4af76af admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:25.783420 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1af17-f931-421e-a02a-fc4651b1aa66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:25.784058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1af17-f931-421e-a02a-fc4651b1aa66 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:25.784321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1af17-f931-421e-a02a-fc4651b1aa66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:25.784596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1af17-f931-421e-a02a-fc4651b1aa66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:25.794672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1af17-f931-421e-a02a-fc4651b1aa66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:25.796123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1af17-f931-421e-a02a-fc4651b1aa66 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:25.805863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1177/2388] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:26.228137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf043ee-2d09-4087-b64e-efc694bcdf2d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:26.229578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7cf043ee-2d09-4087-b64e-efc694bcdf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:26.243091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf043ee-2d09-4087-b64e-efc694bcdf2d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:26.247940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4579d5-5cfe-462d-991c-19f59f521933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:26.248738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4579d5-5cfe-462d-991c-19f59f521933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:26.249021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4579d5-5cfe-462d-991c-19f59f521933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:26.249302 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4579d5-5cfe-462d-991c-19f59f521933 admin admin] PATH_INFO: `/v3/projects/df625bda5c534397b85fa8d8a83c7c13` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:26.250496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4579d5-5cfe-462d-991c-19f59f521933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df625bda5c534397b85fa8d8a83c7c13)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:26.252402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4579d5-5cfe-462d-991c-19f59f521933 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:26.299969 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-eb4579d5-5cfe-462d-991c-19f59f521933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df625bda5c534397b85fa8d8a83c7c13', 'request_id': 'req-eb4579d5-5cfe-462d-991c-19f59f521933'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:26.306422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-eb4579d5-5cfe-462d-991c-19f59f521933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df625bda5c534397b85fa8d8a83c7c13', 'request_id': 'req-eb4579d5-5cfe-462d-991c-19f59f521933'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:26.313624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-eb4579d5-5cfe-462d-991c-19f59f521933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df625bda5c534397b85fa8d8a83c7c13', 'request_id': 'req-eb4579d5-5cfe-462d-991c-19f59f521933'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:26.321671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:26.327079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-eb4579d5-5cfe-462d-991c-19f59f521933 admin admin] The token cache is being invalidate because project df625bda5c534397b85fa8d8a83c7c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:26.327543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-eb4579d5-5cfe-462d-991c-19f59f521933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:26.328565 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-eb4579d5-5cfe-462d-991c-19f59f521933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:26.330329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1212/2389] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:26 2022] DELETE /identity/v3/projects/df625bda5c534397b85fa8d8a83c7c13 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:26.335701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59372229-6655-43dd-860b-0938a870e29c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:26.335988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59372229-6655-43dd-860b-0938a870e29c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:26.336262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59372229-6655-43dd-860b-0938a870e29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:26.355441 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-59372229-6655-43dd-860b-0938a870e29c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:26.356682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-59372229-6655-43dd-860b-0938a870e29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:26.417709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1178/2390] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:26.425459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46d371-cee2-466a-9d56-97014c9655f6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:26.425745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46d371-cee2-466a-9d56-97014c9655f6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:26.426019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46d371-cee2-466a-9d56-97014c9655f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:26.446282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6c46d371-cee2-466a-9d56-97014c9655f6 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:26.447464 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6c46d371-cee2-466a-9d56-97014c9655f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:26.455218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1213/2391] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:26.459240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59372229-6655-43dd-860b-0938a870e29c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:26.469086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59372229-6655-43dd-860b-0938a870e29c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:26.473545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b9848-1f0b-4c6e-86ce-9ddfdad3146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:26.474140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b9848-1f0b-4c6e-86ce-9ddfdad3146b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:26.474418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b9848-1f0b-4c6e-86ce-9ddfdad3146b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:26.474688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b9848-1f0b-4c6e-86ce-9ddfdad3146b admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:26.475430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b9848-1f0b-4c6e-86ce-9ddfdad3146b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:39:26.475732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b9848-1f0b-4c6e-86ce-9ddfdad3146b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:26.477363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b9848-1f0b-4c6e-86ce-9ddfdad3146b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:26.488633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1179/2392] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:39:26.493597 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46d371-cee2-466a-9d56-97014c9655f6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:26.502697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46d371-cee2-466a-9d56-97014c9655f6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:26.508471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed606f08-3bbb-452e-a471-4e0095742ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:26.509108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed606f08-3bbb-452e-a471-4e0095742ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:26.509387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed606f08-3bbb-452e-a471-4e0095742ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:26.509657 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed606f08-3bbb-452e-a471-4e0095742ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:26.510327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed606f08-3bbb-452e-a471-4e0095742ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:26.512197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed606f08-3bbb-452e-a471-4e0095742ba9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:26.538914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1214/2393] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:26 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:26.543208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b9848-1f0b-4c6e-86ce-9ddfdad3146b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:26.553733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b9848-1f0b-4c6e-86ce-9ddfdad3146b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:26.609461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592916e2-803e-47aa-9fcf-4c73e3dae3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:26.610075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592916e2-803e-47aa-9fcf-4c73e3dae3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:26.610365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592916e2-803e-47aa-9fcf-4c73e3dae3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:26.610640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592916e2-803e-47aa-9fcf-4c73e3dae3f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:26.611299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592916e2-803e-47aa-9fcf-4c73e3dae3f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:26.613235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592916e2-803e-47aa-9fcf-4c73e3dae3f6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:26.634966 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1180/2394] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:39:26 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:26.640838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed606f08-3bbb-452e-a471-4e0095742ba9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:26.652030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed606f08-3bbb-452e-a471-4e0095742ba9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:26.656631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfceeb-4729-4b97-8a3c-66a2fe695b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:26.657266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfceeb-4729-4b97-8a3c-66a2fe695b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:26.657551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfceeb-4729-4b97-8a3c-66a2fe695b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:26.657824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfceeb-4729-4b97-8a3c-66a2fe695b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:26.658517 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfceeb-4729-4b97-8a3c-66a2fe695b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:26.660127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfceeb-4729-4b97-8a3c-66a2fe695b2d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:26.670219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1215/2395] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:26.674117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592916e2-803e-47aa-9fcf-4c73e3dae3f6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:26.680612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:26.684369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592916e2-803e-47aa-9fcf-4c73e3dae3f6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:26.689271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bfba9-9d41-493a-af22-92792e155101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:26.689938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bfba9-9d41-493a-af22-92792e155101 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:26.690360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bfba9-9d41-493a-af22-92792e155101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:26.690984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bfba9-9d41-493a-af22-92792e155101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:26.691771 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bfba9-9d41-493a-af22-92792e155101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:26.693788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bfba9-9d41-493a-af22-92792e155101 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:26.706569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1181/2396] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:26.711404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfceeb-4729-4b97-8a3c-66a2fe695b2d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:26.721555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfceeb-4729-4b97-8a3c-66a2fe695b2d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:26.726516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3189a1-9b23-42fa-b26c-b8165ddb7359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:26.727191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3189a1-9b23-42fa-b26c-b8165ddb7359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:26.727478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3189a1-9b23-42fa-b26c-b8165ddb7359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:26.727758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3189a1-9b23-42fa-b26c-b8165ddb7359 admin admin] PATH_INFO: `/v3/projects/84b8cfd82c0f418796adcfb2c82f87a0/users/a2c0d6b77e344f5fb23ec60c8211aefc/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:26.742348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3189a1-9b23-42fa-b26c-b8165ddb7359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b8cfd82c0f418796adcfb2c82f87a0, user_id=a2c0d6b77e344f5fb23ec60c8211aefc, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:26.745111 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3189a1-9b23-42fa-b26c-b8165ddb7359 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:26.758624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1216/2397] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:26 2022] PUT /identity/v3/projects/84b8cfd82c0f418796adcfb2c82f87a0/users/a2c0d6b77e344f5fb23ec60c8211aefc/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:26.768677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb671-2f2e-4977-84fc-894ff4282bc9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:26.768998 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb671-2f2e-4977-84fc-894ff4282bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:26.769284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb671-2f2e-4977-84fc-894ff4282bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:26.800485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c50cb671-2f2e-4977-84fc-894ff4282bc9 None None] MFA Rules not processed for user `a2c0d6b77e344f5fb23ec60c8211aefc`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:26.802497 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c50cb671-2f2e-4977-84fc-894ff4282bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:26.867471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1182/2398] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:26.871961 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3189a1-9b23-42fa-b26c-b8165ddb7359 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:26.934642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3189a1-9b23-42fa-b26c-b8165ddb7359 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:26.939189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df601770-9cd8-4fcb-bc2a-5a5649f48c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:26.939800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df601770-9cd8-4fcb-bc2a-5a5649f48c39 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:26.940081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df601770-9cd8-4fcb-bc2a-5a5649f48c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:26.940363 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df601770-9cd8-4fcb-bc2a-5a5649f48c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:26.941089 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df601770-9cd8-4fcb-bc2a-5a5649f48c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:26.943019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df601770-9cd8-4fcb-bc2a-5a5649f48c39 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:26.969688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1217/2399] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:26 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:26.973810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb671-2f2e-4977-84fc-894ff4282bc9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:26.984845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb671-2f2e-4977-84fc-894ff4282bc9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:27.041964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05b556-cffe-4898-9c6b-44daffd032d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:27.042580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05b556-cffe-4898-9c6b-44daffd032d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:27.042870 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05b556-cffe-4898-9c6b-44daffd032d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:27.043147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05b556-cffe-4898-9c6b-44daffd032d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:27.043818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05b556-cffe-4898-9c6b-44daffd032d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:27.045780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05b556-cffe-4898-9c6b-44daffd032d7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:27.067599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1183/2400] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:39:26 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:27.071903 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df601770-9cd8-4fcb-bc2a-5a5649f48c39 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:27.082309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df601770-9cd8-4fcb-bc2a-5a5649f48c39 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:27.087818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3011b-813f-48a3-af61-987c6f29072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:27.088424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3011b-813f-48a3-af61-987c6f29072f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:27.088707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3011b-813f-48a3-af61-987c6f29072f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:27.089017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3011b-813f-48a3-af61-987c6f29072f admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:27.089714 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3011b-813f-48a3-af61-987c6f29072f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:27.091288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3011b-813f-48a3-af61-987c6f29072f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:27.102654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1218/2401] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:27.106532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05b556-cffe-4898-9c6b-44daffd032d7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:27.116644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05b556-cffe-4898-9c6b-44daffd032d7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:27.121312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8bb25-f67f-4b12-b103-3b410d30bb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:27.121972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8bb25-f67f-4b12-b103-3b410d30bb2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:27.122266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8bb25-f67f-4b12-b103-3b410d30bb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:27.122541 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8bb25-f67f-4b12-b103-3b410d30bb2c admin admin] PATH_INFO: `/v3/projects/303c04e9c5bb46ffa289e714cabe247f/users/0aa7219b1d83442eb7f8750821d232c5/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:27.137993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8bb25-f67f-4b12-b103-3b410d30bb2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=303c04e9c5bb46ffa289e714cabe247f, user_id=0aa7219b1d83442eb7f8750821d232c5, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:27.140657 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8bb25-f67f-4b12-b103-3b410d30bb2c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:27.153975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1184/2402] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:27 2022] PUT /identity/v3/projects/303c04e9c5bb46ffa289e714cabe247f/users/0aa7219b1d83442eb7f8750821d232c5/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:39:27.158026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3011b-813f-48a3-af61-987c6f29072f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:27.168779 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3011b-813f-48a3-af61-987c6f29072f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:27.229525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a4d26-6328-4c27-a346-f182f70ee986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:27.230152 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a4d26-6328-4c27-a346-f182f70ee986 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:27.230674 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a4d26-6328-4c27-a346-f182f70ee986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:27.230882 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a4d26-6328-4c27-a346-f182f70ee986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:27.231535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a4d26-6328-4c27-a346-f182f70ee986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:27.233156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a4d26-6328-4c27-a346-f182f70ee986 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:27.246412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1219/2403] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:39:27.247611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8bb25-f67f-4b12-b103-3b410d30bb2c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:27.258854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8bb25-f67f-4b12-b103-3b410d30bb2c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:27.263538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceca0e2-1279-4b2d-a82e-62fcd1af60ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:27.264207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceca0e2-1279-4b2d-a82e-62fcd1af60ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:27.264490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceca0e2-1279-4b2d-a82e-62fcd1af60ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:27.264768 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceca0e2-1279-4b2d-a82e-62fcd1af60ad admin admin] PATH_INFO: `/v3/projects/303c04e9c5bb46ffa289e714cabe247f/users/0aa7219b1d83442eb7f8750821d232c5/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:27.266837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceca0e2-1279-4b2d-a82e-62fcd1af60ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=303c04e9c5bb46ffa289e714cabe247f, user_id=0aa7219b1d83442eb7f8750821d232c5, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:27.269480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceca0e2-1279-4b2d-a82e-62fcd1af60ad admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:27.281113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1185/2404] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:27 2022] PUT /identity/v3/projects/303c04e9c5bb46ffa289e714cabe247f/users/0aa7219b1d83442eb7f8750821d232c5/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:27.291430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636404-7368-40ed-a115-19157ef476f0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:27.291729 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636404-7368-40ed-a115-19157ef476f0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:27.292008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636404-7368-40ed-a115-19157ef476f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:27.300288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:27.321630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7c636404-7368-40ed-a115-19157ef476f0 None None] MFA Rules not processed for user `0aa7219b1d83442eb7f8750821d232c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:27.322840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7c636404-7368-40ed-a115-19157ef476f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:27.389933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1220/2405] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:27.401810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceca0e2-1279-4b2d-a82e-62fcd1af60ad admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:27.403602 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4ceca0e2-1279-4b2d-a82e-62fcd1af60ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:27.443059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:27.461779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceca0e2-1279-4b2d-a82e-62fcd1af60ad admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:27.465321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cfcf0-4eb9-4d22-b08a-66e10f58c010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:27.465935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cfcf0-4eb9-4d22-b08a-66e10f58c010 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:27.466215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cfcf0-4eb9-4d22-b08a-66e10f58c010 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:27.466492 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cfcf0-4eb9-4d22-b08a-66e10f58c010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:27.475392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cfcf0-4eb9-4d22-b08a-66e10f58c010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:27.476924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cfcf0-4eb9-4d22-b08a-66e10f58c010 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:27.487155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1186/2406] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:27.567953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636404-7368-40ed-a115-19157ef476f0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:27.578332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636404-7368-40ed-a115-19157ef476f0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:27.582242 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424eb07-8deb-42f9-b3af-7d69b595039d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:27.582859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424eb07-8deb-42f9-b3af-7d69b595039d service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:27.583163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424eb07-8deb-42f9-b3af-7d69b595039d service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:27.583439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424eb07-8deb-42f9-b3af-7d69b595039d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:27.641068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424eb07-8deb-42f9-b3af-7d69b595039d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:27.642504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424eb07-8deb-42f9-b3af-7d69b595039d service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:27.652554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1221/2407] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:30.383025 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cfcf0-4eb9-4d22-b08a-66e10f58c010 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:30.446260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cfcf0-4eb9-4d22-b08a-66e10f58c010 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:30.450772 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:30.451412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:30.451692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:30.451964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] PATH_INFO: `/v3/users/a2c0d6b77e344f5fb23ec60c8211aefc` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:30.453156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c0d6b77e344f5fb23ec60c8211aefc)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:30.455045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:30.505144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c0d6b77e344f5fb23ec60c8211aefc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:30.514387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c0d6b77e344f5fb23ec60c8211aefc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:30.527831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c0d6b77e344f5fb23ec60c8211aefc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:30.528576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c0d6b77e344f5fb23ec60c8211aefc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:30.529211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c0d6b77e344f5fb23ec60c8211aefc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:30.544237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1187/2408] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:39:30 2022] DELETE /identity/v3/users/a2c0d6b77e344f5fb23ec60c8211aefc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:30.548724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09718aaa-c242-496b-949f-d3ebc28db23d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:30.549709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09718aaa-c242-496b-949f-d3ebc28db23d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:30.549997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09718aaa-c242-496b-949f-d3ebc28db23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:30.571134 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-09718aaa-c242-496b-949f-d3ebc28db23d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:30.572337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-09718aaa-c242-496b-949f-d3ebc28db23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:30.634349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1222/2409] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:39:30.644165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:30.645684 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:30.710235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdb6b6-5764-477d-a272-c67f1f3c19a1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:30.714165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd6e6-9ce0-4d95-969f-7cad06b306aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:30.714789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd6e6-9ce0-4d95-969f-7cad06b306aa service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:30.715072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd6e6-9ce0-4d95-969f-7cad06b306aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:30.715348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd6e6-9ce0-4d95-969f-7cad06b306aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:30.724745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dd6e6-9ce0-4d95-969f-7cad06b306aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:30.726248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dd6e6-9ce0-4d95-969f-7cad06b306aa service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:30.731846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:30.741286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1188/2410] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:31.013028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09718aaa-c242-496b-949f-d3ebc28db23d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:31.014454 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-09718aaa-c242-496b-949f-d3ebc28db23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:31.028570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09718aaa-c242-496b-949f-d3ebc28db23d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:31.033509 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:31.034677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:31.035124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:31.035402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] PATH_INFO: `/v3/projects/84b8cfd82c0f418796adcfb2c82f87a0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:31.036559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b8cfd82c0f418796adcfb2c82f87a0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:31.039253 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:31.065177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:31.088202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b8cfd82c0f418796adcfb2c82f87a0', 'request_id': 'req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.093693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b8cfd82c0f418796adcfb2c82f87a0', 'request_id': 'req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.101974 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b8cfd82c0f418796adcfb2c82f87a0', 'request_id': 'req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.113254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] The token cache is being invalidate because project 84b8cfd82c0f418796adcfb2c82f87a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:31.113542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.114161 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.115740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1223/2411] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:31 2022] DELETE /identity/v3/projects/84b8cfd82c0f418796adcfb2c82f87a0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:31.119789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd6e6-9ce0-4d95-969f-7cad06b306aa service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:31.129435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd6e6-9ce0-4d95-969f-7cad06b306aa service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:31.186024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b916fc2-fd67-4134-b8ea-13af3e494509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:31.186655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b916fc2-fd67-4134-b8ea-13af3e494509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:31.186934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b916fc2-fd67-4134-b8ea-13af3e494509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:31.187207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b916fc2-fd67-4134-b8ea-13af3e494509 admin admin] PATH_INFO: `/v3/users/0aa7219b1d83442eb7f8750821d232c5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:31.188339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b916fc2-fd67-4134-b8ea-13af3e494509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa7219b1d83442eb7f8750821d232c5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:31.190285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b916fc2-fd67-4134-b8ea-13af3e494509 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:31.235569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1b916fc2-fd67-4134-b8ea-13af3e494509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa7219b1d83442eb7f8750821d232c5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.242551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1b916fc2-fd67-4134-b8ea-13af3e494509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa7219b1d83442eb7f8750821d232c5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.254106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1b916fc2-fd67-4134-b8ea-13af3e494509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa7219b1d83442eb7f8750821d232c5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.254746 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1b916fc2-fd67-4134-b8ea-13af3e494509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa7219b1d83442eb7f8750821d232c5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.255336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1b916fc2-fd67-4134-b8ea-13af3e494509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa7219b1d83442eb7f8750821d232c5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.268651 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1189/2412] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:39:31 2022] DELETE /identity/v3/users/0aa7219b1d83442eb7f8750821d232c5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:31.545952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:31.547917 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:31.563081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0c549-429b-4c30-be00-dc9cc05ddfd4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:31.620473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472151e-d27a-40f1-9799-00e541e17148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:31.621077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472151e-d27a-40f1-9799-00e541e17148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:31.621362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472151e-d27a-40f1-9799-00e541e17148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:31.621634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472151e-d27a-40f1-9799-00e541e17148 admin admin] PATH_INFO: `/v3/projects/303c04e9c5bb46ffa289e714cabe247f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:31.622869 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472151e-d27a-40f1-9799-00e541e17148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=303c04e9c5bb46ffa289e714cabe247f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:31.624798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472151e-d27a-40f1-9799-00e541e17148 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:31.670183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1472151e-d27a-40f1-9799-00e541e17148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '303c04e9c5bb46ffa289e714cabe247f', 'request_id': 'req-1472151e-d27a-40f1-9799-00e541e17148'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.675611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1472151e-d27a-40f1-9799-00e541e17148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '303c04e9c5bb46ffa289e714cabe247f', 'request_id': 'req-1472151e-d27a-40f1-9799-00e541e17148'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.683186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1472151e-d27a-40f1-9799-00e541e17148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '303c04e9c5bb46ffa289e714cabe247f', 'request_id': 'req-1472151e-d27a-40f1-9799-00e541e17148'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.693965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1472151e-d27a-40f1-9799-00e541e17148 admin admin] The token cache is being invalidate because project 303c04e9c5bb46ffa289e714cabe247f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:31.694325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1472151e-d27a-40f1-9799-00e541e17148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.694878 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1472151e-d27a-40f1-9799-00e541e17148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:31.696353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1224/2413] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:31 2022] DELETE /identity/v3/projects/303c04e9c5bb46ffa289e714cabe247f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:31.701246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ce34d-7125-4d22-b6c4-d9b4372e7c21 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:31.701705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ce34d-7125-4d22-b6c4-d9b4372e7c21 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:31.701818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ce34d-7125-4d22-b6c4-d9b4372e7c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:31.722053 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5b2ce34d-7125-4d22-b6c4-d9b4372e7c21 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:31.723243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5b2ce34d-7125-4d22-b6c4-d9b4372e7c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:31.783167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1190/2414] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:31.792191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b933f-c4c2-4c57-ab16-9544294b3440 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:31.792501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b933f-c4c2-4c57-ab16-9544294b3440 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:31.792784 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b933f-c4c2-4c57-ab16-9544294b3440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:31.813209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2d8b933f-c4c2-4c57-ab16-9544294b3440 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:31.814408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2d8b933f-c4c2-4c57-ab16-9544294b3440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:31.823468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1225/2415] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:31.827626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ce34d-7125-4d22-b6c4-d9b4372e7c21 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:31.837256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ce34d-7125-4d22-b6c4-d9b4372e7c21 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:31.841734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fcbf3-239e-4440-97fd-de50f8d9d60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:31.842341 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fcbf3-239e-4440-97fd-de50f8d9d60e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:31.842616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fcbf3-239e-4440-97fd-de50f8d9d60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:31.842889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fcbf3-239e-4440-97fd-de50f8d9d60e admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:31.843576 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fcbf3-239e-4440-97fd-de50f8d9d60e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:39:31.843879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fcbf3-239e-4440-97fd-de50f8d9d60e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:31.845488 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fcbf3-239e-4440-97fd-de50f8d9d60e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:31.857257 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1191/2416] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:39:31.861449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b933f-c4c2-4c57-ab16-9544294b3440 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:31.871724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b933f-c4c2-4c57-ab16-9544294b3440 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:31.876244 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98660095-45de-4887-abfe-81e5e948b4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:31.876843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98660095-45de-4887-abfe-81e5e948b4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:31.877154 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98660095-45de-4887-abfe-81e5e948b4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:31.877428 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98660095-45de-4887-abfe-81e5e948b4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:31.878096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98660095-45de-4887-abfe-81e5e948b4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:31.879975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98660095-45de-4887-abfe-81e5e948b4f0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:31.907667 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1226/2417] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:31 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:31.911836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fcbf3-239e-4440-97fd-de50f8d9d60e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:31.922285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fcbf3-239e-4440-97fd-de50f8d9d60e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:31.926067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:31.981306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe94feb-8627-44e8-af80-21b97e666611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:31.981909 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe94feb-8627-44e8-af80-21b97e666611 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:31.982193 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe94feb-8627-44e8-af80-21b97e666611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:31.982466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe94feb-8627-44e8-af80-21b97e666611 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:31.983120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe94feb-8627-44e8-af80-21b97e666611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:31.985035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe94feb-8627-44e8-af80-21b97e666611 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:32.005633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1192/2418] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:39:31 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:32.011570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98660095-45de-4887-abfe-81e5e948b4f0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:32.021652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98660095-45de-4887-abfe-81e5e948b4f0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:32.026377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30001e68-9f40-4f60-a34a-9f18ca0e716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:32.026972 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30001e68-9f40-4f60-a34a-9f18ca0e716e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.027251 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30001e68-9f40-4f60-a34a-9f18ca0e716e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.027521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30001e68-9f40-4f60-a34a-9f18ca0e716e admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.028209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30001e68-9f40-4f60-a34a-9f18ca0e716e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:32.029880 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30001e68-9f40-4f60-a34a-9f18ca0e716e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:32.040002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1227/2419] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:32.043975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe94feb-8627-44e8-af80-21b97e666611 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:32.054988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe94feb-8627-44e8-af80-21b97e666611 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:32.060426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc2d9e-6dcc-43f4-a0c7-0187403165ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:32.061070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc2d9e-6dcc-43f4-a0c7-0187403165ea admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.061389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc2d9e-6dcc-43f4-a0c7-0187403165ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.061666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc2d9e-6dcc-43f4-a0c7-0187403165ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.062360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc2d9e-6dcc-43f4-a0c7-0187403165ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:32.063947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc2d9e-6dcc-43f4-a0c7-0187403165ea admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:32.074604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1193/2420] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:32.078733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30001e68-9f40-4f60-a34a-9f18ca0e716e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:32.083813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:32.093648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30001e68-9f40-4f60-a34a-9f18ca0e716e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:32.098368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3f262-3227-4d80-98cb-8711c10a0a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:32.099045 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3f262-3227-4d80-98cb-8711c10a0a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.099335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3f262-3227-4d80-98cb-8711c10a0a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.099617 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3f262-3227-4d80-98cb-8711c10a0a5c admin admin] PATH_INFO: `/v3/projects/3d77efb5f0bf402a86e5480d7bdc223c/users/9d72b641b30a4620bb60c7675f330380/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.115037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3f262-3227-4d80-98cb-8711c10a0a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d77efb5f0bf402a86e5480d7bdc223c, user_id=9d72b641b30a4620bb60c7675f330380, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:32.118330 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3f262-3227-4d80-98cb-8711c10a0a5c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:32.131427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1228/2421] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:32 2022] PUT /identity/v3/projects/3d77efb5f0bf402a86e5480d7bdc223c/users/9d72b641b30a4620bb60c7675f330380/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:32.141876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814548-5008-443d-8fcb-6460f6c2e441 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.142306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814548-5008-443d-8fcb-6460f6c2e441 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.142448 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814548-5008-443d-8fcb-6460f6c2e441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.170514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-98814548-5008-443d-8fcb-6460f6c2e441 None None] MFA Rules not processed for user `9d72b641b30a4620bb60c7675f330380`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:32.171731 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-98814548-5008-443d-8fcb-6460f6c2e441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:32.235080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1194/2422] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:32.239552 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3f262-3227-4d80-98cb-8711c10a0a5c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:32.307194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3f262-3227-4d80-98cb-8711c10a0a5c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:32.311905 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d2529-c6ff-4e73-94ae-4c3a23e37175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:32.312527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d2529-c6ff-4e73-94ae-4c3a23e37175 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.312814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d2529-c6ff-4e73-94ae-4c3a23e37175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.313133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d2529-c6ff-4e73-94ae-4c3a23e37175 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.313815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d2529-c6ff-4e73-94ae-4c3a23e37175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:32.315703 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d2529-c6ff-4e73-94ae-4c3a23e37175 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:32.342535 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1229/2423] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:32 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:32.346515 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98814548-5008-443d-8fcb-6460f6c2e441 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:32.357662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98814548-5008-443d-8fcb-6460f6c2e441 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:32.413533 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d662e6-92b4-4870-a766-7b11910a9a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:32.414081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d662e6-92b4-4870-a766-7b11910a9a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.415122 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d662e6-92b4-4870-a766-7b11910a9a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.415122 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d662e6-92b4-4870-a766-7b11910a9a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.415852 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d662e6-92b4-4870-a766-7b11910a9a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:32.417795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d662e6-92b4-4870-a766-7b11910a9a7e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:32.438295 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1195/2424] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:39:32 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:39:32.442319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d2529-c6ff-4e73-94ae-4c3a23e37175 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:32.452556 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d2529-c6ff-4e73-94ae-4c3a23e37175 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:32.457183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f4ee1-64b9-4024-9dcb-7453fad28caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:32.457795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f4ee1-64b9-4024-9dcb-7453fad28caf admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.458083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f4ee1-64b9-4024-9dcb-7453fad28caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.458358 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f4ee1-64b9-4024-9dcb-7453fad28caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.459061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f4ee1-64b9-4024-9dcb-7453fad28caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:32.460637 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f4ee1-64b9-4024-9dcb-7453fad28caf admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:32.471679 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1230/2425] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:32.475880 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d662e6-92b4-4870-a766-7b11910a9a7e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:32.482722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:32.486545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d662e6-92b4-4870-a766-7b11910a9a7e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:32.491945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c6e72-8072-4888-8140-ec11120a110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:32.492624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c6e72-8072-4888-8140-ec11120a110c admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.492922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c6e72-8072-4888-8140-ec11120a110c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.493234 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c6e72-8072-4888-8140-ec11120a110c admin admin] PATH_INFO: `/v3/projects/d35eeb1eb6da401fb741aaa9b417eae1/users/3e8ae65e1d554ebca0cf35596cb716fb/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.508408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c6e72-8072-4888-8140-ec11120a110c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35eeb1eb6da401fb741aaa9b417eae1, user_id=3e8ae65e1d554ebca0cf35596cb716fb, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:32.511262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c6e72-8072-4888-8140-ec11120a110c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:32.524213 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1196/2426] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:32 2022] PUT /identity/v3/projects/d35eeb1eb6da401fb741aaa9b417eae1/users/3e8ae65e1d554ebca0cf35596cb716fb/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:32.528325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f4ee1-64b9-4024-9dcb-7453fad28caf admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:32.538135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f4ee1-64b9-4024-9dcb-7453fad28caf admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:32.594483 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68015b-7b35-4900-9b62-201b5a31f555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:32.595147 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68015b-7b35-4900-9b62-201b5a31f555 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.595360 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68015b-7b35-4900-9b62-201b5a31f555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.595631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68015b-7b35-4900-9b62-201b5a31f555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.596309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68015b-7b35-4900-9b62-201b5a31f555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:32.597939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68015b-7b35-4900-9b62-201b5a31f555 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:32.607779 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1231/2427] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:32.611986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c6e72-8072-4888-8140-ec11120a110c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:32.622389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c6e72-8072-4888-8140-ec11120a110c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:32.627059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fef41-0ada-4c3e-91ac-35c65cac091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:32.627721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fef41-0ada-4c3e-91ac-35c65cac091d admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.628006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fef41-0ada-4c3e-91ac-35c65cac091d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.628282 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fef41-0ada-4c3e-91ac-35c65cac091d admin admin] PATH_INFO: `/v3/projects/d35eeb1eb6da401fb741aaa9b417eae1/users/3e8ae65e1d554ebca0cf35596cb716fb/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.630250 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fef41-0ada-4c3e-91ac-35c65cac091d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35eeb1eb6da401fb741aaa9b417eae1, user_id=3e8ae65e1d554ebca0cf35596cb716fb, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:32.633701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fef41-0ada-4c3e-91ac-35c65cac091d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:32.643739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1197/2428] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:32 2022] PUT /identity/v3/projects/d35eeb1eb6da401fb741aaa9b417eae1/users/3e8ae65e1d554ebca0cf35596cb716fb/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:32.653900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5befb-30a0-4da7-883d-8b712604dbe7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.654196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5befb-30a0-4da7-883d-8b712604dbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.654475 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5befb-30a0-4da7-883d-8b712604dbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.682472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d8e5befb-30a0-4da7-883d-8b712604dbe7 None None] MFA Rules not processed for user `3e8ae65e1d554ebca0cf35596cb716fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:32.683608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d8e5befb-30a0-4da7-883d-8b712604dbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:32.720705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:32.752487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1232/2429] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:32.763897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fef41-0ada-4c3e-91ac-35c65cac091d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:32.765721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-839fef41-0ada-4c3e-91ac-35c65cac091d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:32.822371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fef41-0ada-4c3e-91ac-35c65cac091d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:32.826067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd9fff-fe93-4a77-8cca-37dffcc5e0d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:32.826680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd9fff-fe93-4a77-8cca-37dffcc5e0d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.826964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd9fff-fe93-4a77-8cca-37dffcc5e0d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.827243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd9fff-fe93-4a77-8cca-37dffcc5e0d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.836082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd9fff-fe93-4a77-8cca-37dffcc5e0d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:32.837572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd9fff-fe93-4a77-8cca-37dffcc5e0d2 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:32.846799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1198/2430] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:32.890720 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5befb-30a0-4da7-883d-8b712604dbe7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:32.892137 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d8e5befb-30a0-4da7-883d-8b712604dbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:32.903996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5befb-30a0-4da7-883d-8b712604dbe7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:32.907685 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd69867-11da-43ee-b396-3f0039e3dc67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:32.908304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd69867-11da-43ee-b396-3f0039e3dc67 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:32.908587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd69867-11da-43ee-b396-3f0039e3dc67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:32.908863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd69867-11da-43ee-b396-3f0039e3dc67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:32.967415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd69867-11da-43ee-b396-3f0039e3dc67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:32.968772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd69867-11da-43ee-b396-3f0039e3dc67 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:32.978160 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1233/2431] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:36.251075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd9fff-fe93-4a77-8cca-37dffcc5e0d2 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:36.312214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd9fff-fe93-4a77-8cca-37dffcc5e0d2 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:36.316625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:36.317281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:36.317560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:36.317832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] PATH_INFO: `/v3/users/9d72b641b30a4620bb60c7675f330380` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:36.318979 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d72b641b30a4620bb60c7675f330380)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:36.322017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:36.365543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d72b641b30a4620bb60c7675f330380'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:36.373799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d72b641b30a4620bb60c7675f330380'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:36.385591 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:36.386810 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d72b641b30a4620bb60c7675f330380'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:36.387804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d72b641b30a4620bb60c7675f330380'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:36.388672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d72b641b30a4620bb60c7675f330380'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:36.402588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1199/2432] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:39:36 2022] DELETE /identity/v3/users/9d72b641b30a4620bb60c7675f330380 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:36.407290 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81296acd-cb81-4e71-8265-bbb0324e26a8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:36.407759 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81296acd-cb81-4e71-8265-bbb0324e26a8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:36.407857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81296acd-cb81-4e71-8265-bbb0324e26a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:36.426739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-81296acd-cb81-4e71-8265-bbb0324e26a8 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:36.427918 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-81296acd-cb81-4e71-8265-bbb0324e26a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:36.484277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1234/2433] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:36.493800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:36.495189 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:36.551570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f9b1d-d18b-4e31-8259-9281ca850093 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:36.555990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af96dd5-60f7-4978-9a27-8ff72bed9756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:36.556610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af96dd5-60f7-4978-9a27-8ff72bed9756 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:36.556894 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af96dd5-60f7-4978-9a27-8ff72bed9756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:36.557197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af96dd5-60f7-4978-9a27-8ff72bed9756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:36.566214 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af96dd5-60f7-4978-9a27-8ff72bed9756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:36.567634 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af96dd5-60f7-4978-9a27-8ff72bed9756 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:36.577293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1200/2434] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:36.842354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81296acd-cb81-4e71-8265-bbb0324e26a8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:36.843877 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-81296acd-cb81-4e71-8265-bbb0324e26a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:36.858269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81296acd-cb81-4e71-8265-bbb0324e26a8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:36.862806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:36.863444 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:36.863725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:36.864520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] PATH_INFO: `/v3/projects/3d77efb5f0bf402a86e5480d7bdc223c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:36.865885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d77efb5f0bf402a86e5480d7bdc223c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:36.868215 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:36.916571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d77efb5f0bf402a86e5480d7bdc223c', 'request_id': 'req-6573f99a-5236-4d90-9c93-bc8b75bc8e41'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:36.922116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d77efb5f0bf402a86e5480d7bdc223c', 'request_id': 'req-6573f99a-5236-4d90-9c93-bc8b75bc8e41'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:36.929124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d77efb5f0bf402a86e5480d7bdc223c', 'request_id': 'req-6573f99a-5236-4d90-9c93-bc8b75bc8e41'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:36.931130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:36.942192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] The token cache is being invalidate because project 3d77efb5f0bf402a86e5480d7bdc223c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:36.942488 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:36.943294 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:36.944802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1235/2435] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:36 2022] DELETE /identity/v3/projects/3d77efb5f0bf402a86e5480d7bdc223c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:36.948876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af96dd5-60f7-4978-9a27-8ff72bed9756 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:36.958399 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af96dd5-60f7-4978-9a27-8ff72bed9756 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:37.014944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b68ab7-970e-47a0-b6a9-964b6600cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:37.015506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68ab7-970e-47a0-b6a9-964b6600cfa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:37.015793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68ab7-970e-47a0-b6a9-964b6600cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:37.016073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b68ab7-970e-47a0-b6a9-964b6600cfa0 admin admin] PATH_INFO: `/v3/users/3e8ae65e1d554ebca0cf35596cb716fb` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:37.017269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b68ab7-970e-47a0-b6a9-964b6600cfa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8ae65e1d554ebca0cf35596cb716fb)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:37.019187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b68ab7-970e-47a0-b6a9-964b6600cfa0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:37.066552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02b68ab7-970e-47a0-b6a9-964b6600cfa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8ae65e1d554ebca0cf35596cb716fb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:37.074346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02b68ab7-970e-47a0-b6a9-964b6600cfa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8ae65e1d554ebca0cf35596cb716fb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:37.085799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02b68ab7-970e-47a0-b6a9-964b6600cfa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8ae65e1d554ebca0cf35596cb716fb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:37.087600 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02b68ab7-970e-47a0-b6a9-964b6600cfa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8ae65e1d554ebca0cf35596cb716fb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:37.088217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02b68ab7-970e-47a0-b6a9-964b6600cfa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8ae65e1d554ebca0cf35596cb716fb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:37.100407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1201/2436] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:39:36 2022] DELETE /identity/v3/users/3e8ae65e1d554ebca0cf35596cb716fb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:37.385596 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:37.387155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:37.402418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573f99a-5236-4d90-9c93-bc8b75bc8e41 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:37.463388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:37.464021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:37.464305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:37.464581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a admin admin] PATH_INFO: `/v3/projects/d35eeb1eb6da401fb741aaa9b417eae1` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:37.465842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35eeb1eb6da401fb741aaa9b417eae1)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:37.467730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:37.517039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35eeb1eb6da401fb741aaa9b417eae1', 'request_id': 'req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:37.522476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35eeb1eb6da401fb741aaa9b417eae1', 'request_id': 'req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:37.530628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35eeb1eb6da401fb741aaa9b417eae1', 'request_id': 'req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:37.542355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a admin admin] The token cache is being invalidate because project d35eeb1eb6da401fb741aaa9b417eae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:37.542643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:37.543263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-440ef5d3-0868-4c09-a858-c89c7cbeeb0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:37.544748 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1236/2437] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:37 2022] DELETE /identity/v3/projects/d35eeb1eb6da401fb741aaa9b417eae1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:37.549618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f591f4-b7e4-4d35-80c6-495fe32b659d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:37.550075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f591f4-b7e4-4d35-80c6-495fe32b659d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:37.550169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f591f4-b7e4-4d35-80c6-495fe32b659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:37.570141 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-20f591f4-b7e4-4d35-80c6-495fe32b659d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:37.571445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-20f591f4-b7e4-4d35-80c6-495fe32b659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:37.576644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:37.631160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1202/2438] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:37.639628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb481c-9442-4eae-986a-b02228b9ba8c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:37.639918 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb481c-9442-4eae-986a-b02228b9ba8c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:37.640197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb481c-9442-4eae-986a-b02228b9ba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:37.659677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9bcb481c-9442-4eae-986a-b02228b9ba8c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:37.660922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9bcb481c-9442-4eae-986a-b02228b9ba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:37.668960 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1237/2439] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:37.673024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f591f4-b7e4-4d35-80c6-495fe32b659d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:37.683192 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f591f4-b7e4-4d35-80c6-495fe32b659d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:37.687637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4663e52-ada4-44b1-91a2-362143bb2741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:37.688236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4663e52-ada4-44b1-91a2-362143bb2741 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:37.688531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4663e52-ada4-44b1-91a2-362143bb2741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:37.688794 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4663e52-ada4-44b1-91a2-362143bb2741 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:37.689525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4663e52-ada4-44b1-91a2-362143bb2741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:39:37.689828 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4663e52-ada4-44b1-91a2-362143bb2741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:37.691391 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4663e52-ada4-44b1-91a2-362143bb2741 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:37.702867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1203/2440] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:39:37.707124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb481c-9442-4eae-986a-b02228b9ba8c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:37.717011 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb481c-9442-4eae-986a-b02228b9ba8c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:37.721631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212487-c4aa-4fe9-8ebd-304f550c7e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:37.722234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212487-c4aa-4fe9-8ebd-304f550c7e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:37.722518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212487-c4aa-4fe9-8ebd-304f550c7e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:37.722795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212487-c4aa-4fe9-8ebd-304f550c7e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:37.723471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99212487-c4aa-4fe9-8ebd-304f550c7e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:37.725433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99212487-c4aa-4fe9-8ebd-304f550c7e86 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:37.754065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1238/2441] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:37 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:37.758611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4663e52-ada4-44b1-91a2-362143bb2741 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:37.768357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4663e52-ada4-44b1-91a2-362143bb2741 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:37.823721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f942a-ae3b-4c34-92d6-a21588748b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:37.824266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f942a-ae3b-4c34-92d6-a21588748b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:37.824561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f942a-ae3b-4c34-92d6-a21588748b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:37.824830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f942a-ae3b-4c34-92d6-a21588748b8c admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:37.825539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f942a-ae3b-4c34-92d6-a21588748b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:37.827437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f942a-ae3b-4c34-92d6-a21588748b8c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:37.848211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1204/2442] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:39:37 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:37.852372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212487-c4aa-4fe9-8ebd-304f550c7e86 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:37.862756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212487-c4aa-4fe9-8ebd-304f550c7e86 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:37.867353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b26951-1d2c-44a5-b16c-acfe3cedd299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:37.867951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26951-1d2c-44a5-b16c-acfe3cedd299 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:37.868234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26951-1d2c-44a5-b16c-acfe3cedd299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:37.868506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26951-1d2c-44a5-b16c-acfe3cedd299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:37.869233 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b26951-1d2c-44a5-b16c-acfe3cedd299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:37.870812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b26951-1d2c-44a5-b16c-acfe3cedd299 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:37.880469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1239/2443] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:37.890284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f942a-ae3b-4c34-92d6-a21588748b8c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:37.901261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f942a-ae3b-4c34-92d6-a21588748b8c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:37.905832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8457f9-612d-4ed4-8ef3-6c4a215651b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:37.906544 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8457f9-612d-4ed4-8ef3-6c4a215651b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:37.906830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8457f9-612d-4ed4-8ef3-6c4a215651b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:37.907105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8457f9-612d-4ed4-8ef3-6c4a215651b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:37.907793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8457f9-612d-4ed4-8ef3-6c4a215651b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:37.909405 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8457f9-612d-4ed4-8ef3-6c4a215651b3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:37.920055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1205/2444] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:37.924289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b26951-1d2c-44a5-b16c-acfe3cedd299 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:37.934798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b26951-1d2c-44a5-b16c-acfe3cedd299 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:37.939317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b986e-c98e-4c1f-8a67-e3edcdc1dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:37.940075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b986e-c98e-4c1f-8a67-e3edcdc1dc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:37.940387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b986e-c98e-4c1f-8a67-e3edcdc1dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:37.940659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b986e-c98e-4c1f-8a67-e3edcdc1dc20 admin admin] PATH_INFO: `/v3/projects/da03e4fa2a884fc6a9c68c250fedb9b8/users/3ebd61e7af8a4b7e8bd61f7990fa7cc4/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:37.955652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b986e-c98e-4c1f-8a67-e3edcdc1dc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da03e4fa2a884fc6a9c68c250fedb9b8, user_id=3ebd61e7af8a4b7e8bd61f7990fa7cc4, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:37.958351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b986e-c98e-4c1f-8a67-e3edcdc1dc20 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:37.971925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1240/2445] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:37 2022] PUT /identity/v3/projects/da03e4fa2a884fc6a9c68c250fedb9b8/users/3ebd61e7af8a4b7e8bd61f7990fa7cc4/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:37.982191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ec44b-856c-4024-a46c-1f48330f7dc8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:37.982481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ec44b-856c-4024-a46c-1f48330f7dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:37.982764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ec44b-856c-4024-a46c-1f48330f7dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:38.010405 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e04ec44b-856c-4024-a46c-1f48330f7dc8 None None] MFA Rules not processed for user `3ebd61e7af8a4b7e8bd61f7990fa7cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:38.011610 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e04ec44b-856c-4024-a46c-1f48330f7dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:38.076262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1206/2446] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:38.080689 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b986e-c98e-4c1f-8a67-e3edcdc1dc20 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:38.105879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:38.144447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b986e-c98e-4c1f-8a67-e3edcdc1dc20 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:38.149712 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1ee40-a144-4e67-90c8-986912c86771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:38.150321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1ee40-a144-4e67-90c8-986912c86771 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:38.150600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1ee40-a144-4e67-90c8-986912c86771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:38.150873 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1ee40-a144-4e67-90c8-986912c86771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:38.151536 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1ee40-a144-4e67-90c8-986912c86771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:38.153434 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1ee40-a144-4e67-90c8-986912c86771 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:38.178697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1241/2447] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:38 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:38.183397 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ec44b-856c-4024-a46c-1f48330f7dc8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:38.194085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ec44b-856c-4024-a46c-1f48330f7dc8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:38.198310 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:38.251703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaa646-228e-4ade-b4ea-d3d41133ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:38.252323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaa646-228e-4ade-b4ea-d3d41133ee85 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:38.252611 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaa646-228e-4ade-b4ea-d3d41133ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:38.252891 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaa646-228e-4ade-b4ea-d3d41133ee85 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:38.253587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaa646-228e-4ade-b4ea-d3d41133ee85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:38.255501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaa646-228e-4ade-b4ea-d3d41133ee85 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:38.278432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1207/2448] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:39:38 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:38.282769 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1ee40-a144-4e67-90c8-986912c86771 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:38.293048 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1ee40-a144-4e67-90c8-986912c86771 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:38.297692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d3138-8976-4091-b3c9-d47b95758194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:38.298298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d3138-8976-4091-b3c9-d47b95758194 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:38.298583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d3138-8976-4091-b3c9-d47b95758194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:38.298860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d3138-8976-4091-b3c9-d47b95758194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:38.299558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d3138-8976-4091-b3c9-d47b95758194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:38.301179 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d3138-8976-4091-b3c9-d47b95758194 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:38.312217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1242/2449] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:38.316602 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaa646-228e-4ade-b4ea-d3d41133ee85 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:38.327293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaa646-228e-4ade-b4ea-d3d41133ee85 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:38.331765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0c707-18f9-4962-87f7-ecb93aa368ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:38.332412 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0c707-18f9-4962-87f7-ecb93aa368ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:38.332695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0c707-18f9-4962-87f7-ecb93aa368ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:38.332989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0c707-18f9-4962-87f7-ecb93aa368ff admin admin] PATH_INFO: `/v3/projects/21cedc882aa045a4aec8cd8833f3068f/users/dfbc8ea8e61c4b8db5835df581c2233e/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:38.347297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0c707-18f9-4962-87f7-ecb93aa368ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cedc882aa045a4aec8cd8833f3068f, user_id=dfbc8ea8e61c4b8db5835df581c2233e, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:38.349969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0c707-18f9-4962-87f7-ecb93aa368ff admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:38.362778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1208/2450] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:38 2022] PUT /identity/v3/projects/21cedc882aa045a4aec8cd8833f3068f/users/dfbc8ea8e61c4b8db5835df581c2233e/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:38.366704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d3138-8976-4091-b3c9-d47b95758194 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:38.377461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d3138-8976-4091-b3c9-d47b95758194 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:38.433622 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557d754-da05-4e2e-9b26-f43c20f081c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:38.434249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557d754-da05-4e2e-9b26-f43c20f081c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:38.434538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557d754-da05-4e2e-9b26-f43c20f081c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:38.434818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557d754-da05-4e2e-9b26-f43c20f081c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:38.435520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557d754-da05-4e2e-9b26-f43c20f081c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:38.437135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557d754-da05-4e2e-9b26-f43c20f081c2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:38.446921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1243/2451] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:38.451207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0c707-18f9-4962-87f7-ecb93aa368ff admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:38.461911 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0c707-18f9-4962-87f7-ecb93aa368ff admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:38.466465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5295d50-7eb5-4c54-8bf9-44b588c0e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:38.467116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5295d50-7eb5-4c54-8bf9-44b588c0e810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:38.467395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5295d50-7eb5-4c54-8bf9-44b588c0e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:38.467668 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5295d50-7eb5-4c54-8bf9-44b588c0e810 admin admin] PATH_INFO: `/v3/projects/21cedc882aa045a4aec8cd8833f3068f/users/dfbc8ea8e61c4b8db5835df581c2233e/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:38.469594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5295d50-7eb5-4c54-8bf9-44b588c0e810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cedc882aa045a4aec8cd8833f3068f, user_id=dfbc8ea8e61c4b8db5835df581c2233e, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:38.472175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5295d50-7eb5-4c54-8bf9-44b588c0e810 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:38.482179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1209/2452] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:38 2022] PUT /identity/v3/projects/21cedc882aa045a4aec8cd8833f3068f/users/dfbc8ea8e61c4b8db5835df581c2233e/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:38.493528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950decf-69d1-44f2-87d7-844c7c93f87f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:38.494019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950decf-69d1-44f2-87d7-844c7c93f87f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:38.494128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950decf-69d1-44f2-87d7-844c7c93f87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:38.522469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d950decf-69d1-44f2-87d7-844c7c93f87f None None] MFA Rules not processed for user `dfbc8ea8e61c4b8db5835df581c2233e`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:38.523799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d950decf-69d1-44f2-87d7-844c7c93f87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:38.590628 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1244/2453] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:38.603444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5295d50-7eb5-4c54-8bf9-44b588c0e810 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:38.605184 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e5295d50-7eb5-4c54-8bf9-44b588c0e810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:38.662429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5295d50-7eb5-4c54-8bf9-44b588c0e810 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:38.666834 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904b5e6-f18e-413d-a950-36f511846e3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:38.667500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904b5e6-f18e-413d-a950-36f511846e3d service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:38.667787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904b5e6-f18e-413d-a950-36f511846e3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:38.668063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904b5e6-f18e-413d-a950-36f511846e3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:38.677073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904b5e6-f18e-413d-a950-36f511846e3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:38.678545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904b5e6-f18e-413d-a950-36f511846e3d service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:38.688075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1210/2454] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:38.990515 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950decf-69d1-44f2-87d7-844c7c93f87f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:39.000103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950decf-69d1-44f2-87d7-844c7c93f87f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:39.004631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cd9ad-f42b-46ab-a9cd-4a00baf1d231 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfbc8ea8e61c4b8db5835df581c2233e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21cedc882aa045a4aec8cd8833f3068f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:39.005271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cd9ad-f42b-46ab-a9cd-4a00baf1d231 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:39.005560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cd9ad-f42b-46ab-a9cd-4a00baf1d231 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:39.005836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cd9ad-f42b-46ab-a9cd-4a00baf1d231 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:39.006826 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cd9ad-f42b-46ab-a9cd-4a00baf1d231 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:39:39.007133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cd9ad-f42b-46ab-a9cd-4a00baf1d231 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:39.009359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cd9ad-f42b-46ab-a9cd-4a00baf1d231 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:39.020537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1245/2455] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:39:39.024655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904b5e6-f18e-413d-a950-36f511846e3d service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:39.034057 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904b5e6-f18e-413d-a950-36f511846e3d service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:39.038682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe329b-6aff-4b51-ba8a-ac9549c49da5 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfbc8ea8e61c4b8db5835df581c2233e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21cedc882aa045a4aec8cd8833f3068f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:39.039392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe329b-6aff-4b51-ba8a-ac9549c49da5 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:39.039682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe329b-6aff-4b51-ba8a-ac9549c49da5 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:39.039959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe329b-6aff-4b51-ba8a-ac9549c49da5 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:39.040616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe329b-6aff-4b51-ba8a-ac9549c49da5 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:39.042572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe329b-6aff-4b51-ba8a-ac9549c49da5 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:39.069933 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1211/2456] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:39 2022] POST /identity/v3/projects => generated 353 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:39.074764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cd9ad-f42b-46ab-a9cd-4a00baf1d231 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:39.081083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:39.085175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cd9ad-f42b-46ab-a9cd-4a00baf1d231 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:39.142502 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147768ca-165f-4178-8485-8f570d0ad670 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfbc8ea8e61c4b8db5835df581c2233e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21cedc882aa045a4aec8cd8833f3068f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:39.143104 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147768ca-165f-4178-8485-8f570d0ad670 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:39.143387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147768ca-165f-4178-8485-8f570d0ad670 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:39.143662 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147768ca-165f-4178-8485-8f570d0ad670 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:39.144353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147768ca-165f-4178-8485-8f570d0ad670 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:39:39.144655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147768ca-165f-4178-8485-8f570d0ad670 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:39.146270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147768ca-165f-4178-8485-8f570d0ad670 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:39.158484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1246/2457] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:39:39.194368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe329b-6aff-4b51-ba8a-ac9549c49da5 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:39.204593 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe329b-6aff-4b51-ba8a-ac9549c49da5 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:39.209211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caedf9-8853-4010-9953-01ada8ad1b9c tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfbc8ea8e61c4b8db5835df581c2233e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21cedc882aa045a4aec8cd8833f3068f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:39.209849 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caedf9-8853-4010-9953-01ada8ad1b9c tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:39.210140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caedf9-8853-4010-9953-01ada8ad1b9c tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:39.210420 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caedf9-8853-4010-9953-01ada8ad1b9c tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] PATH_INFO: `/v3/projects/d390c9a7c7894f33a0a86124cac47a3c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:39.212131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76caedf9-8853-4010-9953-01ada8ad1b9c tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d390c9a7c7894f33a0a86124cac47a3c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:39.214074 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76caedf9-8853-4010-9953-01ada8ad1b9c tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:39.251390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:39.263187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-76caedf9-8853-4010-9953-01ada8ad1b9c tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd390c9a7c7894f33a0a86124cac47a3c', 'request_id': 'req-76caedf9-8853-4010-9953-01ada8ad1b9c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:39.268565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-76caedf9-8853-4010-9953-01ada8ad1b9c tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd390c9a7c7894f33a0a86124cac47a3c', 'request_id': 'req-76caedf9-8853-4010-9953-01ada8ad1b9c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:39.276118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-76caedf9-8853-4010-9953-01ada8ad1b9c tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd390c9a7c7894f33a0a86124cac47a3c', 'request_id': 'req-76caedf9-8853-4010-9953-01ada8ad1b9c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:39.288325 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-76caedf9-8853-4010-9953-01ada8ad1b9c tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] The token cache is being invalidate because project d390c9a7c7894f33a0a86124cac47a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:39.288616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-76caedf9-8853-4010-9953-01ada8ad1b9c tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:39.289999 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-76caedf9-8853-4010-9953-01ada8ad1b9c tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:39.291661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1212/2458] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:39 2022] DELETE /identity/v3/projects/d390c9a7c7894f33a0a86124cac47a3c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:39.481208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147768ca-165f-4178-8485-8f570d0ad670 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:39.482913 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-147768ca-165f-4178-8485-8f570d0ad670 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:39.554307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147768ca-165f-4178-8485-8f570d0ad670 tempest-VolumeQuotaClassesTest-397660111 tempest-VolumeQuotaClassesTest-397660111-project-admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:39.609356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:39.609992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:39.610283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:39.610558 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] PATH_INFO: `/v3/users/3ebd61e7af8a4b7e8bd61f7990fa7cc4` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:39.611713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ebd61e7af8a4b7e8bd61f7990fa7cc4)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:39.613668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:39.659963 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ebd61e7af8a4b7e8bd61f7990fa7cc4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:39.661109 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:39.673762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ebd61e7af8a4b7e8bd61f7990fa7cc4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:39.674441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ebd61e7af8a4b7e8bd61f7990fa7cc4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:39.675049 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ebd61e7af8a4b7e8bd61f7990fa7cc4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:39.682582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ebd61e7af8a4b7e8bd61f7990fa7cc4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:39.694498 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1247/2459] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:39:39 2022] DELETE /identity/v3/users/3ebd61e7af8a4b7e8bd61f7990fa7cc4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:39.699682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2b1a4-54d3-443b-9c66-b72688aaefd1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:39.700147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2b1a4-54d3-443b-9c66-b72688aaefd1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:39.700244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2b1a4-54d3-443b-9c66-b72688aaefd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:39.718969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-83a2b1a4-54d3-443b-9c66-b72688aaefd1 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:39.720087 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-83a2b1a4-54d3-443b-9c66-b72688aaefd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:39.778384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1213/2460] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:39.787950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:39.789758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:39.848285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaaf31c-eed3-4688-8ced-e5a88a4826e9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:39.852379 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee7bfc-defd-42a6-9d6e-f217766c2993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:39.853050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee7bfc-defd-42a6-9d6e-f217766c2993 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:39.853346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee7bfc-defd-42a6-9d6e-f217766c2993 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:39.853625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee7bfc-defd-42a6-9d6e-f217766c2993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:39.863328 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee7bfc-defd-42a6-9d6e-f217766c2993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:39.864756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee7bfc-defd-42a6-9d6e-f217766c2993 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:39.874732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1248/2461] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:40.145623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2b1a4-54d3-443b-9c66-b72688aaefd1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:40.147442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-83a2b1a4-54d3-443b-9c66-b72688aaefd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:40.161612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2b1a4-54d3-443b-9c66-b72688aaefd1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:40.167161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:40.167813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:40.168127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:40.168402 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] PATH_INFO: `/v3/projects/da03e4fa2a884fc6a9c68c250fedb9b8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:40.169573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da03e4fa2a884fc6a9c68c250fedb9b8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:40.171454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:40.218242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da03e4fa2a884fc6a9c68c250fedb9b8', 'request_id': 'req-33ff3b1f-e33a-4ac5-8309-106880ab182a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.223898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da03e4fa2a884fc6a9c68c250fedb9b8', 'request_id': 'req-33ff3b1f-e33a-4ac5-8309-106880ab182a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.231392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da03e4fa2a884fc6a9c68c250fedb9b8', 'request_id': 'req-33ff3b1f-e33a-4ac5-8309-106880ab182a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.242546 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] The token cache is being invalidate because project da03e4fa2a884fc6a9c68c250fedb9b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:40.242821 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.243452 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.244977 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1214/2462] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:40 2022] DELETE /identity/v3/projects/da03e4fa2a884fc6a9c68c250fedb9b8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:40.248994 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee7bfc-defd-42a6-9d6e-f217766c2993 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:40.259192 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee7bfc-defd-42a6-9d6e-f217766c2993 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:40.313233 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f3e31-e7e9-40c9-9b3f-83c1b1cec6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:40.313863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f3e31-e7e9-40c9-9b3f-83c1b1cec6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:40.314145 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f3e31-e7e9-40c9-9b3f-83c1b1cec6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:40.314417 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f3e31-e7e9-40c9-9b3f-83c1b1cec6c3 admin admin] PATH_INFO: `/v3/users/dfbc8ea8e61c4b8db5835df581c2233e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:40.315560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f3e31-e7e9-40c9-9b3f-83c1b1cec6c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfbc8ea8e61c4b8db5835df581c2233e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:40.317546 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f3e31-e7e9-40c9-9b3f-83c1b1cec6c3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:40.362140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e34f3e31-e7e9-40c9-9b3f-83c1b1cec6c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfbc8ea8e61c4b8db5835df581c2233e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.374833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e34f3e31-e7e9-40c9-9b3f-83c1b1cec6c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfbc8ea8e61c4b8db5835df581c2233e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.375573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e34f3e31-e7e9-40c9-9b3f-83c1b1cec6c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfbc8ea8e61c4b8db5835df581c2233e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.376173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e34f3e31-e7e9-40c9-9b3f-83c1b1cec6c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfbc8ea8e61c4b8db5835df581c2233e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.379756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:40.384773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e34f3e31-e7e9-40c9-9b3f-83c1b1cec6c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfbc8ea8e61c4b8db5835df581c2233e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.400190 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1249/2463] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:39:40 2022] DELETE /identity/v3/users/dfbc8ea8e61c4b8db5835df581c2233e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:40.672991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:40.674415 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:40.688458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff3b1f-e33a-4ac5-8309-106880ab182a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:40.732996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:40.747127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea51733-d6a4-44d4-840a-6153998a6d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:40.747831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea51733-d6a4-44d4-840a-6153998a6d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:40.748062 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea51733-d6a4-44d4-840a-6153998a6d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:40.748340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea51733-d6a4-44d4-840a-6153998a6d0f admin admin] PATH_INFO: `/v3/projects/21cedc882aa045a4aec8cd8833f3068f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:40.749530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea51733-d6a4-44d4-840a-6153998a6d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=21cedc882aa045a4aec8cd8833f3068f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:40.751427 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea51733-d6a4-44d4-840a-6153998a6d0f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:40.799092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0ea51733-d6a4-44d4-840a-6153998a6d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21cedc882aa045a4aec8cd8833f3068f', 'request_id': 'req-0ea51733-d6a4-44d4-840a-6153998a6d0f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.805972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0ea51733-d6a4-44d4-840a-6153998a6d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21cedc882aa045a4aec8cd8833f3068f', 'request_id': 'req-0ea51733-d6a4-44d4-840a-6153998a6d0f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.813292 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0ea51733-d6a4-44d4-840a-6153998a6d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21cedc882aa045a4aec8cd8833f3068f', 'request_id': 'req-0ea51733-d6a4-44d4-840a-6153998a6d0f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.824244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0ea51733-d6a4-44d4-840a-6153998a6d0f admin admin] The token cache is being invalidate because project 21cedc882aa045a4aec8cd8833f3068f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:40.824528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0ea51733-d6a4-44d4-840a-6153998a6d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.825170 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0ea51733-d6a4-44d4-840a-6153998a6d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:40.826661 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1215/2464] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:40 2022] DELETE /identity/v3/projects/21cedc882aa045a4aec8cd8833f3068f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:40.831677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce1182-1eba-498b-ab25-2e3fc56392f7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:40.832129 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce1182-1eba-498b-ab25-2e3fc56392f7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:40.832225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce1182-1eba-498b-ab25-2e3fc56392f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:40.852021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a8ce1182-1eba-498b-ab25-2e3fc56392f7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:40.853239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a8ce1182-1eba-498b-ab25-2e3fc56392f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:40.911730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1250/2465] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:40.920307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdff42-0a66-4d24-9d72-3e7f0c238f0d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:40.920597 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdff42-0a66-4d24-9d72-3e7f0c238f0d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:40.920878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdff42-0a66-4d24-9d72-3e7f0c238f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:40.940889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8ccdff42-0a66-4d24-9d72-3e7f0c238f0d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:40.942124 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8ccdff42-0a66-4d24-9d72-3e7f0c238f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:40.950285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1216/2466] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:40.954477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce1182-1eba-498b-ab25-2e3fc56392f7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:40.964015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce1182-1eba-498b-ab25-2e3fc56392f7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:40.968493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769197c-52c5-49bb-bf10-9bb6f614dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:40.969114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769197c-52c5-49bb-bf10-9bb6f614dc62 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:40.969397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769197c-52c5-49bb-bf10-9bb6f614dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:40.969690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769197c-52c5-49bb-bf10-9bb6f614dc62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:40.970377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769197c-52c5-49bb-bf10-9bb6f614dc62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:39:40.970677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769197c-52c5-49bb-bf10-9bb6f614dc62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:40.972234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769197c-52c5-49bb-bf10-9bb6f614dc62 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:40.985119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1251/2467] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:39:40.989507 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdff42-0a66-4d24-9d72-3e7f0c238f0d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:40.999486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdff42-0a66-4d24-9d72-3e7f0c238f0d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:41.004088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774551e8-360c-4734-9c91-723698297433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:41.004686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774551e8-360c-4734-9c91-723698297433 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.005006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774551e8-360c-4734-9c91-723698297433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.005284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774551e8-360c-4734-9c91-723698297433 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.006211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774551e8-360c-4734-9c91-723698297433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:41.009290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774551e8-360c-4734-9c91-723698297433 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:41.037731 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1217/2468] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:40 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:39:41.042334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769197c-52c5-49bb-bf10-9bb6f614dc62 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:41.052472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769197c-52c5-49bb-bf10-9bb6f614dc62 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:41.108116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12ff67-f84c-4f4e-92dd-e82369b74f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:41.108750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12ff67-f84c-4f4e-92dd-e82369b74f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.109113 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12ff67-f84c-4f4e-92dd-e82369b74f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.109395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12ff67-f84c-4f4e-92dd-e82369b74f08 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.110067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12ff67-f84c-4f4e-92dd-e82369b74f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:41.111962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12ff67-f84c-4f4e-92dd-e82369b74f08 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:41.133406 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1252/2469] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:39:41 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:41.137625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774551e8-360c-4734-9c91-723698297433 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:41.147669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774551e8-360c-4734-9c91-723698297433 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:41.152787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630278b6-51e0-4d0c-95f7-b4b30241b9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:41.153419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630278b6-51e0-4d0c-95f7-b4b30241b9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.153696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630278b6-51e0-4d0c-95f7-b4b30241b9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.153968 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630278b6-51e0-4d0c-95f7-b4b30241b9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.154654 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630278b6-51e0-4d0c-95f7-b4b30241b9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:41.156220 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630278b6-51e0-4d0c-95f7-b4b30241b9b9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:41.165885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1218/2470] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:41.169598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12ff67-f84c-4f4e-92dd-e82369b74f08 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:41.179403 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12ff67-f84c-4f4e-92dd-e82369b74f08 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:41.184573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be40cc-272a-46a8-a532-3aa10b149e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:41.185207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be40cc-272a-46a8-a532-3aa10b149e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.185492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be40cc-272a-46a8-a532-3aa10b149e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.185768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be40cc-272a-46a8-a532-3aa10b149e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.186490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be40cc-272a-46a8-a532-3aa10b149e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:41.188068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be40cc-272a-46a8-a532-3aa10b149e89 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:41.199047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1253/2471] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:41.203004 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630278b6-51e0-4d0c-95f7-b4b30241b9b9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:41.212766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630278b6-51e0-4d0c-95f7-b4b30241b9b9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:41.217262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e0d42-a4c4-4d71-8a34-b1ddff960bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:41.217907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e0d42-a4c4-4d71-8a34-b1ddff960bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.218188 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e0d42-a4c4-4d71-8a34-b1ddff960bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.218466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e0d42-a4c4-4d71-8a34-b1ddff960bd3 admin admin] PATH_INFO: `/v3/projects/ff6907c53a1349798d0c2c451434f00e/users/65f1bcdfb66c43bba91034aa7f26d976/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.233431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e0d42-a4c4-4d71-8a34-b1ddff960bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6907c53a1349798d0c2c451434f00e, user_id=65f1bcdfb66c43bba91034aa7f26d976, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:41.236085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e0d42-a4c4-4d71-8a34-b1ddff960bd3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:41.249045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1219/2472] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:41 2022] PUT /identity/v3/projects/ff6907c53a1349798d0c2c451434f00e/users/65f1bcdfb66c43bba91034aa7f26d976/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:41.260400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc2b1-6e7d-4609-9fbb-746fbc31d487 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.260739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc2b1-6e7d-4609-9fbb-746fbc31d487 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.261207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc2b1-6e7d-4609-9fbb-746fbc31d487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.287800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-81ccc2b1-6e7d-4609-9fbb-746fbc31d487 None None] MFA Rules not processed for user `65f1bcdfb66c43bba91034aa7f26d976`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:41.289244 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-81ccc2b1-6e7d-4609-9fbb-746fbc31d487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:41.330154 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:41.354245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1254/2473] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:41.358690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e0d42-a4c4-4d71-8a34-b1ddff960bd3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:41.421683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e0d42-a4c4-4d71-8a34-b1ddff960bd3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:41.426301 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d5b46-0c55-49ef-a11a-1f3973d058cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:41.426909 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d5b46-0c55-49ef-a11a-1f3973d058cf admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.427188 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d5b46-0c55-49ef-a11a-1f3973d058cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.427455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d5b46-0c55-49ef-a11a-1f3973d058cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.428116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d5b46-0c55-49ef-a11a-1f3973d058cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:41.430791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d5b46-0c55-49ef-a11a-1f3973d058cf admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:41.450797 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:41.461807 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1220/2474] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:41 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:41.462938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc2b1-6e7d-4609-9fbb-746fbc31d487 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:41.473422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc2b1-6e7d-4609-9fbb-746fbc31d487 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:41.530693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e96668-e56e-4f44-a284-84fc1c543dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:41.531237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e96668-e56e-4f44-a284-84fc1c543dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.531521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e96668-e56e-4f44-a284-84fc1c543dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.531795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e96668-e56e-4f44-a284-84fc1c543dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.532477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e96668-e56e-4f44-a284-84fc1c543dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:41.534477 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e96668-e56e-4f44-a284-84fc1c543dc2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:41.556559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1255/2475] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:39:41 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:39:41.560663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d5b46-0c55-49ef-a11a-1f3973d058cf admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:41.571114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d5b46-0c55-49ef-a11a-1f3973d058cf admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:41.575712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223248cd-b5ad-4a62-a352-0b7515d6f7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:41.576321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223248cd-b5ad-4a62-a352-0b7515d6f7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.576606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223248cd-b5ad-4a62-a352-0b7515d6f7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.576887 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223248cd-b5ad-4a62-a352-0b7515d6f7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.577612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223248cd-b5ad-4a62-a352-0b7515d6f7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:41.579204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223248cd-b5ad-4a62-a352-0b7515d6f7f5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:41.589509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1221/2476] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:41.593271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e96668-e56e-4f44-a284-84fc1c543dc2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:41.603822 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e96668-e56e-4f44-a284-84fc1c543dc2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:41.608442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74da93-6c6f-4840-b900-a28f0f693ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:41.609079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74da93-6c6f-4840-b900-a28f0f693ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.609370 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74da93-6c6f-4840-b900-a28f0f693ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.609650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74da93-6c6f-4840-b900-a28f0f693ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.610397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74da93-6c6f-4840-b900-a28f0f693ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:41.612142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74da93-6c6f-4840-b900-a28f0f693ed9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:41.622767 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1256/2477] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:41.626690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223248cd-b5ad-4a62-a352-0b7515d6f7f5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:41.636839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223248cd-b5ad-4a62-a352-0b7515d6f7f5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:41.641465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a426f-ad61-4cb4-acd3-64bf0b5f8166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:41.642112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a426f-ad61-4cb4-acd3-64bf0b5f8166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.642398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a426f-ad61-4cb4-acd3-64bf0b5f8166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.642677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a426f-ad61-4cb4-acd3-64bf0b5f8166 admin admin] PATH_INFO: `/v3/projects/b459df92a52c4243972868cd1033d867/users/5b041d9d4b3d41e0addaf3fdded089b2/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.656988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a426f-ad61-4cb4-acd3-64bf0b5f8166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b459df92a52c4243972868cd1033d867, user_id=5b041d9d4b3d41e0addaf3fdded089b2, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:41.659569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a426f-ad61-4cb4-acd3-64bf0b5f8166 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:41.672912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1222/2478] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:41 2022] PUT /identity/v3/projects/b459df92a52c4243972868cd1033d867/users/5b041d9d4b3d41e0addaf3fdded089b2/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:41.739354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b761986-8207-4376-85d2-6085a02c039f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.739630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b761986-8207-4376-85d2-6085a02c039f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.739916 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b761986-8207-4376-85d2-6085a02c039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.768432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7b761986-8207-4376-85d2-6085a02c039f None None] MFA Rules not processed for user `5b041d9d4b3d41e0addaf3fdded089b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:41.769688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7b761986-8207-4376-85d2-6085a02c039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:41.832795 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1257/2479] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:41.837999 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a426f-ad61-4cb4-acd3-64bf0b5f8166 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:41.899120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a426f-ad61-4cb4-acd3-64bf0b5f8166 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:41.903717 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d5279-dc9f-43fe-bce6-2ca873ce7894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:41.904324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d5279-dc9f-43fe-bce6-2ca873ce7894 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:41.904604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d5279-dc9f-43fe-bce6-2ca873ce7894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:41.904879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d5279-dc9f-43fe-bce6-2ca873ce7894 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:41.905572 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d5279-dc9f-43fe-bce6-2ca873ce7894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:41.907462 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d5279-dc9f-43fe-bce6-2ca873ce7894 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:41.934154 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1223/2480] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:41 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:41.938362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b761986-8207-4376-85d2-6085a02c039f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:41.949086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b761986-8207-4376-85d2-6085a02c039f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:41.996066 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:42.006964 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a6799-ef6f-4eb5-b2a9-19cf09cbb344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:42.007649 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a6799-ef6f-4eb5-b2a9-19cf09cbb344 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:42.007938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a6799-ef6f-4eb5-b2a9-19cf09cbb344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:42.008219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a6799-ef6f-4eb5-b2a9-19cf09cbb344 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:42.008883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a6799-ef6f-4eb5-b2a9-19cf09cbb344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:42.010864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a6799-ef6f-4eb5-b2a9-19cf09cbb344 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:42.031536 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1258/2481] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:39:41 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:42.035498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d5279-dc9f-43fe-bce6-2ca873ce7894 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:42.046241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d5279-dc9f-43fe-bce6-2ca873ce7894 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:42.050823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bdf74-1183-4bc4-b82e-3ec929fb1089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:42.051431 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bdf74-1183-4bc4-b82e-3ec929fb1089 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:42.051753 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bdf74-1183-4bc4-b82e-3ec929fb1089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:42.052031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bdf74-1183-4bc4-b82e-3ec929fb1089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:42.052811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bdf74-1183-4bc4-b82e-3ec929fb1089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:42.054612 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bdf74-1183-4bc4-b82e-3ec929fb1089 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:42.064995 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1224/2482] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:42.069062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a6799-ef6f-4eb5-b2a9-19cf09cbb344 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:42.079239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a6799-ef6f-4eb5-b2a9-19cf09cbb344 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:42.083887 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e0add-cb35-462f-931d-804e0c054c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:42.084484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e0add-cb35-462f-931d-804e0c054c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:42.084768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e0add-cb35-462f-931d-804e0c054c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:42.085081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e0add-cb35-462f-931d-804e0c054c66 admin admin] PATH_INFO: `/v3/projects/87e63b485e5d41ea8d070ec5731958df/users/37ebdcaa9b65472fa706de57ecf8ec91/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:42.100349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e0add-cb35-462f-931d-804e0c054c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e63b485e5d41ea8d070ec5731958df, user_id=37ebdcaa9b65472fa706de57ecf8ec91, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:42.103610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e0add-cb35-462f-931d-804e0c054c66 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:42.117354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1259/2483] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:42 2022] PUT /identity/v3/projects/87e63b485e5d41ea8d070ec5731958df/users/37ebdcaa9b65472fa706de57ecf8ec91/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:42.121429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bdf74-1183-4bc4-b82e-3ec929fb1089 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:42.131524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bdf74-1183-4bc4-b82e-3ec929fb1089 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:42.188022 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e344c2-b7c3-428c-8d00-b6adf3f5d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:42.188638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e344c2-b7c3-428c-8d00-b6adf3f5d793 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:42.188943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e344c2-b7c3-428c-8d00-b6adf3f5d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:42.189223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e344c2-b7c3-428c-8d00-b6adf3f5d793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:42.189907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e344c2-b7c3-428c-8d00-b6adf3f5d793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:42.191482 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e344c2-b7c3-428c-8d00-b6adf3f5d793 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:42.201277 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1225/2484] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:42.205422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e0add-cb35-462f-931d-804e0c054c66 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:42.216098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e0add-cb35-462f-931d-804e0c054c66 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:42.220747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c442f1-76c1-4294-9569-b5a286135f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:42.221444 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c442f1-76c1-4294-9569-b5a286135f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:42.221730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c442f1-76c1-4294-9569-b5a286135f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:42.222009 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c442f1-76c1-4294-9569-b5a286135f87 admin admin] PATH_INFO: `/v3/projects/87e63b485e5d41ea8d070ec5731958df/users/37ebdcaa9b65472fa706de57ecf8ec91/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:42.223980 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c442f1-76c1-4294-9569-b5a286135f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e63b485e5d41ea8d070ec5731958df, user_id=37ebdcaa9b65472fa706de57ecf8ec91, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:42.227407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c442f1-76c1-4294-9569-b5a286135f87 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:42.237471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1260/2485] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:42 2022] PUT /identity/v3/projects/87e63b485e5d41ea8d070ec5731958df/users/37ebdcaa9b65472fa706de57ecf8ec91/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:42.247276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98eb09-0847-440b-920f-6f21e1245280 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:42.247567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98eb09-0847-440b-920f-6f21e1245280 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:42.247845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98eb09-0847-440b-920f-6f21e1245280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:42.276560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2b98eb09-0847-440b-920f-6f21e1245280 None None] MFA Rules not processed for user `37ebdcaa9b65472fa706de57ecf8ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:42.277783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2b98eb09-0847-440b-920f-6f21e1245280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:42.298364 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:42.348240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1226/2486] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:42.359570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c442f1-76c1-4294-9569-b5a286135f87 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:42.361446 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-87c442f1-76c1-4294-9569-b5a286135f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:42.419954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c442f1-76c1-4294-9569-b5a286135f87 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:42.423557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcbaa5-124c-4593-809e-2bc5dda184ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:42.424171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcbaa5-124c-4593-809e-2bc5dda184ff service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:42.424484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcbaa5-124c-4593-809e-2bc5dda184ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:42.424760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcbaa5-124c-4593-809e-2bc5dda184ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:42.479418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcbaa5-124c-4593-809e-2bc5dda184ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:42.480843 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcbaa5-124c-4593-809e-2bc5dda184ff service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:42.489625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1261/2487] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:43.983667 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98eb09-0847-440b-920f-6f21e1245280 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:43.985143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2b98eb09-0847-440b-920f-6f21e1245280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:43.997939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98eb09-0847-440b-920f-6f21e1245280 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:44.001433 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7da14-f931-47de-93d2-492c64f4e29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:44.002138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7da14-f931-47de-93d2-492c64f4e29d service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:44.002421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7da14-f931-47de-93d2-492c64f4e29d service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:44.002694 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7da14-f931-47de-93d2-492c64f4e29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:44.059662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7da14-f931-47de-93d2-492c64f4e29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:44.061068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7da14-f931-47de-93d2-492c64f4e29d service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:44.069927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1227/2488] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:44.583482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcbaa5-124c-4593-809e-2bc5dda184ff service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:44.592749 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcbaa5-124c-4593-809e-2bc5dda184ff service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:44.596322 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c53954-5dc9-4c4c-9291-72838555c27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:44.596959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c53954-5dc9-4c4c-9291-72838555c27c service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:44.597247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c53954-5dc9-4c4c-9291-72838555c27c service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:44.597524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c53954-5dc9-4c4c-9291-72838555c27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:44.607094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c53954-5dc9-4c4c-9291-72838555c27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:44.608520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c53954-5dc9-4c4c-9291-72838555c27c service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:44.618224 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1262/2489] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:48.473469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7da14-f931-47de-93d2-492c64f4e29d service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:48.534861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7da14-f931-47de-93d2-492c64f4e29d service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:48.539346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:48.539978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:48.540262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:48.540568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] PATH_INFO: `/v3/users/65f1bcdfb66c43bba91034aa7f26d976` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:48.541750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f1bcdfb66c43bba91034aa7f26d976)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:48.543660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:48.587922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f1bcdfb66c43bba91034aa7f26d976'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:48.594626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f1bcdfb66c43bba91034aa7f26d976'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:48.596457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:48.607877 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f1bcdfb66c43bba91034aa7f26d976'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:48.608549 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f1bcdfb66c43bba91034aa7f26d976'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:48.609187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f1bcdfb66c43bba91034aa7f26d976'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:48.622871 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1228/2490] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:39:48 2022] DELETE /identity/v3/users/65f1bcdfb66c43bba91034aa7f26d976 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:48.627292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8388c1-6a83-4c18-a32a-8eb6fc238519 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:48.627815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8388c1-6a83-4c18-a32a-8eb6fc238519 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:48.627950 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8388c1-6a83-4c18-a32a-8eb6fc238519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:48.646890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7b8388c1-6a83-4c18-a32a-8eb6fc238519 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:48.648129 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7b8388c1-6a83-4c18-a32a-8eb6fc238519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:48.688063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:48.707412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1263/2491] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:48.717938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:48.719502 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:48.776772 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bb5db-5fa9-40e6-a739-2414574cce27 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:48.780352 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1637-df4f-4abf-b99a-c74a78392c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:48.781003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1637-df4f-4abf-b99a-c74a78392c7a service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:48.781284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1637-df4f-4abf-b99a-c74a78392c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:48.781554 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1637-df4f-4abf-b99a-c74a78392c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:48.790829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c1637-df4f-4abf-b99a-c74a78392c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:48.792241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c1637-df4f-4abf-b99a-c74a78392c7a service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:48.801390 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1229/2492] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:39:49.071431 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8388c1-6a83-4c18-a32a-8eb6fc238519 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:49.073030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7b8388c1-6a83-4c18-a32a-8eb6fc238519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:49.085868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8388c1-6a83-4c18-a32a-8eb6fc238519 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:49.090930 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:49.092228 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:49.092520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:49.092998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] PATH_INFO: `/v3/projects/ff6907c53a1349798d0c2c451434f00e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:49.094212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6907c53a1349798d0c2c451434f00e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:49.096077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:49.144181 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6907c53a1349798d0c2c451434f00e', 'request_id': 'req-86a3159e-2216-4810-900e-dbb68a158095'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.150004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6907c53a1349798d0c2c451434f00e', 'request_id': 'req-86a3159e-2216-4810-900e-dbb68a158095'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.157247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6907c53a1349798d0c2c451434f00e', 'request_id': 'req-86a3159e-2216-4810-900e-dbb68a158095'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.168852 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] The token cache is being invalidate because project ff6907c53a1349798d0c2c451434f00e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:49.169174 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.169797 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.171276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1264/2493] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:49 2022] DELETE /identity/v3/projects/ff6907c53a1349798d0c2c451434f00e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:49.175389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1637-df4f-4abf-b99a-c74a78392c7a service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:49.185551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1637-df4f-4abf-b99a-c74a78392c7a service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:49.239994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:49.240550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:49.240830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:49.241152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] PATH_INFO: `/v3/users/5b041d9d4b3d41e0addaf3fdded089b2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:49.242993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b041d9d4b3d41e0addaf3fdded089b2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:49.244897 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:49.289573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b041d9d4b3d41e0addaf3fdded089b2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.297137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b041d9d4b3d41e0addaf3fdded089b2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.309876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b041d9d4b3d41e0addaf3fdded089b2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.310534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b041d9d4b3d41e0addaf3fdded089b2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.311134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b041d9d4b3d41e0addaf3fdded089b2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.319490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:49.326219 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1230/2494] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:39:49 2022] DELETE /identity/v3/users/5b041d9d4b3d41e0addaf3fdded089b2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:49.596429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:49.598428 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:49.617689 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3159e-2216-4810-900e-dbb68a158095 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:49.678963 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:49.679750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:49.679907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:49.680183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] PATH_INFO: `/v3/projects/b459df92a52c4243972868cd1033d867` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:49.681381 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b459df92a52c4243972868cd1033d867)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:49.683270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:49.729709 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b459df92a52c4243972868cd1033d867', 'request_id': 'req-e0b83025-3cec-4ccd-a9ad-e749c044f871'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.735307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b459df92a52c4243972868cd1033d867', 'request_id': 'req-e0b83025-3cec-4ccd-a9ad-e749c044f871'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.743560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b459df92a52c4243972868cd1033d867', 'request_id': 'req-e0b83025-3cec-4ccd-a9ad-e749c044f871'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.751700 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:49.763287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] The token cache is being invalidate because project b459df92a52c4243972868cd1033d867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:49.763860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.764751 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.767037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1265/2495] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:49 2022] DELETE /identity/v3/projects/b459df92a52c4243972868cd1033d867 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:49.771277 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:49.773626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:49.787775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fcf9f-8bce-4c77-9960-dfefe3bafe53 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:49.861276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f554786-6c98-42f7-a129-a82552f1133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:49.861931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f554786-6c98-42f7-a129-a82552f1133c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:49.862216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f554786-6c98-42f7-a129-a82552f1133c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:49.862494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f554786-6c98-42f7-a129-a82552f1133c admin admin] PATH_INFO: `/v3/users/37ebdcaa9b65472fa706de57ecf8ec91` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:49.863692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f554786-6c98-42f7-a129-a82552f1133c admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ebdcaa9b65472fa706de57ecf8ec91)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:49.865663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f554786-6c98-42f7-a129-a82552f1133c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:49.919455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7f554786-6c98-42f7-a129-a82552f1133c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ebdcaa9b65472fa706de57ecf8ec91'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.927165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7f554786-6c98-42f7-a129-a82552f1133c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ebdcaa9b65472fa706de57ecf8ec91'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.941806 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7f554786-6c98-42f7-a129-a82552f1133c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ebdcaa9b65472fa706de57ecf8ec91'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.942533 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7f554786-6c98-42f7-a129-a82552f1133c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ebdcaa9b65472fa706de57ecf8ec91'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.943160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7f554786-6c98-42f7-a129-a82552f1133c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ebdcaa9b65472fa706de57ecf8ec91'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:49.957674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1231/2496] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:39:49 2022] DELETE /identity/v3/users/37ebdcaa9b65472fa706de57ecf8ec91 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:50.296300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:50.299081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:50.313734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b83025-3cec-4ccd-a9ad-e749c044f871 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:50.377646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d322c-752a-4f2e-9b90-21f0f099f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:50.378343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d322c-752a-4f2e-9b90-21f0f099f825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:50.379422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d322c-752a-4f2e-9b90-21f0f099f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:50.379422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d322c-752a-4f2e-9b90-21f0f099f825 admin admin] PATH_INFO: `/v3/projects/87e63b485e5d41ea8d070ec5731958df` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:50.380062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d322c-752a-4f2e-9b90-21f0f099f825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e63b485e5d41ea8d070ec5731958df)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:50.383009 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d322c-752a-4f2e-9b90-21f0f099f825 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:50.436039 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-759d322c-752a-4f2e-9b90-21f0f099f825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e63b485e5d41ea8d070ec5731958df', 'request_id': 'req-759d322c-752a-4f2e-9b90-21f0f099f825'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:50.441570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-759d322c-752a-4f2e-9b90-21f0f099f825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e63b485e5d41ea8d070ec5731958df', 'request_id': 'req-759d322c-752a-4f2e-9b90-21f0f099f825'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:50.450736 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-759d322c-752a-4f2e-9b90-21f0f099f825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e63b485e5d41ea8d070ec5731958df', 'request_id': 'req-759d322c-752a-4f2e-9b90-21f0f099f825'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:50.470580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-759d322c-752a-4f2e-9b90-21f0f099f825 admin admin] The token cache is being invalidate because project 87e63b485e5d41ea8d070ec5731958df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:39:50.471112 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-759d322c-752a-4f2e-9b90-21f0f099f825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:50.472196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-759d322c-752a-4f2e-9b90-21f0f099f825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:39:50.474431 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1266/2497] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:39:50 2022] DELETE /identity/v3/projects/87e63b485e5d41ea8d070ec5731958df => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:50.480172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0d113-34bc-4541-a2eb-3ccb98d37931 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:50.480460 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0d113-34bc-4541-a2eb-3ccb98d37931 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:50.480731 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0d113-34bc-4541-a2eb-3ccb98d37931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:50.499994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-49b0d113-34bc-4541-a2eb-3ccb98d37931 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:50.501216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-49b0d113-34bc-4541-a2eb-3ccb98d37931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:50.564366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1232/2498] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:50.573984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c75e0-dba3-45e2-a21a-6f29d2d07c17 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:50.574260 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c75e0-dba3-45e2-a21a-6f29d2d07c17 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:50.574543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c75e0-dba3-45e2-a21a-6f29d2d07c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:50.595694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-883c75e0-dba3-45e2-a21a-6f29d2d07c17 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:50.596919 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-883c75e0-dba3-45e2-a21a-6f29d2d07c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:50.605290 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1267/2499] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:50.609461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0d113-34bc-4541-a2eb-3ccb98d37931 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:50.619581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0d113-34bc-4541-a2eb-3ccb98d37931 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:50.624145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bcf50-af7e-42b2-aef6-ad77f786a8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:50.624801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bcf50-af7e-42b2-aef6-ad77f786a8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:50.625137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bcf50-af7e-42b2-aef6-ad77f786a8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:50.625419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bcf50-af7e-42b2-aef6-ad77f786a8b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:50.626107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bcf50-af7e-42b2-aef6-ad77f786a8b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:39:50.626409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bcf50-af7e-42b2-aef6-ad77f786a8b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:50.627982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bcf50-af7e-42b2-aef6-ad77f786a8b7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:50.640334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1233/2500] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:39:50.644813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c75e0-dba3-45e2-a21a-6f29d2d07c17 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:50.654808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c75e0-dba3-45e2-a21a-6f29d2d07c17 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:50.659492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da080f2-b4f9-4e7f-80e7-07114bbb77cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:50.660095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da080f2-b4f9-4e7f-80e7-07114bbb77cf admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:50.660380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da080f2-b4f9-4e7f-80e7-07114bbb77cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:50.660654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da080f2-b4f9-4e7f-80e7-07114bbb77cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:50.661479 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da080f2-b4f9-4e7f-80e7-07114bbb77cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:50.663375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da080f2-b4f9-4e7f-80e7-07114bbb77cf admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:50.690197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1268/2501] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:39:50 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:50.694453 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bcf50-af7e-42b2-aef6-ad77f786a8b7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:50.701493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:50.705621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bcf50-af7e-42b2-aef6-ad77f786a8b7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:50.764180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bcaf8-b31b-4349-80f2-5d5990608026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:50.764803 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bcaf8-b31b-4349-80f2-5d5990608026 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:50.765226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bcaf8-b31b-4349-80f2-5d5990608026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:50.765508 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bcaf8-b31b-4349-80f2-5d5990608026 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:50.766208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bcaf8-b31b-4349-80f2-5d5990608026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:50.768183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bcaf8-b31b-4349-80f2-5d5990608026 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:50.789422 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1234/2502] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:39:50 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:39:50.793510 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da080f2-b4f9-4e7f-80e7-07114bbb77cf admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:50.803697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da080f2-b4f9-4e7f-80e7-07114bbb77cf admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:50.809091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a15d78-a856-4f2f-8679-855a6efcb91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:50.809699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a15d78-a856-4f2f-8679-855a6efcb91f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:50.809979 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a15d78-a856-4f2f-8679-855a6efcb91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:50.810255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a15d78-a856-4f2f-8679-855a6efcb91f admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:50.810965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a15d78-a856-4f2f-8679-855a6efcb91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:50.812546 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a15d78-a856-4f2f-8679-855a6efcb91f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:50.823131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1269/2503] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:50.827029 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bcaf8-b31b-4349-80f2-5d5990608026 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:50.837446 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bcaf8-b31b-4349-80f2-5d5990608026 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:50.842095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcbdac-3296-400b-9716-20137bcb9506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:50.842701 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcbdac-3296-400b-9716-20137bcb9506 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:50.842988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcbdac-3296-400b-9716-20137bcb9506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:50.843267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcbdac-3296-400b-9716-20137bcb9506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:50.844027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcbdac-3296-400b-9716-20137bcb9506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:50.845639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcbdac-3296-400b-9716-20137bcb9506 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:50.856715 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1235/2504] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:39:50.860757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a15d78-a856-4f2f-8679-855a6efcb91f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:50.871687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a15d78-a856-4f2f-8679-855a6efcb91f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:50.876245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83b1a2-481f-45b7-9a20-d9e4fa79384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:50.876892 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b1a2-481f-45b7-9a20-d9e4fa79384e admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:50.877205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b1a2-481f-45b7-9a20-d9e4fa79384e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:50.877482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b1a2-481f-45b7-9a20-d9e4fa79384e admin admin] PATH_INFO: `/v3/projects/6ce25b15e1c64471ad443eec23fb998c/users/6e278418708f4417beeba6eee0eaf1d6/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:50.892471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83b1a2-481f-45b7-9a20-d9e4fa79384e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce25b15e1c64471ad443eec23fb998c, user_id=6e278418708f4417beeba6eee0eaf1d6, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:50.895114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83b1a2-481f-45b7-9a20-d9e4fa79384e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:50.908171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1270/2505] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:39:50 2022] PUT /identity/v3/projects/6ce25b15e1c64471ad443eec23fb998c/users/6e278418708f4417beeba6eee0eaf1d6/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:39:50.919451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32871a-1899-43e8-85a1-b282b1cea828 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:50.919744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32871a-1899-43e8-85a1-b282b1cea828 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:50.920045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32871a-1899-43e8-85a1-b282b1cea828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:50.947570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7f32871a-1899-43e8-85a1-b282b1cea828 None None] MFA Rules not processed for user `6e278418708f4417beeba6eee0eaf1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:39:50.948788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7f32871a-1899-43e8-85a1-b282b1cea828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:51.012223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1236/2506] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:39:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:39:51.023997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83b1a2-481f-45b7-9a20-d9e4fa79384e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:39:51.025659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4e83b1a2-481f-45b7-9a20-d9e4fa79384e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:39:51.054128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:39:51.084922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83b1a2-481f-45b7-9a20-d9e4fa79384e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:39:51.089624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58b3e1-2fdd-43d8-a2d8-c37fc88b3dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:39:51.090237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58b3e1-2fdd-43d8-a2d8-c37fc88b3dff service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:39:51.090521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58b3e1-2fdd-43d8-a2d8-c37fc88b3dff service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:39:51.090815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58b3e1-2fdd-43d8-a2d8-c37fc88b3dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:39:51.098902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58b3e1-2fdd-43d8-a2d8-c37fc88b3dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:39:51.100316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58b3e1-2fdd-43d8-a2d8-c37fc88b3dff service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:39:51.110106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1271/2507] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:39:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:40:01.009363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=64,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:01.106169 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=15 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:13.285624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e3846-e2c2-4135-98e3-d09fccaf7784 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:40:13.286075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e3846-e2c2-4135-98e3-d09fccaf7784 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:40:13.286186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e3846-e2c2-4135-98e3-d09fccaf7784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:40:13.305377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c93e3846-e2c2-4135-98e3-d09fccaf7784 None None] MFA Rules not processed for user `e9f545fde2d94e03b9b8336f53122177`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:40:13.306569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c93e3846-e2c2-4135-98e3-d09fccaf7784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:40:13.362703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1237/2508] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:40:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:40:23.354509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=25 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:27.190780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58b3e1-2fdd-43d8-a2d8-c37fc88b3dff service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:40:27.254683 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58b3e1-2fdd-43d8-a2d8-c37fc88b3dff service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:40:27.260197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:40:27.260836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:40:27.261148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:40:27.261424 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] PATH_INFO: `/v3/users/6e278418708f4417beeba6eee0eaf1d6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:40:27.262594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e278418708f4417beeba6eee0eaf1d6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:40:27.264493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:40:27.311084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e278418708f4417beeba6eee0eaf1d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:40:27.324392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e278418708f4417beeba6eee0eaf1d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:40:27.325146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e278418708f4417beeba6eee0eaf1d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:40:27.325752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e278418708f4417beeba6eee0eaf1d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:40:27.333701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e278418708f4417beeba6eee0eaf1d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:40:27.347149 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1272/2509] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:40:27 2022] DELETE /identity/v3/users/6e278418708f4417beeba6eee0eaf1d6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:40:27.351875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c55e8-90af-46d1-af33-594b2c2a3f86 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:40:27.352387 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c55e8-90af-46d1-af33-594b2c2a3f86 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:40:27.352567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c55e8-90af-46d1-af33-594b2c2a3f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:40:27.372099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e91c55e8-90af-46d1-af33-594b2c2a3f86 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:40:27.373357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e91c55e8-90af-46d1-af33-594b2c2a3f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:40:27.434653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1238/2510] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:40:27.443601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:40:27.445063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:40:27.503663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc88c4-375f-4bbc-9e67-999275a104a5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:40:27.507634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523ec8e-6f18-4718-9db1-d3d438f6e4fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:40:27.508255 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ec8e-6f18-4718-9db1-d3d438f6e4fd service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:40:27.509276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ec8e-6f18-4718-9db1-d3d438f6e4fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:40:27.509563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ec8e-6f18-4718-9db1-d3d438f6e4fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:40:27.519865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523ec8e-6f18-4718-9db1-d3d438f6e4fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:40:27.521335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523ec8e-6f18-4718-9db1-d3d438f6e4fd service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:40:27.531415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1273/2511] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:40:27.813446 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c55e8-90af-46d1-af33-594b2c2a3f86 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:40:27.815050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e91c55e8-90af-46d1-af33-594b2c2a3f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:40:27.842187 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c55e8-90af-46d1-af33-594b2c2a3f86 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:40:27.847601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:40:27.848261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:40:27.848550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:40:27.848829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] PATH_INFO: `/v3/projects/6ce25b15e1c64471ad443eec23fb998c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:40:27.850042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce25b15e1c64471ad443eec23fb998c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:40:27.851958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:40:27.902132 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce25b15e1c64471ad443eec23fb998c', 'request_id': 'req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:40:27.908533 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce25b15e1c64471ad443eec23fb998c', 'request_id': 'req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:40:27.916805 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce25b15e1c64471ad443eec23fb998c', 'request_id': 'req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:40:27.928307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] The token cache is being invalidate because project 6ce25b15e1c64471ad443eec23fb998c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:40:27.928599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:40:27.929241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:40:27.931381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1239/2512] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:40:27 2022] DELETE /identity/v3/projects/6ce25b15e1c64471ad443eec23fb998c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:40:37.527003 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:37.925256 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:40:54.387275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e265258-4d33-4b93-a2fd-3e0868605b3a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:40:54.388012 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e265258-4d33-4b93-a2fd-3e0868605b3a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:40:54.388312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e265258-4d33-4b93-a2fd-3e0868605b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:40:54.431658 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3e265258-4d33-4b93-a2fd-3e0868605b3a None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:40:54.432857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3e265258-4d33-4b93-a2fd-3e0868605b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:40:54.514516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1274/2513] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:40:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:40:54.560606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:40:54.562155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:40:54.656520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cf3b7-b7da-435c-ac3e-113039ebf1dc admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:40:54.661984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2195a-9e0b-49e5-81dc-36b4133a99a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:40:54.662165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2195a-9e0b-49e5-81dc-36b4133a99a4 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:40:54.662451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2195a-9e0b-49e5-81dc-36b4133a99a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:40:54.662727 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2195a-9e0b-49e5-81dc-36b4133a99a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:40:54.672019 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2195a-9e0b-49e5-81dc-36b4133a99a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:40:54.673783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2195a-9e0b-49e5-81dc-36b4133a99a4 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:40:54.682063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1240/2514] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:40:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:41:02.738711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e265258-4d33-4b93-a2fd-3e0868605b3a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:02.740758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3e265258-4d33-4b93-a2fd-3e0868605b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:02.921847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e265258-4d33-4b93-a2fd-3e0868605b3a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:02.945713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7dc7b-d786-433d-b0d6-953c1776dbeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:02.946600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7dc7b-d786-433d-b0d6-953c1776dbeb service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:02.946886 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7dc7b-d786-433d-b0d6-953c1776dbeb service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:02.949264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7dc7b-d786-433d-b0d6-953c1776dbeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:02.952202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-32d7dc7b-d786-433d-b0d6-953c1776dbeb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:02.968975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7dc7b-d786-433d-b0d6-953c1776dbeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:02.970978 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7dc7b-d786-433d-b0d6-953c1776dbeb service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:02.988629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1275/2515] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:04.678662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=43 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:12.981540 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=86 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:13.993413 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca7744-36f7-4551-b1fe-9b05c1f5c9df None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:13.993413 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca7744-36f7-4551-b1fe-9b05c1f5c9df None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:13.993413 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca7744-36f7-4551-b1fe-9b05c1f5c9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:14.014159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9cca7744-36f7-4551-b1fe-9b05c1f5c9df None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:14.014960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9cca7744-36f7-4551-b1fe-9b05c1f5c9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:14.025379 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1241/2516] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:41:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:14.038566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7dc7b-d786-433d-b0d6-953c1776dbeb service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:14.051056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7dc7b-d786-433d-b0d6-953c1776dbeb service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:14.056189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb6083-2181-43c1-bebb-9a89ec9af4d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:14.057072 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb6083-2181-43c1-bebb-9a89ec9af4d6 service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:14.057459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb6083-2181-43c1-bebb-9a89ec9af4d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:14.057845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb6083-2181-43c1-bebb-9a89ec9af4d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:14.068002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb6083-2181-43c1-bebb-9a89ec9af4d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:14.081474 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb6083-2181-43c1-bebb-9a89ec9af4d6 service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:14.099586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1276/2517] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:41:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:41:24.008472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:24.087190 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:34.217183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca7744-36f7-4551-b1fe-9b05c1f5c9df None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:34.218833 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9cca7744-36f7-4551-b1fe-9b05c1f5c9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:34.298045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca7744-36f7-4551-b1fe-9b05c1f5c9df None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:34.301671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101edf55-c517-4576-8b4e-39c40f1542a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:34.302293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101edf55-c517-4576-8b4e-39c40f1542a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:34.302578 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101edf55-c517-4576-8b4e-39c40f1542a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:34.302853 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101edf55-c517-4576-8b4e-39c40f1542a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:34.304585 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-101edf55-c517-4576-8b4e-39c40f1542a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:34.392763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101edf55-c517-4576-8b4e-39c40f1542a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:34.394272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101edf55-c517-4576-8b4e-39c40f1542a4 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:34.425620 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1242/2518] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:34.449233 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4138ca6-f30b-45c6-b0e7-600dea30d989 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:34.449719 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4138ca6-f30b-45c6-b0e7-600dea30d989 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:34.449828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4138ca6-f30b-45c6-b0e7-600dea30d989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:34.469810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d4138ca6-f30b-45c6-b0e7-600dea30d989 None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:34.471007 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d4138ca6-f30b-45c6-b0e7-600dea30d989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:34.478060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1277/2519] 10.222.0.15 () {58 vars in 967 bytes} [Sat Aug 6 01:41:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:34.490362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101edf55-c517-4576-8b4e-39c40f1542a4 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:34.502002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101edf55-c517-4576-8b4e-39c40f1542a4 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:34.507251 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a3937-9639-4884-bdbb-d050bb54f4d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:34.507876 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a3937-9639-4884-bdbb-d050bb54f4d1 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:34.508144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a3937-9639-4884-bdbb-d050bb54f4d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:34.508416 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a3937-9639-4884-bdbb-d050bb54f4d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:34.517287 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a3937-9639-4884-bdbb-d050bb54f4d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:34.518904 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a3937-9639-4884-bdbb-d050bb54f4d1 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:34.527271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1243/2520] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:41:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:41:37.803055 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4138ca6-f30b-45c6-b0e7-600dea30d989 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:37.804601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d4138ca6-f30b-45c6-b0e7-600dea30d989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:37.819465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4138ca6-f30b-45c6-b0e7-600dea30d989 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:37.824266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6766ec1-4b6b-41d0-ad0b-fe75881e2165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:37.825579 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6766ec1-4b6b-41d0-ad0b-fe75881e2165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:37.825934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6766ec1-4b6b-41d0-ad0b-fe75881e2165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:37.826280 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6766ec1-4b6b-41d0-ad0b-fe75881e2165 admin admin] PATH_INFO: `/v3/users/e354e99370d64ec3a7624eb3e550021d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:37.827514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6766ec1-4b6b-41d0-ad0b-fe75881e2165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e354e99370d64ec3a7624eb3e550021d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:37.829487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6766ec1-4b6b-41d0-ad0b-fe75881e2165 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:37.889713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c6766ec1-4b6b-41d0-ad0b-fe75881e2165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e354e99370d64ec3a7624eb3e550021d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:37.902578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c6766ec1-4b6b-41d0-ad0b-fe75881e2165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e354e99370d64ec3a7624eb3e550021d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:37.903933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c6766ec1-4b6b-41d0-ad0b-fe75881e2165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e354e99370d64ec3a7624eb3e550021d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:37.904539 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c6766ec1-4b6b-41d0-ad0b-fe75881e2165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e354e99370d64ec3a7624eb3e550021d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:37.914989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c6766ec1-4b6b-41d0-ad0b-fe75881e2165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e354e99370d64ec3a7624eb3e550021d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:37.932804 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1278/2521] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:41:37 2022] DELETE /identity/v3/users/e354e99370d64ec3a7624eb3e550021d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:38.214382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a3937-9639-4884-bdbb-d050bb54f4d1 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:38.227179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a3937-9639-4884-bdbb-d050bb54f4d1 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:38.279276 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:38.293144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:38.294335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:38.294755 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:38.295260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3 admin admin] PATH_INFO: `/v3/projects/f7085f6fa1ec425ba90573e70f0108c8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:38.296551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7085f6fa1ec425ba90573e70f0108c8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:38.298545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:38.347501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7085f6fa1ec425ba90573e70f0108c8', 'request_id': 'req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:38.353886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7085f6fa1ec425ba90573e70f0108c8', 'request_id': 'req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:38.363055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7085f6fa1ec425ba90573e70f0108c8', 'request_id': 'req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:38.375318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3 admin admin] The token cache is being invalidate because project f7085f6fa1ec425ba90573e70f0108c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:41:38.375613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:38.376258 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3d0772e0-b33e-4bdc-a97f-bbb70bcd63d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:38.377806 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1244/2522] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:41:38 2022] DELETE /identity/v3/projects/f7085f6fa1ec425ba90573e70f0108c8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:38.382942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb07ea-4c76-4768-b4a8-352a67151e6f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:38.383298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb07ea-4c76-4768-b4a8-352a67151e6f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:38.383641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb07ea-4c76-4768-b4a8-352a67151e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:38.441932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1ceb07ea-4c76-4768-b4a8-352a67151e6f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:38.443066 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1ceb07ea-4c76-4768-b4a8-352a67151e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:38.502228 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1279/2523] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:38.510536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ffacc-8588-4acc-bfd9-c221052d49ef None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:38.510841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ffacc-8588-4acc-bfd9-c221052d49ef None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:38.511098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ffacc-8588-4acc-bfd9-c221052d49ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:38.531712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d50ffacc-8588-4acc-bfd9-c221052d49ef None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:38.532931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d50ffacc-8588-4acc-bfd9-c221052d49ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:38.540666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1245/2524] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:38.544928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb07ea-4c76-4768-b4a8-352a67151e6f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:38.554543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb07ea-4c76-4768-b4a8-352a67151e6f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:38.559091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ea6e7-a757-4921-99c6-3ae460fda860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:38.559951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ea6e7-a757-4921-99c6-3ae460fda860 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:38.560235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ea6e7-a757-4921-99c6-3ae460fda860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:38.560501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ea6e7-a757-4921-99c6-3ae460fda860 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:38.561220 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ea6e7-a757-4921-99c6-3ae460fda860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:41:38.561526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ea6e7-a757-4921-99c6-3ae460fda860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:38.563095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ea6e7-a757-4921-99c6-3ae460fda860 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:38.574292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1280/2525] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:41:38.579279 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ffacc-8588-4acc-bfd9-c221052d49ef None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:38.588548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ffacc-8588-4acc-bfd9-c221052d49ef None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:38.593912 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9769589-ead9-4ae7-943b-ca8b84b2dfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:38.594527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769589-ead9-4ae7-943b-ca8b84b2dfb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:38.594792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769589-ead9-4ae7-943b-ca8b84b2dfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:38.595067 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9769589-ead9-4ae7-943b-ca8b84b2dfb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:38.595734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9769589-ead9-4ae7-943b-ca8b84b2dfb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:38.597662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9769589-ead9-4ae7-943b-ca8b84b2dfb1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:38.623743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1246/2526] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:41:38 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:38.627956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ea6e7-a757-4921-99c6-3ae460fda860 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:38.638766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ea6e7-a757-4921-99c6-3ae460fda860 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:38.658367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:38.697033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c69f5a-5003-4895-8254-c35c6091c68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:38.697593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c69f5a-5003-4895-8254-c35c6091c68b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:38.697875 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c69f5a-5003-4895-8254-c35c6091c68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:38.698146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c69f5a-5003-4895-8254-c35c6091c68b admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:38.698806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c69f5a-5003-4895-8254-c35c6091c68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:38.701067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c69f5a-5003-4895-8254-c35c6091c68b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:38.721998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1281/2527] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:41:38 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:41:38.726239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9769589-ead9-4ae7-943b-ca8b84b2dfb1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:38.737593 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9769589-ead9-4ae7-943b-ca8b84b2dfb1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:38.742235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2001748-4e10-4e07-88b2-850d5c02333b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:38.742836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2001748-4e10-4e07-88b2-850d5c02333b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:38.743118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2001748-4e10-4e07-88b2-850d5c02333b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:38.743396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2001748-4e10-4e07-88b2-850d5c02333b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:38.744088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2001748-4e10-4e07-88b2-850d5c02333b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:38.745714 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2001748-4e10-4e07-88b2-850d5c02333b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:38.756445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1247/2528] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:38.760436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c69f5a-5003-4895-8254-c35c6091c68b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:38.770263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c69f5a-5003-4895-8254-c35c6091c68b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:38.774828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836cfb0-cb2e-4e43-972c-ca9c5465c31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:38.775422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836cfb0-cb2e-4e43-972c-ca9c5465c31a admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:38.775702 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836cfb0-cb2e-4e43-972c-ca9c5465c31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:38.775977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836cfb0-cb2e-4e43-972c-ca9c5465c31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:38.776671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836cfb0-cb2e-4e43-972c-ca9c5465c31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:38.778773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836cfb0-cb2e-4e43-972c-ca9c5465c31a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:38.789077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1282/2529] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:38.793204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2001748-4e10-4e07-88b2-850d5c02333b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:38.803722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2001748-4e10-4e07-88b2-850d5c02333b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:38.808258 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98d60e-6eaf-43a9-936a-5aa46af5a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:38.808931 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98d60e-6eaf-43a9-936a-5aa46af5a052 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:38.809217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98d60e-6eaf-43a9-936a-5aa46af5a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:38.809528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98d60e-6eaf-43a9-936a-5aa46af5a052 admin admin] PATH_INFO: `/v3/projects/65e87b2615354ca8a5afb54199f41537/users/1472c29740ae42bdab5aabeb47e315f3/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:38.824150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98d60e-6eaf-43a9-936a-5aa46af5a052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e87b2615354ca8a5afb54199f41537, user_id=1472c29740ae42bdab5aabeb47e315f3, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:38.827320 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98d60e-6eaf-43a9-936a-5aa46af5a052 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:38.841677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1248/2530] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:41:38 2022] PUT /identity/v3/projects/65e87b2615354ca8a5afb54199f41537/users/1472c29740ae42bdab5aabeb47e315f3/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:38.852302 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fbd22-65b4-4934-adad-3ac7cb794c0a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:38.852833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fbd22-65b4-4934-adad-3ac7cb794c0a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:38.852833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fbd22-65b4-4934-adad-3ac7cb794c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:38.880972 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1c2fbd22-65b4-4934-adad-3ac7cb794c0a None None] MFA Rules not processed for user `1472c29740ae42bdab5aabeb47e315f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:38.882185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1c2fbd22-65b4-4934-adad-3ac7cb794c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:38.945391 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1283/2531] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:41:38.950070 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98d60e-6eaf-43a9-936a-5aa46af5a052 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:39.010963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98d60e-6eaf-43a9-936a-5aa46af5a052 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:39.016138 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0754c-86d3-4574-beeb-f256820b98fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:39.016747 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0754c-86d3-4574-beeb-f256820b98fb admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:39.017066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0754c-86d3-4574-beeb-f256820b98fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:39.017342 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0754c-86d3-4574-beeb-f256820b98fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:39.017993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0754c-86d3-4574-beeb-f256820b98fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:39.019896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0754c-86d3-4574-beeb-f256820b98fb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:39.040685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:39.047669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1249/2532] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:41:38 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:41:39.051697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fbd22-65b4-4934-adad-3ac7cb794c0a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:39.062422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fbd22-65b4-4934-adad-3ac7cb794c0a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:39.117762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60334c6-774d-47d7-b9ad-6f28b1387887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:39.118374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60334c6-774d-47d7-b9ad-6f28b1387887 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:39.118652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60334c6-774d-47d7-b9ad-6f28b1387887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:39.118922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60334c6-774d-47d7-b9ad-6f28b1387887 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:39.119589 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60334c6-774d-47d7-b9ad-6f28b1387887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:39.121598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60334c6-774d-47d7-b9ad-6f28b1387887 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:39.142631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1284/2533] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:41:39 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:39.146682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0754c-86d3-4574-beeb-f256820b98fb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:39.157523 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0754c-86d3-4574-beeb-f256820b98fb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:39.162087 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e61b7-433a-4647-b8c6-a637b26abca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:39.162692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e61b7-433a-4647-b8c6-a637b26abca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:39.162974 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e61b7-433a-4647-b8c6-a637b26abca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:39.163250 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e61b7-433a-4647-b8c6-a637b26abca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:39.163940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e61b7-433a-4647-b8c6-a637b26abca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:39.165571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e61b7-433a-4647-b8c6-a637b26abca2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:39.176284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1250/2534] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:39.180347 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60334c6-774d-47d7-b9ad-6f28b1387887 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:39.190593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60334c6-774d-47d7-b9ad-6f28b1387887 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:39.195119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fa35a-6644-47c4-8b8a-7cab4680070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:39.195770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fa35a-6644-47c4-8b8a-7cab4680070f admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:39.196048 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fa35a-6644-47c4-8b8a-7cab4680070f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:39.196329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fa35a-6644-47c4-8b8a-7cab4680070f admin admin] PATH_INFO: `/v3/projects/8fa6e4d8a246415899afee30e875fa81/users/218bd2f9d49f4c449cf1f8c4f4b7183e/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:39.212168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fa35a-6644-47c4-8b8a-7cab4680070f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa6e4d8a246415899afee30e875fa81, user_id=218bd2f9d49f4c449cf1f8c4f4b7183e, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:39.214764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fa35a-6644-47c4-8b8a-7cab4680070f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:39.218934 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:39.230679 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1285/2535] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:41:39 2022] PUT /identity/v3/projects/8fa6e4d8a246415899afee30e875fa81/users/218bd2f9d49f4c449cf1f8c4f4b7183e/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:41:39.235013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e61b7-433a-4647-b8c6-a637b26abca2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:39.245805 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e61b7-433a-4647-b8c6-a637b26abca2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:39.305174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a632fe5-56e0-4392-9784-8980d61b7576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:39.305802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a632fe5-56e0-4392-9784-8980d61b7576 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:39.306083 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a632fe5-56e0-4392-9784-8980d61b7576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:39.306358 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a632fe5-56e0-4392-9784-8980d61b7576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:39.307052 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a632fe5-56e0-4392-9784-8980d61b7576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:39.308792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a632fe5-56e0-4392-9784-8980d61b7576 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:39.319035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1251/2536] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:41:39.323233 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fa35a-6644-47c4-8b8a-7cab4680070f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:39.334665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fa35a-6644-47c4-8b8a-7cab4680070f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:39.339344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cb343-d57e-4320-a651-968d146509a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:39.340032 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cb343-d57e-4320-a651-968d146509a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:39.340855 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cb343-d57e-4320-a651-968d146509a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:39.340855 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cb343-d57e-4320-a651-968d146509a4 admin admin] PATH_INFO: `/v3/projects/8fa6e4d8a246415899afee30e875fa81/users/218bd2f9d49f4c449cf1f8c4f4b7183e/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:39.342747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cb343-d57e-4320-a651-968d146509a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa6e4d8a246415899afee30e875fa81, user_id=218bd2f9d49f4c449cf1f8c4f4b7183e, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:39.345407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cb343-d57e-4320-a651-968d146509a4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:39.355715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1286/2537] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:41:39 2022] PUT /identity/v3/projects/8fa6e4d8a246415899afee30e875fa81/users/218bd2f9d49f4c449cf1f8c4f4b7183e/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:39.368179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d60d69-8b3d-408f-86f2-0590a5569b56 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:39.368475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d60d69-8b3d-408f-86f2-0590a5569b56 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:39.368822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d60d69-8b3d-408f-86f2-0590a5569b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:39.397330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-23d60d69-8b3d-408f-86f2-0590a5569b56 None None] MFA Rules not processed for user `218bd2f9d49f4c449cf1f8c4f4b7183e`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:39.398551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-23d60d69-8b3d-408f-86f2-0590a5569b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:39.464726 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1252/2538] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:39.476221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cb343-d57e-4320-a651-968d146509a4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:39.478004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e73cb343-d57e-4320-a651-968d146509a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:39.558248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cb343-d57e-4320-a651-968d146509a4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:39.561991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf5d82-cb31-4dd0-a535-46e3ab73b905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:39.562606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf5d82-cb31-4dd0-a535-46e3ab73b905 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:39.562891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf5d82-cb31-4dd0-a535-46e3ab73b905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:39.563167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf5d82-cb31-4dd0-a535-46e3ab73b905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:39.572079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf5d82-cb31-4dd0-a535-46e3ab73b905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:39.573557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf5d82-cb31-4dd0-a535-46e3ab73b905 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:39.583413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1287/2539] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:41:40.918981 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d60d69-8b3d-408f-86f2-0590a5569b56 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:40.979525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d60d69-8b3d-408f-86f2-0590a5569b56 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:40.985383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:40.986015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:40.986292 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:40.986562 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] PATH_INFO: `/v3/users/1472c29740ae42bdab5aabeb47e315f3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:40.987706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1472c29740ae42bdab5aabeb47e315f3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:40.989642 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:41.002199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:41.034123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1472c29740ae42bdab5aabeb47e315f3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.040817 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1472c29740ae42bdab5aabeb47e315f3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.052440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1472c29740ae42bdab5aabeb47e315f3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.053152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1472c29740ae42bdab5aabeb47e315f3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.053754 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1472c29740ae42bdab5aabeb47e315f3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.067066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1253/2540] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:41:40 2022] DELETE /identity/v3/users/1472c29740ae42bdab5aabeb47e315f3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:41.071861 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3bbfb-0130-41d6-8916-8cd92862244b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:41.072348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3bbfb-0130-41d6-8916-8cd92862244b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:41.072590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3bbfb-0130-41d6-8916-8cd92862244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:41.093141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5ac3bbfb-0130-41d6-8916-8cd92862244b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:41.094340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5ac3bbfb-0130-41d6-8916-8cd92862244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:41.153058 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1288/2541] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:41:41.162900 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:41.164319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:41.221283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653eded-6cf4-432e-bc87-c1bb3386f93d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:41.224811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0852d-ce27-4e81-a6f1-eb51e1ab92c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:41.225478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0852d-ce27-4e81-a6f1-eb51e1ab92c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:41.225758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0852d-ce27-4e81-a6f1-eb51e1ab92c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:41.226034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0852d-ce27-4e81-a6f1-eb51e1ab92c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:41.234896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0852d-ce27-4e81-a6f1-eb51e1ab92c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:41.236333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0852d-ce27-4e81-a6f1-eb51e1ab92c1 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:41.245658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1254/2542] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:41.511119 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3bbfb-0130-41d6-8916-8cd92862244b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:41.513082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5ac3bbfb-0130-41d6-8916-8cd92862244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:41.526996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3bbfb-0130-41d6-8916-8cd92862244b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:41.534037 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:41.534690 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:41.534968 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:41.535258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] PATH_INFO: `/v3/projects/65e87b2615354ca8a5afb54199f41537` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:41.536378 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e87b2615354ca8a5afb54199f41537)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:41.538327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:41.586419 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e87b2615354ca8a5afb54199f41537', 'request_id': 'req-ac88185d-775b-400a-8f69-4a55a70184d3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.592243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e87b2615354ca8a5afb54199f41537', 'request_id': 'req-ac88185d-775b-400a-8f69-4a55a70184d3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.596204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:41.601921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e87b2615354ca8a5afb54199f41537', 'request_id': 'req-ac88185d-775b-400a-8f69-4a55a70184d3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.616209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] The token cache is being invalidate because project 65e87b2615354ca8a5afb54199f41537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:41:41.616497 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.617187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.618692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1289/2543] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:41:41 2022] DELETE /identity/v3/projects/65e87b2615354ca8a5afb54199f41537 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:41.623450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0852d-ce27-4e81-a6f1-eb51e1ab92c1 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:41.633334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0852d-ce27-4e81-a6f1-eb51e1ab92c1 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:41.692687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc50c7-cca9-4ad2-9b0a-0f4af881fe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:41.693471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc50c7-cca9-4ad2-9b0a-0f4af881fe5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:41.693757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc50c7-cca9-4ad2-9b0a-0f4af881fe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:41.694034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc50c7-cca9-4ad2-9b0a-0f4af881fe5d admin admin] PATH_INFO: `/v3/users/218bd2f9d49f4c449cf1f8c4f4b7183e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:41.695208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc50c7-cca9-4ad2-9b0a-0f4af881fe5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=218bd2f9d49f4c449cf1f8c4f4b7183e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:41.697250 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc50c7-cca9-4ad2-9b0a-0f4af881fe5d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:41.736270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:41.746319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0efc50c7-cca9-4ad2-9b0a-0f4af881fe5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218bd2f9d49f4c449cf1f8c4f4b7183e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.754345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0efc50c7-cca9-4ad2-9b0a-0f4af881fe5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218bd2f9d49f4c449cf1f8c4f4b7183e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.766236 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0efc50c7-cca9-4ad2-9b0a-0f4af881fe5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218bd2f9d49f4c449cf1f8c4f4b7183e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.766918 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0efc50c7-cca9-4ad2-9b0a-0f4af881fe5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218bd2f9d49f4c449cf1f8c4f4b7183e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.767527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0efc50c7-cca9-4ad2-9b0a-0f4af881fe5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218bd2f9d49f4c449cf1f8c4f4b7183e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:41.781034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1255/2544] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:41:41 2022] DELETE /identity/v3/users/218bd2f9d49f4c449cf1f8c4f4b7183e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:42.053493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:42.055023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:42.068777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88185d-775b-400a-8f69-4a55a70184d3 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:42.124262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f617021-3237-4229-b64a-80c09edc6813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:42.124940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f617021-3237-4229-b64a-80c09edc6813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:42.125194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f617021-3237-4229-b64a-80c09edc6813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:42.125466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f617021-3237-4229-b64a-80c09edc6813 admin admin] PATH_INFO: `/v3/projects/8fa6e4d8a246415899afee30e875fa81` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:42.126600 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f617021-3237-4229-b64a-80c09edc6813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa6e4d8a246415899afee30e875fa81)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:42.128499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f617021-3237-4229-b64a-80c09edc6813 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:42.174173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4f617021-3237-4229-b64a-80c09edc6813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa6e4d8a246415899afee30e875fa81', 'request_id': 'req-4f617021-3237-4229-b64a-80c09edc6813'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:42.179694 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4f617021-3237-4229-b64a-80c09edc6813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa6e4d8a246415899afee30e875fa81', 'request_id': 'req-4f617021-3237-4229-b64a-80c09edc6813'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:42.186831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4f617021-3237-4229-b64a-80c09edc6813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa6e4d8a246415899afee30e875fa81', 'request_id': 'req-4f617021-3237-4229-b64a-80c09edc6813'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:42.197890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4f617021-3237-4229-b64a-80c09edc6813 admin admin] The token cache is being invalidate because project 8fa6e4d8a246415899afee30e875fa81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:41:42.198175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4f617021-3237-4229-b64a-80c09edc6813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:42.198792 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4f617021-3237-4229-b64a-80c09edc6813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:42.200815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1290/2545] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:41:42 2022] DELETE /identity/v3/projects/8fa6e4d8a246415899afee30e875fa81 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:42.206644 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d07cc-d74e-4f41-873c-a5d330625208 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:42.207134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d07cc-d74e-4f41-873c-a5d330625208 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:42.207269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d07cc-d74e-4f41-873c-a5d330625208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:42.227827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a93d07cc-d74e-4f41-873c-a5d330625208 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:42.229083 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a93d07cc-d74e-4f41-873c-a5d330625208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:42.287637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1256/2546] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:41:42.295529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4c93d-4897-4503-8c54-68460d45e76f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:42.295840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4c93d-4897-4503-8c54-68460d45e76f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:42.296121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4c93d-4897-4503-8c54-68460d45e76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:42.315462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-19a4c93d-4897-4503-8c54-68460d45e76f None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:42.316641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-19a4c93d-4897-4503-8c54-68460d45e76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:42.325260 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1291/2547] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:42.329444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d07cc-d74e-4f41-873c-a5d330625208 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:42.339015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d07cc-d74e-4f41-873c-a5d330625208 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:42.344409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fdd47-92ab-446e-8d13-4739bbaede7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:42.345051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fdd47-92ab-446e-8d13-4739bbaede7b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:42.345340 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fdd47-92ab-446e-8d13-4739bbaede7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:42.345618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fdd47-92ab-446e-8d13-4739bbaede7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:42.346316 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fdd47-92ab-446e-8d13-4739bbaede7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:41:42.346625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fdd47-92ab-446e-8d13-4739bbaede7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:42.348246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fdd47-92ab-446e-8d13-4739bbaede7b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:42.359930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1257/2548] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:41:42.364306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4c93d-4897-4503-8c54-68460d45e76f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:42.374397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4c93d-4897-4503-8c54-68460d45e76f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:42.379354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412de85-fd36-465f-847a-89ec78478f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:42.379966 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412de85-fd36-465f-847a-89ec78478f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:42.380251 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412de85-fd36-465f-847a-89ec78478f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:42.380531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412de85-fd36-465f-847a-89ec78478f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:42.381256 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412de85-fd36-465f-847a-89ec78478f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:42.383210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412de85-fd36-465f-847a-89ec78478f59 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:42.411083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1292/2549] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:41:42 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:42.415271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fdd47-92ab-446e-8d13-4739bbaede7b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:42.425975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fdd47-92ab-446e-8d13-4739bbaede7b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:42.482178 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47f2f8-adda-4fa7-9c69-6f200c8bc861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:42.482867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47f2f8-adda-4fa7-9c69-6f200c8bc861 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:42.483153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47f2f8-adda-4fa7-9c69-6f200c8bc861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:42.483461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47f2f8-adda-4fa7-9c69-6f200c8bc861 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:42.484129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47f2f8-adda-4fa7-9c69-6f200c8bc861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:42.486124 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47f2f8-adda-4fa7-9c69-6f200c8bc861 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:42.507753 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1258/2550] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:41:42 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:42.511851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412de85-fd36-465f-847a-89ec78478f59 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:42.523080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412de85-fd36-465f-847a-89ec78478f59 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:42.527649 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab9ffb-855c-45c6-b727-476bef328637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:42.528506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab9ffb-855c-45c6-b727-476bef328637 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:42.528786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab9ffb-855c-45c6-b727-476bef328637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:42.529099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab9ffb-855c-45c6-b727-476bef328637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:42.529798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab9ffb-855c-45c6-b727-476bef328637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:42.531381 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab9ffb-855c-45c6-b727-476bef328637 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:42.541393 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1293/2551] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:42.545418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47f2f8-adda-4fa7-9c69-6f200c8bc861 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:42.556682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47f2f8-adda-4fa7-9c69-6f200c8bc861 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:42.562037 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddb232-28b4-4332-b315-74eee97ea8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:42.562653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddb232-28b4-4332-b315-74eee97ea8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:42.562940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddb232-28b4-4332-b315-74eee97ea8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:42.563221 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddb232-28b4-4332-b315-74eee97ea8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:42.563956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddb232-28b4-4332-b315-74eee97ea8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:42.565625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddb232-28b4-4332-b315-74eee97ea8c1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:42.576895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1259/2552] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:42.581125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab9ffb-855c-45c6-b727-476bef328637 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:42.591042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab9ffb-855c-45c6-b727-476bef328637 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:42.595547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eb1f9-cb85-45bc-915c-2728d0362a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:42.596195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eb1f9-cb85-45bc-915c-2728d0362a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:42.596474 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eb1f9-cb85-45bc-915c-2728d0362a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:42.596747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eb1f9-cb85-45bc-915c-2728d0362a60 admin admin] PATH_INFO: `/v3/projects/1bfc9bdac8d0411abd166e94ae1392a5/users/e5a3c99a5f584ffca49ec2a884227a06/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:42.612814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056eb1f9-cb85-45bc-915c-2728d0362a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfc9bdac8d0411abd166e94ae1392a5, user_id=e5a3c99a5f584ffca49ec2a884227a06, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:42.615550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056eb1f9-cb85-45bc-915c-2728d0362a60 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:42.629490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1294/2553] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:41:42 2022] PUT /identity/v3/projects/1bfc9bdac8d0411abd166e94ae1392a5/users/e5a3c99a5f584ffca49ec2a884227a06/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:42.641585 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751984c2-c67b-4223-9d26-93ed41227340 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:42.641872 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751984c2-c67b-4223-9d26-93ed41227340 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:42.642150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751984c2-c67b-4223-9d26-93ed41227340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:42.672271 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-751984c2-c67b-4223-9d26-93ed41227340 None None] MFA Rules not processed for user `e5a3c99a5f584ffca49ec2a884227a06`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:42.673542 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-751984c2-c67b-4223-9d26-93ed41227340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:42.678742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:42.881468 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1260/2554] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:42.885818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eb1f9-cb85-45bc-915c-2728d0362a60 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:42.907774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:42.961912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eb1f9-cb85-45bc-915c-2728d0362a60 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:42.967262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f4552-e321-49bf-9ea7-f626d78ea36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:42.967907 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f4552-e321-49bf-9ea7-f626d78ea36c admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:42.968299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f4552-e321-49bf-9ea7-f626d78ea36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:42.968580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f4552-e321-49bf-9ea7-f626d78ea36c admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:42.969271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f4552-e321-49bf-9ea7-f626d78ea36c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:42.971238 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f4552-e321-49bf-9ea7-f626d78ea36c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:42.997126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1295/2555] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:41:42 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:43.001162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751984c2-c67b-4223-9d26-93ed41227340 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:43.012948 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751984c2-c67b-4223-9d26-93ed41227340 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:43.070224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01865028-26fb-45b1-afb3-b3bdf7f5cc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:43.070847 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01865028-26fb-45b1-afb3-b3bdf7f5cc24 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:43.071133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01865028-26fb-45b1-afb3-b3bdf7f5cc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:43.071405 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01865028-26fb-45b1-afb3-b3bdf7f5cc24 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:43.072114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01865028-26fb-45b1-afb3-b3bdf7f5cc24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:43.074050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01865028-26fb-45b1-afb3-b3bdf7f5cc24 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:43.098147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1261/2556] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:41:43 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:43.102064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f4552-e321-49bf-9ea7-f626d78ea36c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:43.112560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f4552-e321-49bf-9ea7-f626d78ea36c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:43.117223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56be197-d489-4bec-ae03-c2271fbee794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:43.117837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56be197-d489-4bec-ae03-c2271fbee794 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:43.118121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56be197-d489-4bec-ae03-c2271fbee794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:43.118488 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56be197-d489-4bec-ae03-c2271fbee794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:43.119201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56be197-d489-4bec-ae03-c2271fbee794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:43.120816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56be197-d489-4bec-ae03-c2271fbee794 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:43.132586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1296/2557] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:41:43.136799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01865028-26fb-45b1-afb3-b3bdf7f5cc24 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:43.147723 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01865028-26fb-45b1-afb3-b3bdf7f5cc24 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:43.152626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227521ba-5444-4d70-bc0e-cf7ad2c820eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:43.153930 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227521ba-5444-4d70-bc0e-cf7ad2c820eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:43.154208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227521ba-5444-4d70-bc0e-cf7ad2c820eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:43.154480 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227521ba-5444-4d70-bc0e-cf7ad2c820eb admin admin] PATH_INFO: `/v3/projects/41d29a232a054930aab0064a647d561e/users/0fcca59c96de4f28919d97340670da68/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:43.170035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227521ba-5444-4d70-bc0e-cf7ad2c820eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d29a232a054930aab0064a647d561e, user_id=0fcca59c96de4f28919d97340670da68, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:43.172655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227521ba-5444-4d70-bc0e-cf7ad2c820eb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:43.185837 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1262/2558] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:41:43 2022] PUT /identity/v3/projects/41d29a232a054930aab0064a647d561e/users/0fcca59c96de4f28919d97340670da68/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:43.189874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56be197-d489-4bec-ae03-c2271fbee794 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:43.199611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56be197-d489-4bec-ae03-c2271fbee794 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:43.256798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248464c-aed6-4c2d-92db-74be9668ee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:43.257469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248464c-aed6-4c2d-92db-74be9668ee9e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:43.257755 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248464c-aed6-4c2d-92db-74be9668ee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:43.258034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248464c-aed6-4c2d-92db-74be9668ee9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:43.258726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248464c-aed6-4c2d-92db-74be9668ee9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:43.260308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248464c-aed6-4c2d-92db-74be9668ee9e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:43.270756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1297/2559] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:43.274974 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227521ba-5444-4d70-bc0e-cf7ad2c820eb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:43.285664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227521ba-5444-4d70-bc0e-cf7ad2c820eb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:43.290244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479346cd-966a-46a4-befc-ed511439a0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:43.290901 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479346cd-966a-46a4-befc-ed511439a0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:43.291179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479346cd-966a-46a4-befc-ed511439a0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:43.291452 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479346cd-966a-46a4-befc-ed511439a0fb admin admin] PATH_INFO: `/v3/projects/41d29a232a054930aab0064a647d561e/users/0fcca59c96de4f28919d97340670da68/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:43.293442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479346cd-966a-46a4-befc-ed511439a0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d29a232a054930aab0064a647d561e, user_id=0fcca59c96de4f28919d97340670da68, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:43.296660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479346cd-966a-46a4-befc-ed511439a0fb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:43.306565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1263/2560] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:41:43 2022] PUT /identity/v3/projects/41d29a232a054930aab0064a647d561e/users/0fcca59c96de4f28919d97340670da68/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:43.316633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6696be-b3c1-44a5-b658-a0b58a08bcd6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:43.316932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6696be-b3c1-44a5-b658-a0b58a08bcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:43.317226 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6696be-b3c1-44a5-b658-a0b58a08bcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:43.345126 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5d6696be-b3c1-44a5-b658-a0b58a08bcd6 None None] MFA Rules not processed for user `0fcca59c96de4f28919d97340670da68`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:43.346331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5d6696be-b3c1-44a5-b658-a0b58a08bcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:43.417504 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1298/2561] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:43.429098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479346cd-966a-46a4-befc-ed511439a0fb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:43.430867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-479346cd-966a-46a4-befc-ed511439a0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:43.487555 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479346cd-966a-46a4-befc-ed511439a0fb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:43.491330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de25993-0723-466b-bb14-5ef1d2426369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:43.491943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de25993-0723-466b-bb14-5ef1d2426369 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:43.492223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de25993-0723-466b-bb14-5ef1d2426369 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:43.492503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de25993-0723-466b-bb14-5ef1d2426369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:43.502109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de25993-0723-466b-bb14-5ef1d2426369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:43.503524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de25993-0723-466b-bb14-5ef1d2426369 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:43.513867 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1264/2562] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:43.614168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6696be-b3c1-44a5-b658-a0b58a08bcd6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:43.624316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6696be-b3c1-44a5-b658-a0b58a08bcd6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:43.627747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb791936-5abc-418c-8e9d-9caad45411c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:43.628346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb791936-5abc-418c-8e9d-9caad45411c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:43.628622 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb791936-5abc-418c-8e9d-9caad45411c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:43.629175 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb791936-5abc-418c-8e9d-9caad45411c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:43.637807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:43.687041 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb791936-5abc-418c-8e9d-9caad45411c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:43.688476 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb791936-5abc-418c-8e9d-9caad45411c2 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:43.697186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1299/2563] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:45.448732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71762c9-7a2b-4001-b128-87f0fafb73ec None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:45.449368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71762c9-7a2b-4001-b128-87f0fafb73ec None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:45.449368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71762c9-7a2b-4001-b128-87f0fafb73ec None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:45.451489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1265/2564] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:41:45.458097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b59c83-36f0-4cea-9953-1c2289d6aa2d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:45.458664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b59c83-36f0-4cea-9953-1c2289d6aa2d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:45.459038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b59c83-36f0-4cea-9953-1c2289d6aa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:45.487057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-17b59c83-36f0-4cea-9953-1c2289d6aa2d None None] MFA Rules not processed for user `403beb9eb6c04cc69579361138bea12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:45.488816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-17b59c83-36f0-4cea-9953-1c2289d6aa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:45.560230 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1300/2565] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:41:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:41:45.573279 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71762c9-7a2b-4001-b128-87f0fafb73ec None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:45.575143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e71762c9-7a2b-4001-b128-87f0fafb73ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:45.583155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:45.589781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71762c9-7a2b-4001-b128-87f0fafb73ec None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:45.593972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8f9e7-cec5-4c60-8df6-b561aa99ac66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:45.594700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f9e7-cec5-4c60-8df6-b561aa99ac66 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:45.595065 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f9e7-cec5-4c60-8df6-b561aa99ac66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:45.595652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f9e7-cec5-4c60-8df6-b561aa99ac66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:45.606183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8f9e7-cec5-4c60-8df6-b561aa99ac66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:45.607895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8f9e7-cec5-4c60-8df6-b561aa99ac66 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:45.615724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1266/2566] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:45.698232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd257b-0f3a-4b83-88d4-83a80090d7c0 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:45.698525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd257b-0f3a-4b83-88d4-83a80090d7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:45.698803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd257b-0f3a-4b83-88d4-83a80090d7c0 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:45.701497 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1301/2567] 10.222.0.15 () {54 vars in 921 bytes} [Sat Aug 6 01:41:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:41:45.707095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39246738-b23d-42cb-8bcd-94e90bc25154 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:45.707444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39246738-b23d-42cb-8bcd-94e90bc25154 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:45.707835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39246738-b23d-42cb-8bcd-94e90bc25154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:45.738169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-39246738-b23d-42cb-8bcd-94e90bc25154 None None] MFA Rules not processed for user `666f4864832445d5a10d60f677f5cd6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:45.739380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-39246738-b23d-42cb-8bcd-94e90bc25154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:45.814895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1267/2568] 10.222.0.15 () {58 vars in 1018 bytes} [Sat Aug 6 01:41:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:41:45.825885 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd257b-0f3a-4b83-88d4-83a80090d7c0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:45.827561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-eadd257b-0f3a-4b83-88d4-83a80090d7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:45.840524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd257b-0f3a-4b83-88d4-83a80090d7c0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:45.844069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cab9c-fac3-4639-ad30-3e97768fa240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:45.844668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cab9c-fac3-4639-ad30-3e97768fa240 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:45.845006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cab9c-fac3-4639-ad30-3e97768fa240 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:45.845275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cab9c-fac3-4639-ad30-3e97768fa240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:45.855124 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cab9c-fac3-4639-ad30-3e97768fa240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:45.857235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cab9c-fac3-4639-ad30-3e97768fa240 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:45.867655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1302/2569] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:46.298399 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39246738-b23d-42cb-8bcd-94e90bc25154 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:46.375392 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39246738-b23d-42cb-8bcd-94e90bc25154 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:46.381408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:46.381987 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:46.382391 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:46.382777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] PATH_INFO: `/v3/users/e5a3c99a5f584ffca49ec2a884227a06` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:46.384104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a3c99a5f584ffca49ec2a884227a06)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:46.386038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:46.450034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a3c99a5f584ffca49ec2a884227a06'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:46.458700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a3c99a5f584ffca49ec2a884227a06'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:46.466652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:46.479693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a3c99a5f584ffca49ec2a884227a06'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:46.480476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a3c99a5f584ffca49ec2a884227a06'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:46.481143 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a3c99a5f584ffca49ec2a884227a06'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:46.500399 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1268/2570] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:41:46 2022] DELETE /identity/v3/users/e5a3c99a5f584ffca49ec2a884227a06 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:46.502742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc29d-d443-4fed-9b3e-93bc19ab5cd7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:46.503237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc29d-d443-4fed-9b3e-93bc19ab5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:46.503334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc29d-d443-4fed-9b3e-93bc19ab5cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:46.534576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-42ddc29d-d443-4fed-9b3e-93bc19ab5cd7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:46.535943 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-42ddc29d-d443-4fed-9b3e-93bc19ab5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:46.653069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1303/2571] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:46.658943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:46.665015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:46.777433 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfef98e-b382-4f86-86c2-b55f0a95d8e1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:46.783312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7a3b7-752b-40e8-a339-1e38f17fb918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:46.784284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7a3b7-752b-40e8-a339-1e38f17fb918 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:46.785093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7a3b7-752b-40e8-a339-1e38f17fb918 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:46.785757 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7a3b7-752b-40e8-a339-1e38f17fb918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:46.796641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7a3b7-752b-40e8-a339-1e38f17fb918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:46.798203 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7a3b7-752b-40e8-a339-1e38f17fb918 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:46.809569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1269/2572] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:47.095379 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddc29d-d443-4fed-9b3e-93bc19ab5cd7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:47.096845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-42ddc29d-d443-4fed-9b3e-93bc19ab5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:47.110353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddc29d-d443-4fed-9b3e-93bc19ab5cd7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:47.115100 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:47.115775 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:47.116060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:47.116338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] PATH_INFO: `/v3/projects/1bfc9bdac8d0411abd166e94ae1392a5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:47.117544 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfc9bdac8d0411abd166e94ae1392a5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:47.119449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:47.160051 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:47.166880 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfc9bdac8d0411abd166e94ae1392a5', 'request_id': 'req-85e7b025-62f4-482d-8010-8fec96141c1d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.173201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfc9bdac8d0411abd166e94ae1392a5', 'request_id': 'req-85e7b025-62f4-482d-8010-8fec96141c1d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.180274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfc9bdac8d0411abd166e94ae1392a5', 'request_id': 'req-85e7b025-62f4-482d-8010-8fec96141c1d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.191848 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] The token cache is being invalidate because project 1bfc9bdac8d0411abd166e94ae1392a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:41:47.192141 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.192775 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.194308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1304/2573] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:41:47 2022] DELETE /identity/v3/projects/1bfc9bdac8d0411abd166e94ae1392a5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:47.198348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7a3b7-752b-40e8-a339-1e38f17fb918 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:47.208258 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7a3b7-752b-40e8-a339-1e38f17fb918 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:47.265261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03467e-ace8-42a9-8677-bcf2bf8f8f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:47.266021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03467e-ace8-42a9-8677-bcf2bf8f8f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:47.266300 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03467e-ace8-42a9-8677-bcf2bf8f8f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:47.266574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03467e-ace8-42a9-8677-bcf2bf8f8f13 admin admin] PATH_INFO: `/v3/users/0fcca59c96de4f28919d97340670da68` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:47.267711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03467e-ace8-42a9-8677-bcf2bf8f8f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fcca59c96de4f28919d97340670da68)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:47.269656 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03467e-ace8-42a9-8677-bcf2bf8f8f13 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:47.314735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1c03467e-ace8-42a9-8677-bcf2bf8f8f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fcca59c96de4f28919d97340670da68'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.321557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1c03467e-ace8-42a9-8677-bcf2bf8f8f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fcca59c96de4f28919d97340670da68'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.334370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1c03467e-ace8-42a9-8677-bcf2bf8f8f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fcca59c96de4f28919d97340670da68'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.335050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1c03467e-ace8-42a9-8677-bcf2bf8f8f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fcca59c96de4f28919d97340670da68'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.335663 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1c03467e-ace8-42a9-8677-bcf2bf8f8f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fcca59c96de4f28919d97340670da68'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.349510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1270/2574] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:41:47 2022] DELETE /identity/v3/users/0fcca59c96de4f28919d97340670da68 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:47.626791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:47.628501 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:47.663899 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7b025-62f4-482d-8010-8fec96141c1d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:47.726774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823ce2b-19a5-48b2-94cd-96ac953d83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:47.727427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823ce2b-19a5-48b2-94cd-96ac953d83c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:47.727714 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823ce2b-19a5-48b2-94cd-96ac953d83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:47.727995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823ce2b-19a5-48b2-94cd-96ac953d83c4 admin admin] PATH_INFO: `/v3/projects/41d29a232a054930aab0064a647d561e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:47.729237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823ce2b-19a5-48b2-94cd-96ac953d83c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d29a232a054930aab0064a647d561e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:47.731240 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823ce2b-19a5-48b2-94cd-96ac953d83c4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:47.789484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6823ce2b-19a5-48b2-94cd-96ac953d83c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d29a232a054930aab0064a647d561e', 'request_id': 'req-6823ce2b-19a5-48b2-94cd-96ac953d83c4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.796963 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6823ce2b-19a5-48b2-94cd-96ac953d83c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d29a232a054930aab0064a647d561e', 'request_id': 'req-6823ce2b-19a5-48b2-94cd-96ac953d83c4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.808449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6823ce2b-19a5-48b2-94cd-96ac953d83c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d29a232a054930aab0064a647d561e', 'request_id': 'req-6823ce2b-19a5-48b2-94cd-96ac953d83c4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.820529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6823ce2b-19a5-48b2-94cd-96ac953d83c4 admin admin] The token cache is being invalidate because project 41d29a232a054930aab0064a647d561e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:41:47.820823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6823ce2b-19a5-48b2-94cd-96ac953d83c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.821503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6823ce2b-19a5-48b2-94cd-96ac953d83c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:47.823026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1305/2575] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:41:47 2022] DELETE /identity/v3/projects/41d29a232a054930aab0064a647d561e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:47.828430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6e6f7-5dae-4887-a9e0-5f96f0cba5fe None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:47.828972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6e6f7-5dae-4887-a9e0-5f96f0cba5fe None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:47.829097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6e6f7-5dae-4887-a9e0-5f96f0cba5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:47.836467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:47.860423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6bb6e6f7-5dae-4887-a9e0-5f96f0cba5fe None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:47.861655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6bb6e6f7-5dae-4887-a9e0-5f96f0cba5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:47.962287 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1271/2576] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:47.970210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7e759-0d80-4289-83fc-2b31de89444c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:47.970679 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7e759-0d80-4289-83fc-2b31de89444c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:47.971033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7e759-0d80-4289-83fc-2b31de89444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:47.996234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8ec7e759-0d80-4289-83fc-2b31de89444c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:47.998322 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8ec7e759-0d80-4289-83fc-2b31de89444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:48.008335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1306/2577] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:48.013252 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6e6f7-5dae-4887-a9e0-5f96f0cba5fe None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.037851 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6e6f7-5dae-4887-a9e0-5f96f0cba5fe None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:48.037851 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4b11e-246f-49cd-89d0-45f8d1efa6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:48.037851 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4b11e-246f-49cd-89d0-45f8d1efa6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.037851 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4b11e-246f-49cd-89d0-45f8d1efa6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.038356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4b11e-246f-49cd-89d0-45f8d1efa6c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.038356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4b11e-246f-49cd-89d0-45f8d1efa6c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:41:48.038356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4b11e-246f-49cd-89d0-45f8d1efa6c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:48.038356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4b11e-246f-49cd-89d0-45f8d1efa6c1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:48.055013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1272/2578] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:41:48.060962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7e759-0d80-4289-83fc-2b31de89444c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.073747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7e759-0d80-4289-83fc-2b31de89444c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:48.081034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650d6b5-5ce6-4aa8-8cd7-d56b248008e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:48.081656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650d6b5-5ce6-4aa8-8cd7-d56b248008e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.081936 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650d6b5-5ce6-4aa8-8cd7-d56b248008e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.082211 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650d6b5-5ce6-4aa8-8cd7-d56b248008e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.082975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650d6b5-5ce6-4aa8-8cd7-d56b248008e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:48.086043 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650d6b5-5ce6-4aa8-8cd7-d56b248008e4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:48.122647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1307/2579] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:41:48 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:48.126932 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4b11e-246f-49cd-89d0-45f8d1efa6c1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.137272 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4b11e-246f-49cd-89d0-45f8d1efa6c1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:48.198674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5298b-ed4a-46b0-8bbc-7271edd13406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:48.199201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5298b-ed4a-46b0-8bbc-7271edd13406 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.199487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5298b-ed4a-46b0-8bbc-7271edd13406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.199768 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5298b-ed4a-46b0-8bbc-7271edd13406 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.200439 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5298b-ed4a-46b0-8bbc-7271edd13406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:48.202517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5298b-ed4a-46b0-8bbc-7271edd13406 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:48.225551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1273/2580] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:41:48 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:48.229562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650d6b5-5ce6-4aa8-8cd7-d56b248008e4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.241060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650d6b5-5ce6-4aa8-8cd7-d56b248008e4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:48.245723 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d3cb0-c15e-4274-9231-53f2120a095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:48.246583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3cb0-c15e-4274-9231-53f2120a095d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.247491 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3cb0-c15e-4274-9231-53f2120a095d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.248048 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3cb0-c15e-4274-9231-53f2120a095d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.248842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d3cb0-c15e-4274-9231-53f2120a095d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:48.250566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d3cb0-c15e-4274-9231-53f2120a095d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:48.261635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1308/2581] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:48.265683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5298b-ed4a-46b0-8bbc-7271edd13406 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.276344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5298b-ed4a-46b0-8bbc-7271edd13406 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:48.285098 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557912e-5f93-4558-9740-809809bf45ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:48.285730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557912e-5f93-4558-9740-809809bf45ef admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.286015 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557912e-5f93-4558-9740-809809bf45ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.286294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557912e-5f93-4558-9740-809809bf45ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.287136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557912e-5f93-4558-9740-809809bf45ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:48.288724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557912e-5f93-4558-9740-809809bf45ef admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:48.303830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1274/2582] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:41:48.305004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d3cb0-c15e-4274-9231-53f2120a095d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.315180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d3cb0-c15e-4274-9231-53f2120a095d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:48.319865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d1fcf-e68f-4c6c-aee7-ed595d33af86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:48.320531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d1fcf-e68f-4c6c-aee7-ed595d33af86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.320816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d1fcf-e68f-4c6c-aee7-ed595d33af86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.321120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d1fcf-e68f-4c6c-aee7-ed595d33af86 admin admin] PATH_INFO: `/v3/projects/614757b981d94bc99fa1a5b407e74693/users/2888d76cbd24456faf044a737ac2efc2/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.336367 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d1fcf-e68f-4c6c-aee7-ed595d33af86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=614757b981d94bc99fa1a5b407e74693, user_id=2888d76cbd24456faf044a737ac2efc2, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:48.339053 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d1fcf-e68f-4c6c-aee7-ed595d33af86 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:48.342797 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:48.355307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1309/2583] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:41:48 2022] PUT /identity/v3/projects/614757b981d94bc99fa1a5b407e74693/users/2888d76cbd24456faf044a737ac2efc2/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:48.367393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef7ad8-dac8-47c8-a34c-9e8856eed4de None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.367685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef7ad8-dac8-47c8-a34c-9e8856eed4de None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.367969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef7ad8-dac8-47c8-a34c-9e8856eed4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.395833 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a3ef7ad8-dac8-47c8-a34c-9e8856eed4de None None] MFA Rules not processed for user `2888d76cbd24456faf044a737ac2efc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:48.397104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a3ef7ad8-dac8-47c8-a34c-9e8856eed4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:48.456089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:48.461996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1275/2584] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:48.466284 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d1fcf-e68f-4c6c-aee7-ed595d33af86 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.529163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d1fcf-e68f-4c6c-aee7-ed595d33af86 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:48.533747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c824-69b6-419d-98fc-09e9c64456db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:48.534359 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c824-69b6-419d-98fc-09e9c64456db admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.534646 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c824-69b6-419d-98fc-09e9c64456db admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.534933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c824-69b6-419d-98fc-09e9c64456db admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.535598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7c824-69b6-419d-98fc-09e9c64456db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:48.537612 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7c824-69b6-419d-98fc-09e9c64456db admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:48.563629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1310/2585] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:41:48 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:48.567820 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef7ad8-dac8-47c8-a34c-9e8856eed4de None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.578235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef7ad8-dac8-47c8-a34c-9e8856eed4de None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:48.633947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e707c-3e05-48b4-8467-34f207a2b5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:48.634560 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e707c-3e05-48b4-8467-34f207a2b5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.634842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e707c-3e05-48b4-8467-34f207a2b5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.635118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e707c-3e05-48b4-8467-34f207a2b5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.635780 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e707c-3e05-48b4-8467-34f207a2b5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:48.637806 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e707c-3e05-48b4-8467-34f207a2b5e3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:48.658695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1276/2586] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:41:48 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:41:48.662814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c824-69b6-419d-98fc-09e9c64456db admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.674752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c824-69b6-419d-98fc-09e9c64456db admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:48.679511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba3656-428e-476a-8b24-ab702f997989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:48.680121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba3656-428e-476a-8b24-ab702f997989 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.680404 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba3656-428e-476a-8b24-ab702f997989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.680678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba3656-428e-476a-8b24-ab702f997989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.681412 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba3656-428e-476a-8b24-ab702f997989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:48.683078 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba3656-428e-476a-8b24-ab702f997989 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:48.693544 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1311/2587] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:48.697684 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e707c-3e05-48b4-8467-34f207a2b5e3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.707787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e707c-3e05-48b4-8467-34f207a2b5e3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:48.712357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d7900-d328-4391-9267-6c17ed3eae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:48.713045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d7900-d328-4391-9267-6c17ed3eae25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.713324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d7900-d328-4391-9267-6c17ed3eae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.713594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d7900-d328-4391-9267-6c17ed3eae25 admin admin] PATH_INFO: `/v3/projects/be6256a946da479c8831805532bbdb19/users/c7c5671dca344033a2f5984eb036f1c8/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.728846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d7900-d328-4391-9267-6c17ed3eae25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6256a946da479c8831805532bbdb19, user_id=c7c5671dca344033a2f5984eb036f1c8, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:48.732151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d7900-d328-4391-9267-6c17ed3eae25 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:48.746040 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1277/2588] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:41:48 2022] PUT /identity/v3/projects/be6256a946da479c8831805532bbdb19/users/c7c5671dca344033a2f5984eb036f1c8/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:41:48.750196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba3656-428e-476a-8b24-ab702f997989 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.760470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba3656-428e-476a-8b24-ab702f997989 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:48.815025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369908b6-e340-4eb7-abf0-3e9b6efbc2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:48.815629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369908b6-e340-4eb7-abf0-3e9b6efbc2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.815910 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369908b6-e340-4eb7-abf0-3e9b6efbc2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.816183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369908b6-e340-4eb7-abf0-3e9b6efbc2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.816862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369908b6-e340-4eb7-abf0-3e9b6efbc2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:48.818460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369908b6-e340-4eb7-abf0-3e9b6efbc2c0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:48.828415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1312/2589] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:48.832532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d7900-d328-4391-9267-6c17ed3eae25 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.843131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d7900-d328-4391-9267-6c17ed3eae25 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:48.847632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f632ce7-df58-438c-8065-197d1c402182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:48.848274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f632ce7-df58-438c-8065-197d1c402182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.848550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f632ce7-df58-438c-8065-197d1c402182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.848819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f632ce7-df58-438c-8065-197d1c402182 admin admin] PATH_INFO: `/v3/projects/be6256a946da479c8831805532bbdb19/users/c7c5671dca344033a2f5984eb036f1c8/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.850764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f632ce7-df58-438c-8065-197d1c402182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6256a946da479c8831805532bbdb19, user_id=c7c5671dca344033a2f5984eb036f1c8, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:48.853365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f632ce7-df58-438c-8065-197d1c402182 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:48.863478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1278/2590] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:41:48 2022] PUT /identity/v3/projects/be6256a946da479c8831805532bbdb19/users/c7c5671dca344033a2f5984eb036f1c8/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:41:48.873668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec92022-73db-44eb-be7d-2c0758890719 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:48.873818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec92022-73db-44eb-be7d-2c0758890719 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:48.874065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec92022-73db-44eb-be7d-2c0758890719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:48.901264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7ec92022-73db-44eb-be7d-2c0758890719 None None] MFA Rules not processed for user `c7c5671dca344033a2f5984eb036f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:48.902452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7ec92022-73db-44eb-be7d-2c0758890719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:48.951450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:48.969976 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1313/2591] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:48.981678 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f632ce7-df58-438c-8065-197d1c402182 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:48.983274 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8f632ce7-df58-438c-8065-197d1c402182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:49.039751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f632ce7-df58-438c-8065-197d1c402182 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:49.043754 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cc3f1-ec37-4c53-9f73-6fae2103dd93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:49.044363 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cc3f1-ec37-4c53-9f73-6fae2103dd93 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:49.044640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cc3f1-ec37-4c53-9f73-6fae2103dd93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:49.044921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cc3f1-ec37-4c53-9f73-6fae2103dd93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:49.054118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cc3f1-ec37-4c53-9f73-6fae2103dd93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:49.055547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cc3f1-ec37-4c53-9f73-6fae2103dd93 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:49.065758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1279/2592] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:49.151066 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec92022-73db-44eb-be7d-2c0758890719 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:49.162632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec92022-73db-44eb-be7d-2c0758890719 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:49.167973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fbf39-dfe1-4c92-a51e-cba90c35385b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:49.168695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fbf39-dfe1-4c92-a51e-cba90c35385b service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:49.169089 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fbf39-dfe1-4c92-a51e-cba90c35385b service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:49.169305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fbf39-dfe1-4c92-a51e-cba90c35385b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:49.239199 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fbf39-dfe1-4c92-a51e-cba90c35385b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:49.240575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fbf39-dfe1-4c92-a51e-cba90c35385b service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:49.249970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1314/2593] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:54.005505 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cc3f1-ec37-4c53-9f73-6fae2103dd93 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:54.056063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:54.068703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cc3f1-ec37-4c53-9f73-6fae2103dd93 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:54.073369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:54.074002 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:54.074313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:54.074589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] PATH_INFO: `/v3/users/2888d76cbd24456faf044a737ac2efc2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:54.075766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2888d76cbd24456faf044a737ac2efc2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:54.077698 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:54.126606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2888d76cbd24456faf044a737ac2efc2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.133804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2888d76cbd24456faf044a737ac2efc2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.145830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2888d76cbd24456faf044a737ac2efc2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.146497 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2888d76cbd24456faf044a737ac2efc2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.147102 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2888d76cbd24456faf044a737ac2efc2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.160243 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1280/2594] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:41:54 2022] DELETE /identity/v3/users/2888d76cbd24456faf044a737ac2efc2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:54.164914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a7237-5068-46dc-9980-38deeaa017eb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:54.165422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a7237-5068-46dc-9980-38deeaa017eb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:54.165602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a7237-5068-46dc-9980-38deeaa017eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:54.186749 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c12a7237-5068-46dc-9980-38deeaa017eb None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:54.187963 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c12a7237-5068-46dc-9980-38deeaa017eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:54.249898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1315/2595] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:54.260036 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:54.261520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:54.320921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b715b4a-589b-4b1b-9c22-15e3da17bc88 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:54.325586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ffbde-ed4d-4138-9ad6-345bfdf236c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:54.326218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ffbde-ed4d-4138-9ad6-345bfdf236c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:54.326499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ffbde-ed4d-4138-9ad6-345bfdf236c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:54.326772 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ffbde-ed4d-4138-9ad6-345bfdf236c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:54.340783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ffbde-ed4d-4138-9ad6-345bfdf236c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:54.342625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ffbde-ed4d-4138-9ad6-345bfdf236c1 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:54.353761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1281/2596] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:54.629315 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a7237-5068-46dc-9980-38deeaa017eb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:54.630762 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c12a7237-5068-46dc-9980-38deeaa017eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:54.643850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a7237-5068-46dc-9980-38deeaa017eb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:54.648815 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:54.649436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:54.649871 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:54.650149 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] PATH_INFO: `/v3/projects/614757b981d94bc99fa1a5b407e74693` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:54.651304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=614757b981d94bc99fa1a5b407e74693)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:54.653840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:54.706269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614757b981d94bc99fa1a5b407e74693', 'request_id': 'req-c4c46d9e-99ec-478b-abfa-0284deee4364'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.712724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614757b981d94bc99fa1a5b407e74693', 'request_id': 'req-c4c46d9e-99ec-478b-abfa-0284deee4364'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.721851 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614757b981d94bc99fa1a5b407e74693', 'request_id': 'req-c4c46d9e-99ec-478b-abfa-0284deee4364'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.733726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] The token cache is being invalidate because project 614757b981d94bc99fa1a5b407e74693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:41:54.734025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.734674 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.736202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1316/2597] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:41:54 2022] DELETE /identity/v3/projects/614757b981d94bc99fa1a5b407e74693 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:54.740559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ffbde-ed4d-4138-9ad6-345bfdf236c1 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:54.750742 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ffbde-ed4d-4138-9ad6-345bfdf236c1 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:54.812672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa1dfc-655d-4ac5-84ba-5265a617e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:54.813353 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa1dfc-655d-4ac5-84ba-5265a617e356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:54.813637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa1dfc-655d-4ac5-84ba-5265a617e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:54.813918 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa1dfc-655d-4ac5-84ba-5265a617e356 admin admin] PATH_INFO: `/v3/users/c7c5671dca344033a2f5984eb036f1c8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:54.815153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa1dfc-655d-4ac5-84ba-5265a617e356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c5671dca344033a2f5984eb036f1c8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:54.817096 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa1dfc-655d-4ac5-84ba-5265a617e356 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:54.836468 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:54.870203 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2baa1dfc-655d-4ac5-84ba-5265a617e356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c5671dca344033a2f5984eb036f1c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.878235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2baa1dfc-655d-4ac5-84ba-5265a617e356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c5671dca344033a2f5984eb036f1c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.891599 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2baa1dfc-655d-4ac5-84ba-5265a617e356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c5671dca344033a2f5984eb036f1c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.892335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2baa1dfc-655d-4ac5-84ba-5265a617e356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c5671dca344033a2f5984eb036f1c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.892971 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2baa1dfc-655d-4ac5-84ba-5265a617e356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c5671dca344033a2f5984eb036f1c8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:54.907156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1282/2598] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:41:54 2022] DELETE /identity/v3/users/c7c5671dca344033a2f5984eb036f1c8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:41:55.199225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:55.202774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:55.231831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c46d9e-99ec-478b-abfa-0284deee4364 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:55.240955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:55.291992 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82767df5-8a3e-44a8-b0de-9585cf8118d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:55.292631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767df5-8a3e-44a8-b0de-9585cf8118d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:55.292932 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767df5-8a3e-44a8-b0de-9585cf8118d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:55.293212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82767df5-8a3e-44a8-b0de-9585cf8118d6 admin admin] PATH_INFO: `/v3/projects/be6256a946da479c8831805532bbdb19` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:55.295134 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82767df5-8a3e-44a8-b0de-9585cf8118d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6256a946da479c8831805532bbdb19)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:55.297047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82767df5-8a3e-44a8-b0de-9585cf8118d6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:55.341385 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-82767df5-8a3e-44a8-b0de-9585cf8118d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6256a946da479c8831805532bbdb19', 'request_id': 'req-82767df5-8a3e-44a8-b0de-9585cf8118d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:55.346773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-82767df5-8a3e-44a8-b0de-9585cf8118d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6256a946da479c8831805532bbdb19', 'request_id': 'req-82767df5-8a3e-44a8-b0de-9585cf8118d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:55.353757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-82767df5-8a3e-44a8-b0de-9585cf8118d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6256a946da479c8831805532bbdb19', 'request_id': 'req-82767df5-8a3e-44a8-b0de-9585cf8118d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:55.365973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-82767df5-8a3e-44a8-b0de-9585cf8118d6 admin admin] The token cache is being invalidate because project be6256a946da479c8831805532bbdb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:41:55.366261 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-82767df5-8a3e-44a8-b0de-9585cf8118d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:55.366901 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-82767df5-8a3e-44a8-b0de-9585cf8118d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:55.368400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1317/2599] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:41:55 2022] DELETE /identity/v3/projects/be6256a946da479c8831805532bbdb19 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:55.373292 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1604f4-a4bd-4fad-8037-849975dd1c40 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:55.373800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1604f4-a4bd-4fad-8037-849975dd1c40 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:55.374371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1604f4-a4bd-4fad-8037-849975dd1c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:55.393532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1a1604f4-a4bd-4fad-8037-849975dd1c40 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:55.394725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1a1604f4-a4bd-4fad-8037-849975dd1c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:55.451982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1283/2600] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:55.460806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca0eba-b897-446f-970d-166926d4f907 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:55.461130 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca0eba-b897-446f-970d-166926d4f907 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:55.461409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca0eba-b897-446f-970d-166926d4f907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:55.482091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-03ca0eba-b897-446f-970d-166926d4f907 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:55.483336 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-03ca0eba-b897-446f-970d-166926d4f907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:55.491284 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1318/2601] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:55.495503 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1604f4-a4bd-4fad-8037-849975dd1c40 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:55.505487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1604f4-a4bd-4fad-8037-849975dd1c40 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:55.509903 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa0cc4-9678-42b2-b916-63699cc52cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:55.510499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa0cc4-9678-42b2-b916-63699cc52cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:55.510774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa0cc4-9678-42b2-b916-63699cc52cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:55.511043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa0cc4-9678-42b2-b916-63699cc52cf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:55.511724 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa0cc4-9678-42b2-b916-63699cc52cf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:41:55.512024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa0cc4-9678-42b2-b916-63699cc52cf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:55.514122 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa0cc4-9678-42b2-b916-63699cc52cf4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:55.525377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1284/2602] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:41:55.530377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca0eba-b897-446f-970d-166926d4f907 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:55.539483 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca0eba-b897-446f-970d-166926d4f907 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:55.544182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1f230-7e16-49ab-852c-c996ad5b50e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:55.544785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f230-7e16-49ab-852c-c996ad5b50e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:55.545177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f230-7e16-49ab-852c-c996ad5b50e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:55.545456 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1f230-7e16-49ab-852c-c996ad5b50e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:55.546120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1f230-7e16-49ab-852c-c996ad5b50e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:55.548020 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1f230-7e16-49ab-852c-c996ad5b50e9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:55.575842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1319/2603] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:41:55 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:55.580107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa0cc4-9678-42b2-b916-63699cc52cf4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:55.589849 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa0cc4-9678-42b2-b916-63699cc52cf4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:55.644859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1e44-b4ea-43aa-b33a-483dfbb93850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:55.645489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1e44-b4ea-43aa-b33a-483dfbb93850 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:55.645768 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1e44-b4ea-43aa-b33a-483dfbb93850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:55.646037 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1e44-b4ea-43aa-b33a-483dfbb93850 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:55.646692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb1e44-b4ea-43aa-b33a-483dfbb93850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:55.648561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb1e44-b4ea-43aa-b33a-483dfbb93850 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:55.669711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1285/2604] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:41:55 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:55.673945 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1f230-7e16-49ab-852c-c996ad5b50e9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:55.684142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1f230-7e16-49ab-852c-c996ad5b50e9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:55.688669 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90735624-36bb-4955-bf33-9417a3b9cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:55.689312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90735624-36bb-4955-bf33-9417a3b9cf5a admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:55.689595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90735624-36bb-4955-bf33-9417a3b9cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:55.689871 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90735624-36bb-4955-bf33-9417a3b9cf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:55.690567 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90735624-36bb-4955-bf33-9417a3b9cf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:55.692143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90735624-36bb-4955-bf33-9417a3b9cf5a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:55.702737 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1320/2605] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:55.706448 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1e44-b4ea-43aa-b33a-483dfbb93850 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:55.717246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1e44-b4ea-43aa-b33a-483dfbb93850 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:55.721804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4220f-a4d9-4932-a737-3bcb57e320ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:55.722401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4220f-a4d9-4932-a737-3bcb57e320ea admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:55.722679 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4220f-a4d9-4932-a737-3bcb57e320ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:55.722949 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4220f-a4d9-4932-a737-3bcb57e320ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:55.723631 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4220f-a4d9-4932-a737-3bcb57e320ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:55.725260 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4220f-a4d9-4932-a737-3bcb57e320ea admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:55.730376 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:55.736586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1286/2606] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:55.740197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90735624-36bb-4955-bf33-9417a3b9cf5a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:55.750537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90735624-36bb-4955-bf33-9417a3b9cf5a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:55.755416 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23331f-4e8e-42a1-9487-2969cfb400b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:55.756079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23331f-4e8e-42a1-9487-2969cfb400b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:55.756366 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23331f-4e8e-42a1-9487-2969cfb400b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:55.756643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23331f-4e8e-42a1-9487-2969cfb400b6 admin admin] PATH_INFO: `/v3/projects/1e2d0f6ce2f94c6786e47a5b5c71a396/users/57f121218edf4186a430bddb4c3169af/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:55.772051 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23331f-4e8e-42a1-9487-2969cfb400b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2d0f6ce2f94c6786e47a5b5c71a396, user_id=57f121218edf4186a430bddb4c3169af, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:55.774724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23331f-4e8e-42a1-9487-2969cfb400b6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:55.787829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1321/2607] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:41:55 2022] PUT /identity/v3/projects/1e2d0f6ce2f94c6786e47a5b5c71a396/users/57f121218edf4186a430bddb4c3169af/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:41:55.798369 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872fd12-032d-4aef-a02d-37db4ceac4e8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:55.798653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872fd12-032d-4aef-a02d-37db4ceac4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:55.798926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872fd12-032d-4aef-a02d-37db4ceac4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:55.826615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1872fd12-032d-4aef-a02d-37db4ceac4e8 None None] MFA Rules not processed for user `57f121218edf4186a430bddb4c3169af`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:55.827829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1872fd12-032d-4aef-a02d-37db4ceac4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:55.891415 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1287/2608] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:41:55.902610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23331f-4e8e-42a1-9487-2969cfb400b6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:55.904526 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7e23331f-4e8e-42a1-9487-2969cfb400b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:55.947288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:55.963389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23331f-4e8e-42a1-9487-2969cfb400b6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:55.967108 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44edac7-157d-4c33-a27e-de764116189e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:55.967756 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44edac7-157d-4c33-a27e-de764116189e service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:55.968044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44edac7-157d-4c33-a27e-de764116189e service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:55.968321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44edac7-157d-4c33-a27e-de764116189e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:55.980082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44edac7-157d-4c33-a27e-de764116189e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:55.981561 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44edac7-157d-4c33-a27e-de764116189e service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:55.990301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1322/2609] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:56.012324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872fd12-032d-4aef-a02d-37db4ceac4e8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:56.074539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872fd12-032d-4aef-a02d-37db4ceac4e8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:56.079195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:56.079840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:56.080124 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:56.080403 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] PATH_INFO: `/v3/users/57f121218edf4186a430bddb4c3169af` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:56.081655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] RBAC: Authorizing `identity:delete_user(user_id=57f121218edf4186a430bddb4c3169af)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:56.083605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:56.131162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57f121218edf4186a430bddb4c3169af'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:56.138763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57f121218edf4186a430bddb4c3169af'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:56.150242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57f121218edf4186a430bddb4c3169af'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:56.150926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57f121218edf4186a430bddb4c3169af'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:56.151539 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57f121218edf4186a430bddb4c3169af'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:56.164888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1288/2610] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:41:56 2022] DELETE /identity/v3/users/57f121218edf4186a430bddb4c3169af => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:56.170259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac14ed-9c5d-4875-8be2-a6a4a8c50408 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:56.170554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac14ed-9c5d-4875-8be2-a6a4a8c50408 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:56.170836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac14ed-9c5d-4875-8be2-a6a4a8c50408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:56.190114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-31ac14ed-9c5d-4875-8be2-a6a4a8c50408 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:56.191318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-31ac14ed-9c5d-4875-8be2-a6a4a8c50408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:56.252706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1323/2611] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:56.263226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:56.264678 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:56.275395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:56.326194 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158a308-2b8e-432e-9940-92f09974abde admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:56.329866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba00cfd-99ea-4e9f-b878-79525785e4ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:56.330495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba00cfd-99ea-4e9f-b878-79525785e4ef service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:56.330778 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba00cfd-99ea-4e9f-b878-79525785e4ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:56.331053 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba00cfd-99ea-4e9f-b878-79525785e4ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:56.340302 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba00cfd-99ea-4e9f-b878-79525785e4ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:56.342384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba00cfd-99ea-4e9f-b878-79525785e4ef service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:56.351805 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1289/2612] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:41:56.670067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac14ed-9c5d-4875-8be2-a6a4a8c50408 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:56.671601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-31ac14ed-9c5d-4875-8be2-a6a4a8c50408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:56.685241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac14ed-9c5d-4875-8be2-a6a4a8c50408 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:56.690082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8e0e3-19cd-486b-bbed-59a3e18430df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:56.690954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8e0e3-19cd-486b-bbed-59a3e18430df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:56.691239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8e0e3-19cd-486b-bbed-59a3e18430df admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:56.691514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8e0e3-19cd-486b-bbed-59a3e18430df admin admin] PATH_INFO: `/v3/projects/1e2d0f6ce2f94c6786e47a5b5c71a396` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:56.693399 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8e0e3-19cd-486b-bbed-59a3e18430df admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2d0f6ce2f94c6786e47a5b5c71a396)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:56.695306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8e0e3-19cd-486b-bbed-59a3e18430df admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:56.742601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fec8e0e3-19cd-486b-bbed-59a3e18430df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2d0f6ce2f94c6786e47a5b5c71a396', 'request_id': 'req-fec8e0e3-19cd-486b-bbed-59a3e18430df'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:56.749219 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fec8e0e3-19cd-486b-bbed-59a3e18430df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2d0f6ce2f94c6786e47a5b5c71a396', 'request_id': 'req-fec8e0e3-19cd-486b-bbed-59a3e18430df'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:56.757624 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fec8e0e3-19cd-486b-bbed-59a3e18430df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2d0f6ce2f94c6786e47a5b5c71a396', 'request_id': 'req-fec8e0e3-19cd-486b-bbed-59a3e18430df'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:56.769668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fec8e0e3-19cd-486b-bbed-59a3e18430df admin admin] The token cache is being invalidate because project 1e2d0f6ce2f94c6786e47a5b5c71a396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:41:56.769959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fec8e0e3-19cd-486b-bbed-59a3e18430df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:56.770584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fec8e0e3-19cd-486b-bbed-59a3e18430df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:41:56.772107 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1324/2613] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:41:56 2022] DELETE /identity/v3/projects/1e2d0f6ce2f94c6786e47a5b5c71a396 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:56.777146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d671d6-fdb4-4ac9-9070-a4b0d834bece None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:56.777618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d671d6-fdb4-4ac9-9070-a4b0d834bece None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:56.777714 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d671d6-fdb4-4ac9-9070-a4b0d834bece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:56.797892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b9d671d6-fdb4-4ac9-9070-a4b0d834bece None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:56.799105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b9d671d6-fdb4-4ac9-9070-a4b0d834bece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:56.861262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1290/2614] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:56.869225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d480b-280b-4e7d-8bd7-3b71c9c19230 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:56.869614 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d480b-280b-4e7d-8bd7-3b71c9c19230 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:56.869902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d480b-280b-4e7d-8bd7-3b71c9c19230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:56.891587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e56d480b-280b-4e7d-8bd7-3b71c9c19230 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:56.892871 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e56d480b-280b-4e7d-8bd7-3b71c9c19230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:56.901072 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1325/2615] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:56.905882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d671d6-fdb4-4ac9-9070-a4b0d834bece None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:56.915452 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d671d6-fdb4-4ac9-9070-a4b0d834bece None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:56.920763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8824b1-b56e-487c-b89c-54d5a2c597a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:56.921398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8824b1-b56e-487c-b89c-54d5a2c597a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:56.921682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8824b1-b56e-487c-b89c-54d5a2c597a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:56.921956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8824b1-b56e-487c-b89c-54d5a2c597a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:56.922654 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8824b1-b56e-487c-b89c-54d5a2c597a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:41:56.922960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8824b1-b56e-487c-b89c-54d5a2c597a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:56.924547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8824b1-b56e-487c-b89c-54d5a2c597a6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:56.936285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1291/2616] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:41:56.941794 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d480b-280b-4e7d-8bd7-3b71c9c19230 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:56.951140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d480b-280b-4e7d-8bd7-3b71c9c19230 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:56.955717 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15890a7-a1e7-4419-ae67-139b8f842bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:56.956317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15890a7-a1e7-4419-ae67-139b8f842bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:56.956597 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15890a7-a1e7-4419-ae67-139b8f842bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:56.956874 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15890a7-a1e7-4419-ae67-139b8f842bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:56.957568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15890a7-a1e7-4419-ae67-139b8f842bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:56.959437 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15890a7-a1e7-4419-ae67-139b8f842bb8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:56.991187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1326/2617] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:41:56 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:56.992483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8824b1-b56e-487c-b89c-54d5a2c597a6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:57.002570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8824b1-b56e-487c-b89c-54d5a2c597a6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:57.057491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9928f-b664-4ffa-bb63-04afad16c2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:57.058224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9928f-b664-4ffa-bb63-04afad16c2fa admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:57.058510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9928f-b664-4ffa-bb63-04afad16c2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:57.058785 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9928f-b664-4ffa-bb63-04afad16c2fa admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:57.059699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9928f-b664-4ffa-bb63-04afad16c2fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:57.061653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9928f-b664-4ffa-bb63-04afad16c2fa admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:57.083077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1292/2618] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:41:56 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:41:57.087209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15890a7-a1e7-4419-ae67-139b8f842bb8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:57.097494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15890a7-a1e7-4419-ae67-139b8f842bb8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:57.102033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368a07b-e876-4ae7-823e-d9a3b1abb623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:57.102631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368a07b-e876-4ae7-823e-d9a3b1abb623 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:57.102910 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368a07b-e876-4ae7-823e-d9a3b1abb623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:57.103182 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368a07b-e876-4ae7-823e-d9a3b1abb623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:57.103879 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368a07b-e876-4ae7-823e-d9a3b1abb623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:57.105480 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368a07b-e876-4ae7-823e-d9a3b1abb623 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:57.115661 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1327/2619] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:57.119468 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9928f-b664-4ffa-bb63-04afad16c2fa admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:57.130110 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9928f-b664-4ffa-bb63-04afad16c2fa admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:57.134765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cfd4a-fdac-4f05-a9fc-cc3f8bdf68e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:57.135365 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cfd4a-fdac-4f05-a9fc-cc3f8bdf68e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:57.135632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cfd4a-fdac-4f05-a9fc-cc3f8bdf68e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:57.135904 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cfd4a-fdac-4f05-a9fc-cc3f8bdf68e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:57.136586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cfd4a-fdac-4f05-a9fc-cc3f8bdf68e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:57.138218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cfd4a-fdac-4f05-a9fc-cc3f8bdf68e2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:57.148398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1293/2620] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:41:57.152269 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368a07b-e876-4ae7-823e-d9a3b1abb623 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:57.162250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368a07b-e876-4ae7-823e-d9a3b1abb623 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:57.166961 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14499a3d-c9cb-437c-93d0-48bb8023797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:57.167609 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14499a3d-c9cb-437c-93d0-48bb8023797d admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:57.167891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14499a3d-c9cb-437c-93d0-48bb8023797d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:57.168165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14499a3d-c9cb-437c-93d0-48bb8023797d admin admin] PATH_INFO: `/v3/projects/9ec1ae14eda04cf282fde29bf768f2b4/users/5014a0883b4746aea562dd20adf763d4/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:57.183529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14499a3d-c9cb-437c-93d0-48bb8023797d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec1ae14eda04cf282fde29bf768f2b4, user_id=5014a0883b4746aea562dd20adf763d4, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:57.186740 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14499a3d-c9cb-437c-93d0-48bb8023797d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:57.198838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1328/2621] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:41:57 2022] PUT /identity/v3/projects/9ec1ae14eda04cf282fde29bf768f2b4/users/5014a0883b4746aea562dd20adf763d4/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:41:57.210011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6795d-a507-425e-81cd-028c0535613f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:57.210313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6795d-a507-425e-81cd-028c0535613f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:57.210583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6795d-a507-425e-81cd-028c0535613f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:57.237713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-36a6795d-a507-425e-81cd-028c0535613f None None] MFA Rules not processed for user `5014a0883b4746aea562dd20adf763d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:41:57.238905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-36a6795d-a507-425e-81cd-028c0535613f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:57.243754 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:57.302454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1294/2622] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:41:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:41:57.315099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14499a3d-c9cb-437c-93d0-48bb8023797d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:41:57.316841 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-14499a3d-c9cb-437c-93d0-48bb8023797d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:41:57.322316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:41:57.383436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14499a3d-c9cb-437c-93d0-48bb8023797d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:41:57.388330 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36667ed8-8b03-4275-a69b-26fb403b483f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da39170a654d4d52a39b4b2c8cfd8906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:41:57.388995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36667ed8-8b03-4275-a69b-26fb403b483f service glance] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:41:57.389283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36667ed8-8b03-4275-a69b-26fb403b483f service glance] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:41:57.389562 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36667ed8-8b03-4275-a69b-26fb403b483f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:41:57.398686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36667ed8-8b03-4275-a69b-26fb403b483f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:41:57.400112 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36667ed8-8b03-4275-a69b-26fb403b483f service glance] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:41:57.409863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1329/2623] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:41:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:04.198092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6795d-a507-425e-81cd-028c0535613f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:04.199530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-36a6795d-a507-425e-81cd-028c0535613f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:04.265486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6795d-a507-425e-81cd-028c0535613f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:04.269072 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da59944-a606-4d83-8b3f-7b452b80738a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:04.269690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da59944-a606-4d83-8b3f-7b452b80738a service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:04.269968 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da59944-a606-4d83-8b3f-7b452b80738a service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:04.270235 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da59944-a606-4d83-8b3f-7b452b80738a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:04.271995 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3da59944-a606-4d83-8b3f-7b452b80738a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:04.337331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da59944-a606-4d83-8b3f-7b452b80738a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:04.338763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da59944-a606-4d83-8b3f-7b452b80738a service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:04.348261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1295/2624] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:07.405866 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=25 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:07.557369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36667ed8-8b03-4275-a69b-26fb403b483f service glance] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:07.558964 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-36667ed8-8b03-4275-a69b-26fb403b483f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:07.630839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da59944-a606-4d83-8b3f-7b452b80738a service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:07.632360 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3da59944-a606-4d83-8b3f-7b452b80738a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:07.648782 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da59944-a606-4d83-8b3f-7b452b80738a service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:07.661620 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d4fe1-a0c5-4b0a-8eae-f83456e19750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:07.662388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4fe1-a0c5-4b0a-8eae-f83456e19750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:07.662739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4fe1-a0c5-4b0a-8eae-f83456e19750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:07.663024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4fe1-a0c5-4b0a-8eae-f83456e19750 admin admin] PATH_INFO: `/v3/users/e9f545fde2d94e03b9b8336f53122177` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:07.664288 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d4fe1-a0c5-4b0a-8eae-f83456e19750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f545fde2d94e03b9b8336f53122177)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:07.665276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36667ed8-8b03-4275-a69b-26fb403b483f service glance] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:07.666327 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d4fe1-a0c5-4b0a-8eae-f83456e19750 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:07.670982 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8353b-b7e0-493a-a46b-ae95f5bd5a86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:07.671563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8353b-b7e0-493a-a46b-ae95f5bd5a86 service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:07.671899 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8353b-b7e0-493a-a46b-ae95f5bd5a86 service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:07.672114 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8353b-b7e0-493a-a46b-ae95f5bd5a86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:07.674521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-15e8353b-b7e0-493a-a46b-ae95f5bd5a86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:07.692494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8353b-b7e0-493a-a46b-ae95f5bd5a86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:07.694251 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8353b-b7e0-493a-a46b-ae95f5bd5a86 service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:07.707555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1330/2625] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:07.729607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7e2d4fe1-a0c5-4b0a-8eae-f83456e19750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f545fde2d94e03b9b8336f53122177'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:07.737565 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:07.740191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7e2d4fe1-a0c5-4b0a-8eae-f83456e19750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f545fde2d94e03b9b8336f53122177'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:07.754127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7e2d4fe1-a0c5-4b0a-8eae-f83456e19750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f545fde2d94e03b9b8336f53122177'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:07.754853 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7e2d4fe1-a0c5-4b0a-8eae-f83456e19750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f545fde2d94e03b9b8336f53122177'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:07.755486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7e2d4fe1-a0c5-4b0a-8eae-f83456e19750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f545fde2d94e03b9b8336f53122177'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:07.768959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1296/2626] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:07 2022] DELETE /identity/v3/users/e9f545fde2d94e03b9b8336f53122177 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:07.944768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8353b-b7e0-493a-a46b-ae95f5bd5a86 service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:07.956170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8353b-b7e0-493a-a46b-ae95f5bd5a86 service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:08.026442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:08.026993 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:08.027278 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:08.027553 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931 admin admin] PATH_INFO: `/v3/projects/41e0d82a38794d39a612eac6afda5007` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:08.028710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e0d82a38794d39a612eac6afda5007)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:08.030735 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:08.084132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e0d82a38794d39a612eac6afda5007', 'request_id': 'req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:08.089672 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e0d82a38794d39a612eac6afda5007', 'request_id': 'req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:08.097335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e0d82a38794d39a612eac6afda5007', 'request_id': 'req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:08.108759 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931 admin admin] The token cache is being invalidate because project 41e0d82a38794d39a612eac6afda5007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:08.109077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:08.109713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f532a60a-598d-4cdc-91b3-3cc6d0d6d931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:08.111232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1331/2627] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:07 2022] DELETE /identity/v3/projects/41e0d82a38794d39a612eac6afda5007 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:08.116152 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380deea6-d4ed-4a77-b074-291488494f73 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:08.116441 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380deea6-d4ed-4a77-b074-291488494f73 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:08.116722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380deea6-d4ed-4a77-b074-291488494f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:08.136959 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-380deea6-d4ed-4a77-b074-291488494f73 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:08.138171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-380deea6-d4ed-4a77-b074-291488494f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:08.197793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1297/2628] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:08.207160 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2244bd2-9c90-44cf-9205-5ab584fb0b80 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:08.207503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2244bd2-9c90-44cf-9205-5ab584fb0b80 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:08.207731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2244bd2-9c90-44cf-9205-5ab584fb0b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:08.228042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a2244bd2-9c90-44cf-9205-5ab584fb0b80 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:08.229028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a2244bd2-9c90-44cf-9205-5ab584fb0b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:08.238128 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1332/2629] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:08.242027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380deea6-d4ed-4a77-b074-291488494f73 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:08.252958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380deea6-d4ed-4a77-b074-291488494f73 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:08.257817 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc4126-f2fd-4d11-8022-6dd553a00447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:08.258432 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc4126-f2fd-4d11-8022-6dd553a00447 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:08.258713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc4126-f2fd-4d11-8022-6dd553a00447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:08.258990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc4126-f2fd-4d11-8022-6dd553a00447 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:08.259689 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc4126-f2fd-4d11-8022-6dd553a00447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:42:08.259996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc4126-f2fd-4d11-8022-6dd553a00447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:08.261622 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc4126-f2fd-4d11-8022-6dd553a00447 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:08.278168 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1298/2630] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:42:08.283421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2244bd2-9c90-44cf-9205-5ab584fb0b80 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:08.293125 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2244bd2-9c90-44cf-9205-5ab584fb0b80 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:08.298749 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9fbeb-03bd-49cc-8ea5-1aef86b463dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:08.299686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9fbeb-03bd-49cc-8ea5-1aef86b463dd admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:08.299971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9fbeb-03bd-49cc-8ea5-1aef86b463dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:08.300293 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9fbeb-03bd-49cc-8ea5-1aef86b463dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:08.300965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9fbeb-03bd-49cc-8ea5-1aef86b463dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:08.302845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9fbeb-03bd-49cc-8ea5-1aef86b463dd admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:08.315261 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:08.334133 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1333/2631] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:08 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:42:08.338210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc4126-f2fd-4d11-8022-6dd553a00447 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:08.348470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc4126-f2fd-4d11-8022-6dd553a00447 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:08.412373 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee63c6-e2d2-4c09-8e7e-c57f65d1e638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:08.413147 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee63c6-e2d2-4c09-8e7e-c57f65d1e638 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:08.413501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee63c6-e2d2-4c09-8e7e-c57f65d1e638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:08.413844 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee63c6-e2d2-4c09-8e7e-c57f65d1e638 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:08.414579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee63c6-e2d2-4c09-8e7e-c57f65d1e638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:08.416528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee63c6-e2d2-4c09-8e7e-c57f65d1e638 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:08.439273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1299/2632] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:08 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:42:08.448011 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9fbeb-03bd-49cc-8ea5-1aef86b463dd admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:08.458376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9fbeb-03bd-49cc-8ea5-1aef86b463dd admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:08.462927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a19595-314b-4f21-ad93-7dd8ac77f5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:08.463525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19595-314b-4f21-ad93-7dd8ac77f5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:08.463805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19595-314b-4f21-ad93-7dd8ac77f5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:08.464075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19595-314b-4f21-ad93-7dd8ac77f5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:08.464763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a19595-314b-4f21-ad93-7dd8ac77f5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:08.466365 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a19595-314b-4f21-ad93-7dd8ac77f5aa admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:08.476831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1334/2633] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:08.480792 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee63c6-e2d2-4c09-8e7e-c57f65d1e638 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:08.491823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee63c6-e2d2-4c09-8e7e-c57f65d1e638 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:08.496478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50864a-b540-4658-846e-fe85f0820c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:08.497122 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50864a-b540-4658-846e-fe85f0820c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:08.497408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50864a-b540-4658-846e-fe85f0820c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:08.497683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50864a-b540-4658-846e-fe85f0820c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:08.499003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50864a-b540-4658-846e-fe85f0820c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:08.500789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50864a-b540-4658-846e-fe85f0820c3a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:08.511453 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1300/2634] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:08.516429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a19595-314b-4f21-ad93-7dd8ac77f5aa admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:08.526427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a19595-314b-4f21-ad93-7dd8ac77f5aa admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:08.531693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03468f9-da9f-4621-a6f4-e4dfb45b4759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:08.532344 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03468f9-da9f-4621-a6f4-e4dfb45b4759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:08.532627 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03468f9-da9f-4621-a6f4-e4dfb45b4759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:08.532927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03468f9-da9f-4621-a6f4-e4dfb45b4759 admin admin] PATH_INFO: `/v3/projects/4375b5eef5a24ce885fbd88bc4a82112/users/a20b6d00abf64cffa8e5011265e3f046/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:08.547807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03468f9-da9f-4621-a6f4-e4dfb45b4759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4375b5eef5a24ce885fbd88bc4a82112, user_id=a20b6d00abf64cffa8e5011265e3f046, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:08.550447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03468f9-da9f-4621-a6f4-e4dfb45b4759 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:08.563455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1335/2635] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:08 2022] PUT /identity/v3/projects/4375b5eef5a24ce885fbd88bc4a82112/users/a20b6d00abf64cffa8e5011265e3f046/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:08.573761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931428c1-df09-455f-909f-d37000c1c1eb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:08.574050 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931428c1-df09-455f-909f-d37000c1c1eb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:08.574382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931428c1-df09-455f-909f-d37000c1c1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:08.602305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-931428c1-df09-455f-909f-d37000c1c1eb None None] MFA Rules not processed for user `a20b6d00abf64cffa8e5011265e3f046`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:08.603517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-931428c1-df09-455f-909f-d37000c1c1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:08.628111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:08.669133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1301/2636] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:08.681430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03468f9-da9f-4621-a6f4-e4dfb45b4759 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:08.683075 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a03468f9-da9f-4621-a6f4-e4dfb45b4759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:08.755777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03468f9-da9f-4621-a6f4-e4dfb45b4759 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:08.761309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6b014-a25d-4a8c-a27a-b05ee72d621e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:08.761922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6b014-a25d-4a8c-a27a-b05ee72d621e service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:08.762202 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6b014-a25d-4a8c-a27a-b05ee72d621e service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:08.762475 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6b014-a25d-4a8c-a27a-b05ee72d621e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:08.771327 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6b014-a25d-4a8c-a27a-b05ee72d621e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:08.772894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6b014-a25d-4a8c-a27a-b05ee72d621e service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:08.782780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1336/2637] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:08.983461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931428c1-df09-455f-909f-d37000c1c1eb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:09.045626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931428c1-df09-455f-909f-d37000c1c1eb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:09.050108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:09.050748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:09.051033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:09.051311 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] PATH_INFO: `/v3/users/a20b6d00abf64cffa8e5011265e3f046` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:09.052462 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20b6d00abf64cffa8e5011265e3f046)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:09.054385 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:09.100183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20b6d00abf64cffa8e5011265e3f046'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:09.106925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20b6d00abf64cffa8e5011265e3f046'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:09.118991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20b6d00abf64cffa8e5011265e3f046'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:09.119648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20b6d00abf64cffa8e5011265e3f046'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:09.120241 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20b6d00abf64cffa8e5011265e3f046'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:09.133499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1302/2638] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:08 2022] DELETE /identity/v3/users/a20b6d00abf64cffa8e5011265e3f046 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:09.137939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11e5fa-a3ae-4e58-a5e7-0fcbfc9b5761 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:09.138232 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11e5fa-a3ae-4e58-a5e7-0fcbfc9b5761 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:09.138538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11e5fa-a3ae-4e58-a5e7-0fcbfc9b5761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:09.157245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4d11e5fa-a3ae-4e58-a5e7-0fcbfc9b5761 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:09.158442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4d11e5fa-a3ae-4e58-a5e7-0fcbfc9b5761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:09.217759 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1337/2639] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:09.228084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:09.229501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:09.276370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:09.288719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaee12c-4ef0-45c3-9941-916e078fe566 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:09.292621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92e218-65cc-4a41-989d-da8754291e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:09.293298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92e218-65cc-4a41-989d-da8754291e79 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:09.293582 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92e218-65cc-4a41-989d-da8754291e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:09.293859 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92e218-65cc-4a41-989d-da8754291e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:09.303543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92e218-65cc-4a41-989d-da8754291e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:09.304985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92e218-65cc-4a41-989d-da8754291e79 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:09.314935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1303/2640] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:09.588298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11e5fa-a3ae-4e58-a5e7-0fcbfc9b5761 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:09.590178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4d11e5fa-a3ae-4e58-a5e7-0fcbfc9b5761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:09.602362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11e5fa-a3ae-4e58-a5e7-0fcbfc9b5761 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:09.607121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1644a67-03d3-4596-9ce7-35742f676df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:09.607984 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644a67-03d3-4596-9ce7-35742f676df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:09.608321 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644a67-03d3-4596-9ce7-35742f676df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:09.608602 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644a67-03d3-4596-9ce7-35742f676df7 admin admin] PATH_INFO: `/v3/projects/4375b5eef5a24ce885fbd88bc4a82112` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:09.609816 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1644a67-03d3-4596-9ce7-35742f676df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4375b5eef5a24ce885fbd88bc4a82112)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:09.611724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1644a67-03d3-4596-9ce7-35742f676df7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:09.652138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:09.662997 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e1644a67-03d3-4596-9ce7-35742f676df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4375b5eef5a24ce885fbd88bc4a82112', 'request_id': 'req-e1644a67-03d3-4596-9ce7-35742f676df7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:09.668587 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e1644a67-03d3-4596-9ce7-35742f676df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4375b5eef5a24ce885fbd88bc4a82112', 'request_id': 'req-e1644a67-03d3-4596-9ce7-35742f676df7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:09.677004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e1644a67-03d3-4596-9ce7-35742f676df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4375b5eef5a24ce885fbd88bc4a82112', 'request_id': 'req-e1644a67-03d3-4596-9ce7-35742f676df7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:09.689569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e1644a67-03d3-4596-9ce7-35742f676df7 admin admin] The token cache is being invalidate because project 4375b5eef5a24ce885fbd88bc4a82112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:09.689862 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e1644a67-03d3-4596-9ce7-35742f676df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:09.690507 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e1644a67-03d3-4596-9ce7-35742f676df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:09.692064 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1338/2641] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:09 2022] DELETE /identity/v3/projects/4375b5eef5a24ce885fbd88bc4a82112 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:09.697314 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f83dc-4d1d-4832-843e-b166d42985e9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:09.697800 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f83dc-4d1d-4832-843e-b166d42985e9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:09.697954 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f83dc-4d1d-4832-843e-b166d42985e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:09.717615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-df4f83dc-4d1d-4832-843e-b166d42985e9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:09.718812 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-df4f83dc-4d1d-4832-843e-b166d42985e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:09.781114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1304/2642] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:09.789065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bb8d1-6ebb-4aeb-ac1e-46b36fb87f4b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:09.789381 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bb8d1-6ebb-4aeb-ac1e-46b36fb87f4b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:09.789657 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bb8d1-6ebb-4aeb-ac1e-46b36fb87f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:09.809717 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-315bb8d1-6ebb-4aeb-ac1e-46b36fb87f4b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:09.811623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-315bb8d1-6ebb-4aeb-ac1e-46b36fb87f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:09.819350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1339/2643] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:09.823377 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f83dc-4d1d-4832-843e-b166d42985e9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:09.832835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f83dc-4d1d-4832-843e-b166d42985e9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:09.837315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3a1d7-2822-46fa-a0ee-dc186b96077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:09.837911 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3a1d7-2822-46fa-a0ee-dc186b96077b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:09.838191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3a1d7-2822-46fa-a0ee-dc186b96077b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:09.838464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3a1d7-2822-46fa-a0ee-dc186b96077b admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:09.839153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3a1d7-2822-46fa-a0ee-dc186b96077b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:42:09.839456 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3a1d7-2822-46fa-a0ee-dc186b96077b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:09.841089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3a1d7-2822-46fa-a0ee-dc186b96077b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:09.852257 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1305/2644] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:42:09.856409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bb8d1-6ebb-4aeb-ac1e-46b36fb87f4b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:09.866210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bb8d1-6ebb-4aeb-ac1e-46b36fb87f4b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:09.870920 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2193bbd-fba4-4f44-8fa7-77b8ee1b0d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:09.871524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2193bbd-fba4-4f44-8fa7-77b8ee1b0d25 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:09.871811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2193bbd-fba4-4f44-8fa7-77b8ee1b0d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:09.872089 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2193bbd-fba4-4f44-8fa7-77b8ee1b0d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:09.872758 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2193bbd-fba4-4f44-8fa7-77b8ee1b0d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:09.875343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2193bbd-fba4-4f44-8fa7-77b8ee1b0d25 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:09.904940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1340/2645] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:09 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:09.909053 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3a1d7-2822-46fa-a0ee-dc186b96077b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:09.918820 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3a1d7-2822-46fa-a0ee-dc186b96077b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:09.974400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9ce19-5d61-4db2-8de6-2a86d2dfd7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:09.975006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9ce19-5d61-4db2-8de6-2a86d2dfd7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:09.975289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9ce19-5d61-4db2-8de6-2a86d2dfd7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:09.975563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9ce19-5d61-4db2-8de6-2a86d2dfd7e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:09.976227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9ce19-5d61-4db2-8de6-2a86d2dfd7e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:09.978217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9ce19-5d61-4db2-8de6-2a86d2dfd7e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:10.000422 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1306/2646] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:09 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:42:10.005091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2193bbd-fba4-4f44-8fa7-77b8ee1b0d25 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:10.015445 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2193bbd-fba4-4f44-8fa7-77b8ee1b0d25 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:10.020096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536c026-409c-49b7-ae14-fd9391359573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:10.020721 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536c026-409c-49b7-ae14-fd9391359573 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:10.021022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536c026-409c-49b7-ae14-fd9391359573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:10.021334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536c026-409c-49b7-ae14-fd9391359573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:10.022066 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536c026-409c-49b7-ae14-fd9391359573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:10.023657 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536c026-409c-49b7-ae14-fd9391359573 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:10.033384 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1341/2647] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:10.037596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9ce19-5d61-4db2-8de6-2a86d2dfd7e1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:10.048004 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9ce19-5d61-4db2-8de6-2a86d2dfd7e1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:10.052532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeffd49-c675-4f24-aa05-e33d10421c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:10.053167 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeffd49-c675-4f24-aa05-e33d10421c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:10.053450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeffd49-c675-4f24-aa05-e33d10421c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:10.053725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeffd49-c675-4f24-aa05-e33d10421c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:10.054410 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeffd49-c675-4f24-aa05-e33d10421c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:10.055992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeffd49-c675-4f24-aa05-e33d10421c3c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:10.068524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1307/2648] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:42:10.073116 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536c026-409c-49b7-ae14-fd9391359573 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:10.083324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536c026-409c-49b7-ae14-fd9391359573 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:10.088264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20957df-b1c8-46e8-85cb-d1b24de0b25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:10.088958 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20957df-b1c8-46e8-85cb-d1b24de0b25b admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:10.089248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20957df-b1c8-46e8-85cb-d1b24de0b25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:10.089529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20957df-b1c8-46e8-85cb-d1b24de0b25b admin admin] PATH_INFO: `/v3/projects/b016755264a74130aa4a2678704a3a59/users/0e71d11d57fb4f0295e80244a5f3e3a7/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:10.104503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20957df-b1c8-46e8-85cb-d1b24de0b25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b016755264a74130aa4a2678704a3a59, user_id=0e71d11d57fb4f0295e80244a5f3e3a7, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:10.107170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20957df-b1c8-46e8-85cb-d1b24de0b25b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:10.121355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1342/2649] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:10 2022] PUT /identity/v3/projects/b016755264a74130aa4a2678704a3a59/users/0e71d11d57fb4f0295e80244a5f3e3a7/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:10.133699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e587c8-32e9-45ff-a52d-cc1651d16277 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:10.134005 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e587c8-32e9-45ff-a52d-cc1651d16277 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:10.134280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e587c8-32e9-45ff-a52d-cc1651d16277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:10.162267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-08e587c8-32e9-45ff-a52d-cc1651d16277 None None] MFA Rules not processed for user `0e71d11d57fb4f0295e80244a5f3e3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:10.163467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-08e587c8-32e9-45ff-a52d-cc1651d16277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:10.205410 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:10.229192 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1308/2650] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:10.234179 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20957df-b1c8-46e8-85cb-d1b24de0b25b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:10.296214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20957df-b1c8-46e8-85cb-d1b24de0b25b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:10.300931 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152ab68-4612-4ad5-a9dc-2e854bd14df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:10.301611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152ab68-4612-4ad5-a9dc-2e854bd14df5 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:10.301852 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152ab68-4612-4ad5-a9dc-2e854bd14df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:10.302139 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152ab68-4612-4ad5-a9dc-2e854bd14df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:10.302812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152ab68-4612-4ad5-a9dc-2e854bd14df5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:10.304697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152ab68-4612-4ad5-a9dc-2e854bd14df5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:10.332115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1343/2651] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:10 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:10.336082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e587c8-32e9-45ff-a52d-cc1651d16277 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:10.347101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e587c8-32e9-45ff-a52d-cc1651d16277 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:10.404089 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea060bd-0dd5-4599-85f0-770e7c873dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:10.404838 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea060bd-0dd5-4599-85f0-770e7c873dcc admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:10.405145 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea060bd-0dd5-4599-85f0-770e7c873dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:10.405418 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea060bd-0dd5-4599-85f0-770e7c873dcc admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:10.406076 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea060bd-0dd5-4599-85f0-770e7c873dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:10.407952 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea060bd-0dd5-4599-85f0-770e7c873dcc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:10.428730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1309/2652] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:10 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:10.432845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152ab68-4612-4ad5-a9dc-2e854bd14df5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:10.443684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152ab68-4612-4ad5-a9dc-2e854bd14df5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:10.448396 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364b7cf-24cf-4e61-b714-bdf17598f568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:10.449040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364b7cf-24cf-4e61-b714-bdf17598f568 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:10.449355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364b7cf-24cf-4e61-b714-bdf17598f568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:10.449636 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364b7cf-24cf-4e61-b714-bdf17598f568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:10.450335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364b7cf-24cf-4e61-b714-bdf17598f568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:10.452655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364b7cf-24cf-4e61-b714-bdf17598f568 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:10.463949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1344/2653] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:10.468623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea060bd-0dd5-4599-85f0-770e7c873dcc admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:10.478396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea060bd-0dd5-4599-85f0-770e7c873dcc admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:10.483513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf816dd-83c6-4103-94cf-05a10fc9e019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:10.484495 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf816dd-83c6-4103-94cf-05a10fc9e019 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:10.484887 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf816dd-83c6-4103-94cf-05a10fc9e019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:10.485194 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf816dd-83c6-4103-94cf-05a10fc9e019 admin admin] PATH_INFO: `/v3/projects/380e6bb3eee048ccbe3cba34e64a8803/users/f0d0db76d281419f8eb62b108a96cbe3/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:10.499829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf816dd-83c6-4103-94cf-05a10fc9e019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380e6bb3eee048ccbe3cba34e64a8803, user_id=f0d0db76d281419f8eb62b108a96cbe3, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:10.502463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf816dd-83c6-4103-94cf-05a10fc9e019 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:10.517350 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1310/2654] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:10 2022] PUT /identity/v3/projects/380e6bb3eee048ccbe3cba34e64a8803/users/f0d0db76d281419f8eb62b108a96cbe3/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:10.521357 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364b7cf-24cf-4e61-b714-bdf17598f568 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:10.532222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364b7cf-24cf-4e61-b714-bdf17598f568 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:10.565954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:10.591653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb89636-1999-41ca-9a7d-83eec84772d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:10.592323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb89636-1999-41ca-9a7d-83eec84772d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:10.592576 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb89636-1999-41ca-9a7d-83eec84772d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:10.592850 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb89636-1999-41ca-9a7d-83eec84772d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:10.593612 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb89636-1999-41ca-9a7d-83eec84772d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:10.595200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb89636-1999-41ca-9a7d-83eec84772d6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:10.605052 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1345/2655] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:10.609919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf816dd-83c6-4103-94cf-05a10fc9e019 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:10.620006 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf816dd-83c6-4103-94cf-05a10fc9e019 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:10.625459 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343969c-84d6-406e-a279-5d64d1f9bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:10.626116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343969c-84d6-406e-a279-5d64d1f9bb06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:10.626401 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343969c-84d6-406e-a279-5d64d1f9bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:10.626682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343969c-84d6-406e-a279-5d64d1f9bb06 admin admin] PATH_INFO: `/v3/projects/380e6bb3eee048ccbe3cba34e64a8803/users/f0d0db76d281419f8eb62b108a96cbe3/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:10.628894 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343969c-84d6-406e-a279-5d64d1f9bb06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380e6bb3eee048ccbe3cba34e64a8803, user_id=f0d0db76d281419f8eb62b108a96cbe3, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:10.631516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343969c-84d6-406e-a279-5d64d1f9bb06 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:10.641985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1311/2656] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:10 2022] PUT /identity/v3/projects/380e6bb3eee048ccbe3cba34e64a8803/users/f0d0db76d281419f8eb62b108a96cbe3/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:10.651937 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2297d-d8e9-42d2-a442-086f00289983 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:10.652223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2297d-d8e9-42d2-a442-086f00289983 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:10.652506 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2297d-d8e9-42d2-a442-086f00289983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:10.680405 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-49f2297d-d8e9-42d2-a442-086f00289983 None None] MFA Rules not processed for user `f0d0db76d281419f8eb62b108a96cbe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:10.681642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-49f2297d-d8e9-42d2-a442-086f00289983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:10.748093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1346/2657] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:10.759629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343969c-84d6-406e-a279-5d64d1f9bb06 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:10.761375 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4343969c-84d6-406e-a279-5d64d1f9bb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:10.818346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343969c-84d6-406e-a279-5d64d1f9bb06 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:10.821946 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08851376-8019-4274-b2cc-83c290b38a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:10.822545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08851376-8019-4274-b2cc-83c290b38a19 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:10.822820 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08851376-8019-4274-b2cc-83c290b38a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:10.823091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08851376-8019-4274-b2cc-83c290b38a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:10.832330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08851376-8019-4274-b2cc-83c290b38a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:10.833776 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08851376-8019-4274-b2cc-83c290b38a19 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:10.842899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1312/2658] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:11.223341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2297d-d8e9-42d2-a442-086f00289983 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:11.290121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2297d-d8e9-42d2-a442-086f00289983 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:11.294698 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:11.295630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:11.295929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:11.296204 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] PATH_INFO: `/v3/users/0e71d11d57fb4f0295e80244a5f3e3a7` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:11.297393 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e71d11d57fb4f0295e80244a5f3e3a7)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:11.299299 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:11.345156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e71d11d57fb4f0295e80244a5f3e3a7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:11.352796 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:11.358369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e71d11d57fb4f0295e80244a5f3e3a7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:11.359652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e71d11d57fb4f0295e80244a5f3e3a7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:11.360298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e71d11d57fb4f0295e80244a5f3e3a7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:11.369127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e71d11d57fb4f0295e80244a5f3e3a7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:11.382935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1347/2659] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:11 2022] DELETE /identity/v3/users/0e71d11d57fb4f0295e80244a5f3e3a7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:11.387613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20175687-c7c3-4e54-8543-03642eadde12 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:11.387907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20175687-c7c3-4e54-8543-03642eadde12 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:11.388183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20175687-c7c3-4e54-8543-03642eadde12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:11.406866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-20175687-c7c3-4e54-8543-03642eadde12 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:11.408063 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-20175687-c7c3-4e54-8543-03642eadde12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:11.440863 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:11.468320 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1313/2660] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:42:11.477978 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:11.479455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:11.537554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9a89b-8e42-4018-9846-eed3b4b41f01 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:11.541295 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385ea26-cd6e-477f-a51f-7621fdf2da35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:11.541942 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385ea26-cd6e-477f-a51f-7621fdf2da35 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:11.542229 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385ea26-cd6e-477f-a51f-7621fdf2da35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:11.542505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385ea26-cd6e-477f-a51f-7621fdf2da35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:11.552023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385ea26-cd6e-477f-a51f-7621fdf2da35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:11.553492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385ea26-cd6e-477f-a51f-7621fdf2da35 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:11.563704 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1348/2661] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:11.833504 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20175687-c7c3-4e54-8543-03642eadde12 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:11.834996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-20175687-c7c3-4e54-8543-03642eadde12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:11.846806 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20175687-c7c3-4e54-8543-03642eadde12 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:11.851359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:11.852001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:11.852275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:11.852547 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] PATH_INFO: `/v3/projects/b016755264a74130aa4a2678704a3a59` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:11.853721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b016755264a74130aa4a2678704a3a59)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:11.855596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:11.902335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b016755264a74130aa4a2678704a3a59', 'request_id': 'req-b09e22c4-f094-456f-ba02-8c63d6fc619b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:11.908246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b016755264a74130aa4a2678704a3a59', 'request_id': 'req-b09e22c4-f094-456f-ba02-8c63d6fc619b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:11.915295 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b016755264a74130aa4a2678704a3a59', 'request_id': 'req-b09e22c4-f094-456f-ba02-8c63d6fc619b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:11.926687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] The token cache is being invalidate because project b016755264a74130aa4a2678704a3a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:11.926975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:11.927613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:11.929126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1314/2662] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:11 2022] DELETE /identity/v3/projects/b016755264a74130aa4a2678704a3a59 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:11.933091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385ea26-cd6e-477f-a51f-7621fdf2da35 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:11.942938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385ea26-cd6e-477f-a51f-7621fdf2da35 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:11.997604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ad31a-ce97-462a-8ea1-fafe6b2b60a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:11.998272 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad31a-ce97-462a-8ea1-fafe6b2b60a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:11.998615 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad31a-ce97-462a-8ea1-fafe6b2b60a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:11.998814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad31a-ce97-462a-8ea1-fafe6b2b60a7 admin admin] PATH_INFO: `/v3/users/f0d0db76d281419f8eb62b108a96cbe3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:11.999981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ad31a-ce97-462a-8ea1-fafe6b2b60a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d0db76d281419f8eb62b108a96cbe3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:12.001949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ad31a-ce97-462a-8ea1-fafe6b2b60a7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:12.048375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-204ad31a-ce97-462a-8ea1-fafe6b2b60a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d0db76d281419f8eb62b108a96cbe3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:12.060083 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-204ad31a-ce97-462a-8ea1-fafe6b2b60a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d0db76d281419f8eb62b108a96cbe3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:12.060748 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-204ad31a-ce97-462a-8ea1-fafe6b2b60a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d0db76d281419f8eb62b108a96cbe3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:12.061415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-204ad31a-ce97-462a-8ea1-fafe6b2b60a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d0db76d281419f8eb62b108a96cbe3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:12.069524 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-204ad31a-ce97-462a-8ea1-fafe6b2b60a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d0db76d281419f8eb62b108a96cbe3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:12.077899 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:12.083731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1349/2663] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:11 2022] DELETE /identity/v3/users/f0d0db76d281419f8eb62b108a96cbe3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:12.360568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:12.362079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:12.381675 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e22c4-f094-456f-ba02-8c63d6fc619b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:12.439277 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b5527-5ea8-4c35-9220-067d9f88cbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:12.439864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b5527-5ea8-4c35-9220-067d9f88cbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:12.440159 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b5527-5ea8-4c35-9220-067d9f88cbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:12.440438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b5527-5ea8-4c35-9220-067d9f88cbce admin admin] PATH_INFO: `/v3/projects/380e6bb3eee048ccbe3cba34e64a8803` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:12.441606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b5527-5ea8-4c35-9220-067d9f88cbce admin admin] RBAC: Authorizing `identity:delete_project(project_id=380e6bb3eee048ccbe3cba34e64a8803)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:12.443499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b5527-5ea8-4c35-9220-067d9f88cbce admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:12.490202 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f98b5527-5ea8-4c35-9220-067d9f88cbce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380e6bb3eee048ccbe3cba34e64a8803', 'request_id': 'req-f98b5527-5ea8-4c35-9220-067d9f88cbce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:12.495602 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f98b5527-5ea8-4c35-9220-067d9f88cbce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380e6bb3eee048ccbe3cba34e64a8803', 'request_id': 'req-f98b5527-5ea8-4c35-9220-067d9f88cbce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:12.499248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:12.503516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f98b5527-5ea8-4c35-9220-067d9f88cbce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380e6bb3eee048ccbe3cba34e64a8803', 'request_id': 'req-f98b5527-5ea8-4c35-9220-067d9f88cbce'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:12.516674 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f98b5527-5ea8-4c35-9220-067d9f88cbce admin admin] The token cache is being invalidate because project 380e6bb3eee048ccbe3cba34e64a8803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:12.516995 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f98b5527-5ea8-4c35-9220-067d9f88cbce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:12.517625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f98b5527-5ea8-4c35-9220-067d9f88cbce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:12.519106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1315/2664] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:12 2022] DELETE /identity/v3/projects/380e6bb3eee048ccbe3cba34e64a8803 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:12.524634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f0be-05d4-4acb-8193-f8eee362daf5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:12.524982 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f0be-05d4-4acb-8193-f8eee362daf5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:12.525267 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f0be-05d4-4acb-8193-f8eee362daf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:12.546644 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-db73f0be-05d4-4acb-8193-f8eee362daf5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:12.547897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-db73f0be-05d4-4acb-8193-f8eee362daf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:12.607045 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1350/2665] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:12.616464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac240d-0b5a-4b45-a1a3-ebf62747177d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:12.616464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac240d-0b5a-4b45-a1a3-ebf62747177d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:12.616670 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac240d-0b5a-4b45-a1a3-ebf62747177d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:12.637729 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4eac240d-0b5a-4b45-a1a3-ebf62747177d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:12.639533 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4eac240d-0b5a-4b45-a1a3-ebf62747177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:12.647774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1316/2666] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:12.652056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73f0be-05d4-4acb-8193-f8eee362daf5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:12.661849 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73f0be-05d4-4acb-8193-f8eee362daf5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:12.666452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b03b19-23a1-486f-9b19-3e3de154f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:12.667067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b03b19-23a1-486f-9b19-3e3de154f2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:12.667352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b03b19-23a1-486f-9b19-3e3de154f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:12.667631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b03b19-23a1-486f-9b19-3e3de154f2f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:12.668335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b03b19-23a1-486f-9b19-3e3de154f2f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:42:12.668647 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b03b19-23a1-486f-9b19-3e3de154f2f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:12.670336 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b03b19-23a1-486f-9b19-3e3de154f2f9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:12.681836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1351/2667] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:42:12.686672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac240d-0b5a-4b45-a1a3-ebf62747177d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:12.696046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac240d-0b5a-4b45-a1a3-ebf62747177d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:12.700483 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054696cc-8a65-498a-928f-087f8a8ed2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:12.701233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054696cc-8a65-498a-928f-087f8a8ed2af admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:12.701685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054696cc-8a65-498a-928f-087f8a8ed2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:12.701963 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054696cc-8a65-498a-928f-087f8a8ed2af admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:12.702616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054696cc-8a65-498a-928f-087f8a8ed2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:12.704475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054696cc-8a65-498a-928f-087f8a8ed2af admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:12.730882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1317/2668] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:12 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:12.735603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b03b19-23a1-486f-9b19-3e3de154f2f9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:12.745579 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b03b19-23a1-486f-9b19-3e3de154f2f9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:12.802419 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992ebc1-ca0e-4300-95aa-5cf3bab0bddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:12.803033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992ebc1-ca0e-4300-95aa-5cf3bab0bddb admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:12.803320 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992ebc1-ca0e-4300-95aa-5cf3bab0bddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:12.803598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992ebc1-ca0e-4300-95aa-5cf3bab0bddb admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:12.804271 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992ebc1-ca0e-4300-95aa-5cf3bab0bddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:12.806205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992ebc1-ca0e-4300-95aa-5cf3bab0bddb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:12.828443 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1352/2669] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:12 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:12.832556 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054696cc-8a65-498a-928f-087f8a8ed2af admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:12.843450 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054696cc-8a65-498a-928f-087f8a8ed2af admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:12.848019 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc0132-f472-4f63-ba4d-6383c2bf7c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:12.848624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc0132-f472-4f63-ba4d-6383c2bf7c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:12.848932 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc0132-f472-4f63-ba4d-6383c2bf7c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:12.849231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc0132-f472-4f63-ba4d-6383c2bf7c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:12.849944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc0132-f472-4f63-ba4d-6383c2bf7c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:12.851517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc0132-f472-4f63-ba4d-6383c2bf7c6c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:12.861333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1318/2670] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:12.865189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992ebc1-ca0e-4300-95aa-5cf3bab0bddb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:12.875450 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992ebc1-ca0e-4300-95aa-5cf3bab0bddb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:12.880243 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730d1ae-157a-42e2-add7-502ec00ec6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:12.880842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730d1ae-157a-42e2-add7-502ec00ec6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:12.881162 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730d1ae-157a-42e2-add7-502ec00ec6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:12.881441 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730d1ae-157a-42e2-add7-502ec00ec6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:12.882134 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730d1ae-157a-42e2-add7-502ec00ec6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:12.883779 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730d1ae-157a-42e2-add7-502ec00ec6a0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:12.896613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1353/2671] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:12.900996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc0132-f472-4f63-ba4d-6383c2bf7c6c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:12.911021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc0132-f472-4f63-ba4d-6383c2bf7c6c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:12.915581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605e0c1-db83-41c8-b865-f9c2aabcbb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:12.916231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605e0c1-db83-41c8-b865-f9c2aabcbb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:12.916510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605e0c1-db83-41c8-b865-f9c2aabcbb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:12.916785 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605e0c1-db83-41c8-b865-f9c2aabcbb8f admin admin] PATH_INFO: `/v3/projects/c5b15172fd5a41e98db37738e4dbdc99/users/28f330e25e574c19b03c06c8275d4f19/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:12.932519 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605e0c1-db83-41c8-b865-f9c2aabcbb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b15172fd5a41e98db37738e4dbdc99, user_id=28f330e25e574c19b03c06c8275d4f19, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:12.935139 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605e0c1-db83-41c8-b865-f9c2aabcbb8f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:12.948079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1319/2672] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:12 2022] PUT /identity/v3/projects/c5b15172fd5a41e98db37738e4dbdc99/users/28f330e25e574c19b03c06c8275d4f19/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:12.958045 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b921781-9b0b-4749-9bc1-c0e57165e26f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:12.958516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b921781-9b0b-4749-9bc1-c0e57165e26f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:12.958616 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b921781-9b0b-4749-9bc1-c0e57165e26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:12.985952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6b921781-9b0b-4749-9bc1-c0e57165e26f None None] MFA Rules not processed for user `28f330e25e574c19b03c06c8275d4f19`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:12.987173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6b921781-9b0b-4749-9bc1-c0e57165e26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:13.040502 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:13.052085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1354/2673] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:13.056505 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605e0c1-db83-41c8-b865-f9c2aabcbb8f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:13.117654 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605e0c1-db83-41c8-b865-f9c2aabcbb8f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:13.122228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54cb01-de92-409c-b55d-5d85bd39f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:13.122836 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54cb01-de92-409c-b55d-5d85bd39f940 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:13.123227 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54cb01-de92-409c-b55d-5d85bd39f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:13.123511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54cb01-de92-409c-b55d-5d85bd39f940 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:13.124177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54cb01-de92-409c-b55d-5d85bd39f940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:13.126084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54cb01-de92-409c-b55d-5d85bd39f940 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:13.151842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1320/2674] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:13 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:13.156482 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b921781-9b0b-4749-9bc1-c0e57165e26f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:13.167010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b921781-9b0b-4749-9bc1-c0e57165e26f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:13.222515 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28c040-8b64-4a56-a704-687a5f34b359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:13.223063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28c040-8b64-4a56-a704-687a5f34b359 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:13.223345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28c040-8b64-4a56-a704-687a5f34b359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:13.223625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28c040-8b64-4a56-a704-687a5f34b359 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:13.224302 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28c040-8b64-4a56-a704-687a5f34b359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:13.226216 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28c040-8b64-4a56-a704-687a5f34b359 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:13.246826 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1355/2675] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:13 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:13.251521 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54cb01-de92-409c-b55d-5d85bd39f940 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:13.261936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54cb01-de92-409c-b55d-5d85bd39f940 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:13.267487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f8714-0738-4d50-b8f8-7c41dd5e4a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:13.268085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8714-0738-4d50-b8f8-7c41dd5e4a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:13.268368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8714-0738-4d50-b8f8-7c41dd5e4a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:13.268643 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8714-0738-4d50-b8f8-7c41dd5e4a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:13.269380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f8714-0738-4d50-b8f8-7c41dd5e4a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:13.270969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f8714-0738-4d50-b8f8-7c41dd5e4a8e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:13.281591 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1321/2676] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:13.285710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28c040-8b64-4a56-a704-687a5f34b359 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:13.296046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28c040-8b64-4a56-a704-687a5f34b359 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:13.300625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98093adc-4d1e-48f3-a477-0c4ea5f25739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:13.301334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98093adc-4d1e-48f3-a477-0c4ea5f25739 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:13.301618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98093adc-4d1e-48f3-a477-0c4ea5f25739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:13.301895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98093adc-4d1e-48f3-a477-0c4ea5f25739 admin admin] PATH_INFO: `/v3/projects/69e2b883bf7b4e9d924db322bb3b0d75/users/cd8a653d26454f6baa96290ec54e321a/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:13.317306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98093adc-4d1e-48f3-a477-0c4ea5f25739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e2b883bf7b4e9d924db322bb3b0d75, user_id=cd8a653d26454f6baa96290ec54e321a, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:13.319927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98093adc-4d1e-48f3-a477-0c4ea5f25739 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:13.333273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1356/2677] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:13 2022] PUT /identity/v3/projects/69e2b883bf7b4e9d924db322bb3b0d75/users/cd8a653d26454f6baa96290ec54e321a/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:13.337150 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f8714-0738-4d50-b8f8-7c41dd5e4a8e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:13.347113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f8714-0738-4d50-b8f8-7c41dd5e4a8e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:13.404305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f8023-4af5-4861-bf02-1a2b45cc3ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:13.405163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f8023-4af5-4861-bf02-1a2b45cc3ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:13.405446 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f8023-4af5-4861-bf02-1a2b45cc3ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:13.405722 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f8023-4af5-4861-bf02-1a2b45cc3ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:13.406417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f8023-4af5-4861-bf02-1a2b45cc3ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:13.408021 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f8023-4af5-4861-bf02-1a2b45cc3ba3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:13.410068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:13.418801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1322/2678] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:13.423054 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98093adc-4d1e-48f3-a477-0c4ea5f25739 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:13.433194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98093adc-4d1e-48f3-a477-0c4ea5f25739 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:13.438570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea42efa-a286-4eca-a1b5-e5af387af37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:13.439221 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42efa-a286-4eca-a1b5-e5af387af37a admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:13.439503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42efa-a286-4eca-a1b5-e5af387af37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:13.439778 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42efa-a286-4eca-a1b5-e5af387af37a admin admin] PATH_INFO: `/v3/projects/69e2b883bf7b4e9d924db322bb3b0d75/users/cd8a653d26454f6baa96290ec54e321a/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:13.441750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea42efa-a286-4eca-a1b5-e5af387af37a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e2b883bf7b4e9d924db322bb3b0d75, user_id=cd8a653d26454f6baa96290ec54e321a, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:13.444335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea42efa-a286-4eca-a1b5-e5af387af37a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:13.455436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1357/2679] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:13 2022] PUT /identity/v3/projects/69e2b883bf7b4e9d924db322bb3b0d75/users/cd8a653d26454f6baa96290ec54e321a/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:13.465463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053d380-8a1f-40b8-bb99-3884094a5d94 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:13.465753 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053d380-8a1f-40b8-bb99-3884094a5d94 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:13.466031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053d380-8a1f-40b8-bb99-3884094a5d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:13.494291 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2053d380-8a1f-40b8-bb99-3884094a5d94 None None] MFA Rules not processed for user `cd8a653d26454f6baa96290ec54e321a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:13.495427 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2053d380-8a1f-40b8-bb99-3884094a5d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:13.563700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1323/2680] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:13.574892 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea42efa-a286-4eca-a1b5-e5af387af37a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:13.577375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cea42efa-a286-4eca-a1b5-e5af387af37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:13.634042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea42efa-a286-4eca-a1b5-e5af387af37a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:13.637707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3a670-1a4c-435c-9463-ed300b42d13d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:13.638318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3a670-1a4c-435c-9463-ed300b42d13d service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:13.639145 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3a670-1a4c-435c-9463-ed300b42d13d service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:13.639657 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3a670-1a4c-435c-9463-ed300b42d13d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:13.648631 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3a670-1a4c-435c-9463-ed300b42d13d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:13.650090 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3a670-1a4c-435c-9463-ed300b42d13d service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:13.660167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1358/2681] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:14.068926 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053d380-8a1f-40b8-bb99-3884094a5d94 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:14.130861 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053d380-8a1f-40b8-bb99-3884094a5d94 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:14.135380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:14.136016 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:14.136301 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:14.136578 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] PATH_INFO: `/v3/users/28f330e25e574c19b03c06c8275d4f19` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:14.137791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f330e25e574c19b03c06c8275d4f19)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:14.139707 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:14.184801 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f330e25e574c19b03c06c8275d4f19'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.192087 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f330e25e574c19b03c06c8275d4f19'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.204594 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f330e25e574c19b03c06c8275d4f19'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.205303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f330e25e574c19b03c06c8275d4f19'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.205902 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f330e25e574c19b03c06c8275d4f19'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.219398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1324/2682] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:14 2022] DELETE /identity/v3/users/28f330e25e574c19b03c06c8275d4f19 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:14.223939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6169627-d628-4a2e-9529-ca9056048483 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:14.224396 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6169627-d628-4a2e-9529-ca9056048483 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:14.224496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6169627-d628-4a2e-9529-ca9056048483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:14.243586 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e6169627-d628-4a2e-9529-ca9056048483 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:14.244804 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e6169627-d628-4a2e-9529-ca9056048483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:14.287760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:14.304319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1359/2683] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:14.314744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:14.316126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:14.321437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:14.377059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c302d96-06f6-40e0-9a09-2b7ea90fcb4e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:14.380893 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442eb33e-af7e-403c-85e8-301ff0dd7d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:14.381531 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eb33e-af7e-403c-85e8-301ff0dd7d12 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:14.381809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eb33e-af7e-403c-85e8-301ff0dd7d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:14.382081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eb33e-af7e-403c-85e8-301ff0dd7d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:14.391774 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442eb33e-af7e-403c-85e8-301ff0dd7d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:14.393332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442eb33e-af7e-403c-85e8-301ff0dd7d12 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:14.403265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1325/2684] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:14.674091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6169627-d628-4a2e-9529-ca9056048483 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:14.675511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e6169627-d628-4a2e-9529-ca9056048483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:14.689392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6169627-d628-4a2e-9529-ca9056048483 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:14.694492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:14.695659 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:14.695951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:14.696462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] PATH_INFO: `/v3/projects/c5b15172fd5a41e98db37738e4dbdc99` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:14.697664 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b15172fd5a41e98db37738e4dbdc99)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:14.699537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:14.750420 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b15172fd5a41e98db37738e4dbdc99', 'request_id': 'req-426e7c35-b7cd-4c67-add0-70bd62af820b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.756499 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b15172fd5a41e98db37738e4dbdc99', 'request_id': 'req-426e7c35-b7cd-4c67-add0-70bd62af820b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.765459 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b15172fd5a41e98db37738e4dbdc99', 'request_id': 'req-426e7c35-b7cd-4c67-add0-70bd62af820b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.776802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] The token cache is being invalidate because project c5b15172fd5a41e98db37738e4dbdc99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:14.777194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.777841 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.779335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1360/2685] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:14 2022] DELETE /identity/v3/projects/c5b15172fd5a41e98db37738e4dbdc99 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:14.783229 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442eb33e-af7e-403c-85e8-301ff0dd7d12 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:14.793121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442eb33e-af7e-403c-85e8-301ff0dd7d12 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:14.848704 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08089fc3-45e6-42db-a510-7295c9bafeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:14.849373 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089fc3-45e6-42db-a510-7295c9bafeec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:14.849660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089fc3-45e6-42db-a510-7295c9bafeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:14.849936 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089fc3-45e6-42db-a510-7295c9bafeec admin admin] PATH_INFO: `/v3/users/cd8a653d26454f6baa96290ec54e321a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:14.851107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08089fc3-45e6-42db-a510-7295c9bafeec admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8a653d26454f6baa96290ec54e321a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:14.853077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08089fc3-45e6-42db-a510-7295c9bafeec admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:14.899494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08089fc3-45e6-42db-a510-7295c9bafeec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8a653d26454f6baa96290ec54e321a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.906322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08089fc3-45e6-42db-a510-7295c9bafeec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8a653d26454f6baa96290ec54e321a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.917645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08089fc3-45e6-42db-a510-7295c9bafeec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8a653d26454f6baa96290ec54e321a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.918314 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08089fc3-45e6-42db-a510-7295c9bafeec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8a653d26454f6baa96290ec54e321a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.918916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08089fc3-45e6-42db-a510-7295c9bafeec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8a653d26454f6baa96290ec54e321a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:14.931218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1326/2686] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:14 2022] DELETE /identity/v3/users/cd8a653d26454f6baa96290ec54e321a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:15.204523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:15.206096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:15.221142 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e7c35-b7cd-4c67-add0-70bd62af820b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:15.279537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3986471-79fb-4c5a-a870-69a563c63a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:15.280185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3986471-79fb-4c5a-a870-69a563c63a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:15.280455 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3986471-79fb-4c5a-a870-69a563c63a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:15.280736 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3986471-79fb-4c5a-a870-69a563c63a17 admin admin] PATH_INFO: `/v3/projects/69e2b883bf7b4e9d924db322bb3b0d75` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:15.281935 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3986471-79fb-4c5a-a870-69a563c63a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e2b883bf7b4e9d924db322bb3b0d75)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:15.283826 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3986471-79fb-4c5a-a870-69a563c63a17 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:15.329954 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c3986471-79fb-4c5a-a870-69a563c63a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e2b883bf7b4e9d924db322bb3b0d75', 'request_id': 'req-c3986471-79fb-4c5a-a870-69a563c63a17'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:15.335288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c3986471-79fb-4c5a-a870-69a563c63a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e2b883bf7b4e9d924db322bb3b0d75', 'request_id': 'req-c3986471-79fb-4c5a-a870-69a563c63a17'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:15.343054 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c3986471-79fb-4c5a-a870-69a563c63a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e2b883bf7b4e9d924db322bb3b0d75', 'request_id': 'req-c3986471-79fb-4c5a-a870-69a563c63a17'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:15.354026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c3986471-79fb-4c5a-a870-69a563c63a17 admin admin] The token cache is being invalidate because project 69e2b883bf7b4e9d924db322bb3b0d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:15.354316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c3986471-79fb-4c5a-a870-69a563c63a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:15.354959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c3986471-79fb-4c5a-a870-69a563c63a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:15.356452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1361/2687] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:15 2022] DELETE /identity/v3/projects/69e2b883bf7b4e9d924db322bb3b0d75 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:15.361640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a607c6-3db1-4e92-8b59-dfaf7cdb1830 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:15.362137 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a607c6-3db1-4e92-8b59-dfaf7cdb1830 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:15.362333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a607c6-3db1-4e92-8b59-dfaf7cdb1830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:15.382765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-62a607c6-3db1-4e92-8b59-dfaf7cdb1830 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:15.383976 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-62a607c6-3db1-4e92-8b59-dfaf7cdb1830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:15.403761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:15.447635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1327/2688] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:15.457460 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770bf42-645d-4bea-a9f5-84f8800a9611 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:15.457753 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770bf42-645d-4bea-a9f5-84f8800a9611 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:15.458033 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770bf42-645d-4bea-a9f5-84f8800a9611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:15.465806 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:15.480153 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5770bf42-645d-4bea-a9f5-84f8800a9611 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:15.481390 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5770bf42-645d-4bea-a9f5-84f8800a9611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:15.489675 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1362/2689] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:15.493882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a607c6-3db1-4e92-8b59-dfaf7cdb1830 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:15.504725 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a607c6-3db1-4e92-8b59-dfaf7cdb1830 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:15.509409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714cb3b-895f-47ee-a2fc-ed65df705296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:15.510014 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714cb3b-895f-47ee-a2fc-ed65df705296 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:15.510293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714cb3b-895f-47ee-a2fc-ed65df705296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:15.510566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714cb3b-895f-47ee-a2fc-ed65df705296 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:15.511289 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714cb3b-895f-47ee-a2fc-ed65df705296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:42:15.511618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714cb3b-895f-47ee-a2fc-ed65df705296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:15.513212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714cb3b-895f-47ee-a2fc-ed65df705296 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:15.525498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1328/2690] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:42:15.529807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770bf42-645d-4bea-a9f5-84f8800a9611 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:15.538949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770bf42-645d-4bea-a9f5-84f8800a9611 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:15.543739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c6d6b-6f6f-4b14-ae74-2ed9af5c5cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:15.544338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6d6b-6f6f-4b14-ae74-2ed9af5c5cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:15.544663 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6d6b-6f6f-4b14-ae74-2ed9af5c5cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:15.545000 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6d6b-6f6f-4b14-ae74-2ed9af5c5cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:15.545775 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c6d6b-6f6f-4b14-ae74-2ed9af5c5cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:15.547829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c6d6b-6f6f-4b14-ae74-2ed9af5c5cc5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:15.574598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1363/2691] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:15 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:15.579543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714cb3b-895f-47ee-a2fc-ed65df705296 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:15.589635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714cb3b-895f-47ee-a2fc-ed65df705296 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:15.645632 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5dc2e-9ae7-45a9-b211-b8eff46f7e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:15.646246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5dc2e-9ae7-45a9-b211-b8eff46f7e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:15.646530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5dc2e-9ae7-45a9-b211-b8eff46f7e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:15.646809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5dc2e-9ae7-45a9-b211-b8eff46f7e65 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:15.647505 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5dc2e-9ae7-45a9-b211-b8eff46f7e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:15.649429 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5dc2e-9ae7-45a9-b211-b8eff46f7e65 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:15.671061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1329/2692] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:15 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:42:15.675236 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c6d6b-6f6f-4b14-ae74-2ed9af5c5cc5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:15.685995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c6d6b-6f6f-4b14-ae74-2ed9af5c5cc5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:15.690857 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363b351-3b44-4a71-9796-a32e4f62624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:15.691466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363b351-3b44-4a71-9796-a32e4f62624e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:15.691747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363b351-3b44-4a71-9796-a32e4f62624e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:15.692022 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363b351-3b44-4a71-9796-a32e4f62624e admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:15.692718 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363b351-3b44-4a71-9796-a32e4f62624e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:15.694324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363b351-3b44-4a71-9796-a32e4f62624e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:15.833338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1364/2693] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:15.839728 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5dc2e-9ae7-45a9-b211-b8eff46f7e65 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:15.850197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5dc2e-9ae7-45a9-b211-b8eff46f7e65 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:15.854795 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f51c3-d7f8-4c7a-b309-2f4b4eeadafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:15.855397 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f51c3-d7f8-4c7a-b309-2f4b4eeadafb admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:15.855678 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f51c3-d7f8-4c7a-b309-2f4b4eeadafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:15.855950 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f51c3-d7f8-4c7a-b309-2f4b4eeadafb admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:15.856634 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f51c3-d7f8-4c7a-b309-2f4b4eeadafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:15.859284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f51c3-d7f8-4c7a-b309-2f4b4eeadafb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:15.869677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1330/2694] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:15.874179 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363b351-3b44-4a71-9796-a32e4f62624e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:15.884178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363b351-3b44-4a71-9796-a32e4f62624e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:15.889000 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a7a9e-9711-4aa7-a2ef-e1e120a167b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:15.889420 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a7a9e-9711-4aa7-a2ef-e1e120a167b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:15.889702 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a7a9e-9711-4aa7-a2ef-e1e120a167b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:15.889977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a7a9e-9711-4aa7-a2ef-e1e120a167b7 admin admin] PATH_INFO: `/v3/projects/8501f14246324be9abebaf5f26d0ed81/users/d1218308bdcd43eb991d888043aed29b/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:15.903967 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a7a9e-9711-4aa7-a2ef-e1e120a167b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8501f14246324be9abebaf5f26d0ed81, user_id=d1218308bdcd43eb991d888043aed29b, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:15.906591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a7a9e-9711-4aa7-a2ef-e1e120a167b7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:15.919201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1365/2695] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:15 2022] PUT /identity/v3/projects/8501f14246324be9abebaf5f26d0ed81/users/d1218308bdcd43eb991d888043aed29b/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:15.931605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef7e32-b1d7-4d4c-b3f9-808092be6fba None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:15.931896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef7e32-b1d7-4d4c-b3f9-808092be6fba None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:15.932171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef7e32-b1d7-4d4c-b3f9-808092be6fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:15.960968 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cdef7e32-b1d7-4d4c-b3f9-808092be6fba None None] MFA Rules not processed for user `d1218308bdcd43eb991d888043aed29b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:15.962166 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cdef7e32-b1d7-4d4c-b3f9-808092be6fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:16.030467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1331/2696] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:16.034972 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a7a9e-9711-4aa7-a2ef-e1e120a167b7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:16.099571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a7a9e-9711-4aa7-a2ef-e1e120a167b7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:16.104682 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccf97c-7f63-4a54-a9e7-97465acc6905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:16.105348 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccf97c-7f63-4a54-a9e7-97465acc6905 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:16.105635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccf97c-7f63-4a54-a9e7-97465acc6905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:16.105912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccf97c-7f63-4a54-a9e7-97465acc6905 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:16.106577 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccf97c-7f63-4a54-a9e7-97465acc6905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:16.109213 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccf97c-7f63-4a54-a9e7-97465acc6905 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:16.138432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1366/2697] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:16 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:16.142903 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef7e32-b1d7-4d4c-b3f9-808092be6fba None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:16.153683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef7e32-b1d7-4d4c-b3f9-808092be6fba None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:16.171294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:16.212298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3d8d-6b0e-420e-bc6f-c169bc21639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:16.212941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3d8d-6b0e-420e-bc6f-c169bc21639f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:16.213233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3d8d-6b0e-420e-bc6f-c169bc21639f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:16.213511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3d8d-6b0e-420e-bc6f-c169bc21639f admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:16.214170 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd3d8d-6b0e-420e-bc6f-c169bc21639f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:16.216075 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd3d8d-6b0e-420e-bc6f-c169bc21639f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:16.238711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1332/2698] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:16 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:16.242799 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccf97c-7f63-4a54-a9e7-97465acc6905 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:16.253684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccf97c-7f63-4a54-a9e7-97465acc6905 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:16.258191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a4fe9-5bc7-4303-b5cf-5b19d92ffa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:16.258787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a4fe9-5bc7-4303-b5cf-5b19d92ffa4e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:16.259063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a4fe9-5bc7-4303-b5cf-5b19d92ffa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:16.259331 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a4fe9-5bc7-4303-b5cf-5b19d92ffa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:16.260046 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a4fe9-5bc7-4303-b5cf-5b19d92ffa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:16.261642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a4fe9-5bc7-4303-b5cf-5b19d92ffa4e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:16.271398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1367/2699] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:16.275517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3d8d-6b0e-420e-bc6f-c169bc21639f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:16.286223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3d8d-6b0e-420e-bc6f-c169bc21639f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:16.290758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af312f0-2406-4f6f-befe-9e807fb26e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:16.291421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af312f0-2406-4f6f-befe-9e807fb26e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:16.291708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af312f0-2406-4f6f-befe-9e807fb26e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:16.291982 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af312f0-2406-4f6f-befe-9e807fb26e8d admin admin] PATH_INFO: `/v3/projects/b8b33198f8894f0abf2399a744421b99/users/fa2fab20ef9b4cd8a6e9bfb49b49b151/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:16.307205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af312f0-2406-4f6f-befe-9e807fb26e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b33198f8894f0abf2399a744421b99, user_id=fa2fab20ef9b4cd8a6e9bfb49b49b151, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:16.309869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af312f0-2406-4f6f-befe-9e807fb26e8d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:16.322530 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1333/2700] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:16 2022] PUT /identity/v3/projects/b8b33198f8894f0abf2399a744421b99/users/fa2fab20ef9b4cd8a6e9bfb49b49b151/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:16.326521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a4fe9-5bc7-4303-b5cf-5b19d92ffa4e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:16.336534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a4fe9-5bc7-4303-b5cf-5b19d92ffa4e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:16.397407 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3393c-0701-430d-b4ca-2ed7bd628c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:16.398025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3393c-0701-430d-b4ca-2ed7bd628c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:16.398309 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3393c-0701-430d-b4ca-2ed7bd628c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:16.398580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3393c-0701-430d-b4ca-2ed7bd628c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:16.399264 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3393c-0701-430d-b4ca-2ed7bd628c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:16.400842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3393c-0701-430d-b4ca-2ed7bd628c12 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:16.411473 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1368/2701] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:16.415720 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af312f0-2406-4f6f-befe-9e807fb26e8d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:16.426525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af312f0-2406-4f6f-befe-9e807fb26e8d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:16.431079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec5049-0025-4cc6-be80-51d4110a21e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:16.431734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec5049-0025-4cc6-be80-51d4110a21e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:16.432017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec5049-0025-4cc6-be80-51d4110a21e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:16.432294 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec5049-0025-4cc6-be80-51d4110a21e8 admin admin] PATH_INFO: `/v3/projects/b8b33198f8894f0abf2399a744421b99/users/fa2fab20ef9b4cd8a6e9bfb49b49b151/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:16.434278 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec5049-0025-4cc6-be80-51d4110a21e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b33198f8894f0abf2399a744421b99, user_id=fa2fab20ef9b4cd8a6e9bfb49b49b151, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:16.437034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec5049-0025-4cc6-be80-51d4110a21e8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:16.447121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1334/2702] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:16 2022] PUT /identity/v3/projects/b8b33198f8894f0abf2399a744421b99/users/fa2fab20ef9b4cd8a6e9bfb49b49b151/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:16.459026 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04f93d-149a-4610-8030-cdf87557c7a3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:16.459314 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04f93d-149a-4610-8030-cdf87557c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:16.459592 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04f93d-149a-4610-8030-cdf87557c7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:16.479179 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:16.489397 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-de04f93d-149a-4610-8030-cdf87557c7a3 None None] MFA Rules not processed for user `fa2fab20ef9b4cd8a6e9bfb49b49b151`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:16.490591 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-de04f93d-149a-4610-8030-cdf87557c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:16.558024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1369/2703] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:16.569969 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec5049-0025-4cc6-be80-51d4110a21e8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:16.571689 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-feec5049-0025-4cc6-be80-51d4110a21e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:16.629703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec5049-0025-4cc6-be80-51d4110a21e8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:16.633540 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678a6cd-3e3a-4a85-9e6a-63132b4db513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:16.634168 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678a6cd-3e3a-4a85-9e6a-63132b4db513 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:16.634448 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678a6cd-3e3a-4a85-9e6a-63132b4db513 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:16.634720 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678a6cd-3e3a-4a85-9e6a-63132b4db513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:16.643762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678a6cd-3e3a-4a85-9e6a-63132b4db513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:16.645211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678a6cd-3e3a-4a85-9e6a-63132b4db513 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:16.654381 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1335/2704] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:16.718898 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04f93d-149a-4610-8030-cdf87557c7a3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:16.780981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04f93d-149a-4610-8030-cdf87557c7a3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:16.785573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:16.786210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:16.786496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:16.786779 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] PATH_INFO: `/v3/users/d1218308bdcd43eb991d888043aed29b` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:16.787945 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1218308bdcd43eb991d888043aed29b)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:16.789891 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:16.835274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1218308bdcd43eb991d888043aed29b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:16.847370 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1218308bdcd43eb991d888043aed29b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:16.848048 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1218308bdcd43eb991d888043aed29b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:16.848699 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1218308bdcd43eb991d888043aed29b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:16.856330 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1218308bdcd43eb991d888043aed29b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:16.868834 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1370/2705] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:16 2022] DELETE /identity/v3/users/d1218308bdcd43eb991d888043aed29b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:16.874242 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1be98-e280-4c3e-83db-39819f1c89d8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:16.874604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1be98-e280-4c3e-83db-39819f1c89d8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:16.874951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1be98-e280-4c3e-83db-39819f1c89d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:16.896467 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bdf1be98-e280-4c3e-83db-39819f1c89d8 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:16.897994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bdf1be98-e280-4c3e-83db-39819f1c89d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:16.960629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1336/2706] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:16.971084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:16.972502 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:16.987914 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:17.041270 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f42ec-f9fb-4669-be57-c11f829746d0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:17.045409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22e05c-421e-4c24-8d7b-17306c00db0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:17.046132 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e05c-421e-4c24-8d7b-17306c00db0a service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:17.046415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e05c-421e-4c24-8d7b-17306c00db0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:17.046693 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22e05c-421e-4c24-8d7b-17306c00db0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:17.056019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22e05c-421e-4c24-8d7b-17306c00db0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:17.057466 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22e05c-421e-4c24-8d7b-17306c00db0a service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:17.068085 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1371/2707] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:17.338139 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1be98-e280-4c3e-83db-39819f1c89d8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:17.339557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bdf1be98-e280-4c3e-83db-39819f1c89d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:17.353528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1be98-e280-4c3e-83db-39819f1c89d8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:17.359404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:17.360128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:17.360574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:17.360860 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] PATH_INFO: `/v3/projects/8501f14246324be9abebaf5f26d0ed81` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:17.364988 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8501f14246324be9abebaf5f26d0ed81)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:17.366898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:17.378652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:17.415577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8501f14246324be9abebaf5f26d0ed81', 'request_id': 'req-9bc4904b-71c2-4eb2-b06d-af98234936f5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:17.421239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8501f14246324be9abebaf5f26d0ed81', 'request_id': 'req-9bc4904b-71c2-4eb2-b06d-af98234936f5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:17.428616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8501f14246324be9abebaf5f26d0ed81', 'request_id': 'req-9bc4904b-71c2-4eb2-b06d-af98234936f5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:17.439830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] The token cache is being invalidate because project 8501f14246324be9abebaf5f26d0ed81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:17.440121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:17.440764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:17.442283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1337/2708] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:17 2022] DELETE /identity/v3/projects/8501f14246324be9abebaf5f26d0ed81 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:17.446234 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22e05c-421e-4c24-8d7b-17306c00db0a service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:17.456138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22e05c-421e-4c24-8d7b-17306c00db0a service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:17.511841 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba1268-c710-4e6e-b398-752ec3ac2770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:17.512483 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba1268-c710-4e6e-b398-752ec3ac2770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:17.512770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba1268-c710-4e6e-b398-752ec3ac2770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:17.513086 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba1268-c710-4e6e-b398-752ec3ac2770 admin admin] PATH_INFO: `/v3/users/fa2fab20ef9b4cd8a6e9bfb49b49b151` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:17.514557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba1268-c710-4e6e-b398-752ec3ac2770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2fab20ef9b4cd8a6e9bfb49b49b151)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:17.516520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba1268-c710-4e6e-b398-752ec3ac2770 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:17.563982 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-91ba1268-c710-4e6e-b398-752ec3ac2770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2fab20ef9b4cd8a6e9bfb49b49b151'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:17.575486 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-91ba1268-c710-4e6e-b398-752ec3ac2770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2fab20ef9b4cd8a6e9bfb49b49b151'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:17.576354 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-91ba1268-c710-4e6e-b398-752ec3ac2770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2fab20ef9b4cd8a6e9bfb49b49b151'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:17.576771 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-91ba1268-c710-4e6e-b398-752ec3ac2770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2fab20ef9b4cd8a6e9bfb49b49b151'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:17.584011 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-91ba1268-c710-4e6e-b398-752ec3ac2770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2fab20ef9b4cd8a6e9bfb49b49b151'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:17.597139 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1372/2709] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:17 2022] DELETE /identity/v3/users/fa2fab20ef9b4cd8a6e9bfb49b49b151 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:17.867603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:17.869171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:17.887109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4904b-71c2-4eb2-b06d-af98234936f5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:17.944073 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6072d46-7d0d-4cde-9ff6-230ec6f47611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:17.944635 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6072d46-7d0d-4cde-9ff6-230ec6f47611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:17.944929 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6072d46-7d0d-4cde-9ff6-230ec6f47611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:17.945212 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6072d46-7d0d-4cde-9ff6-230ec6f47611 admin admin] PATH_INFO: `/v3/projects/b8b33198f8894f0abf2399a744421b99` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:17.946347 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6072d46-7d0d-4cde-9ff6-230ec6f47611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b33198f8894f0abf2399a744421b99)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:17.948231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6072d46-7d0d-4cde-9ff6-230ec6f47611 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:17.995198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b6072d46-7d0d-4cde-9ff6-230ec6f47611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b33198f8894f0abf2399a744421b99', 'request_id': 'req-b6072d46-7d0d-4cde-9ff6-230ec6f47611'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:18.000648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b6072d46-7d0d-4cde-9ff6-230ec6f47611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b33198f8894f0abf2399a744421b99', 'request_id': 'req-b6072d46-7d0d-4cde-9ff6-230ec6f47611'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:18.007918 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b6072d46-7d0d-4cde-9ff6-230ec6f47611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b33198f8894f0abf2399a744421b99', 'request_id': 'req-b6072d46-7d0d-4cde-9ff6-230ec6f47611'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:18.019721 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b6072d46-7d0d-4cde-9ff6-230ec6f47611 admin admin] The token cache is being invalidate because project b8b33198f8894f0abf2399a744421b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:18.020012 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b6072d46-7d0d-4cde-9ff6-230ec6f47611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:18.020638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b6072d46-7d0d-4cde-9ff6-230ec6f47611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:18.022160 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1338/2710] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:17 2022] DELETE /identity/v3/projects/b8b33198f8894f0abf2399a744421b99 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:18.026953 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397c46a-68fd-4835-96dc-73f8fbd274b7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.027245 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397c46a-68fd-4835-96dc-73f8fbd274b7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.027538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397c46a-68fd-4835-96dc-73f8fbd274b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.050103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7397c46a-68fd-4835-96dc-73f8fbd274b7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:18.051777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7397c46a-68fd-4835-96dc-73f8fbd274b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:18.085508 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:18.116844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1373/2711] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:18.126115 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbcdd7-077a-4797-834a-dd71ca562c91 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.126493 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbcdd7-077a-4797-834a-dd71ca562c91 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.126868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbcdd7-077a-4797-834a-dd71ca562c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.147509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-38cbcdd7-077a-4797-834a-dd71ca562c91 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:18.148705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-38cbcdd7-077a-4797-834a-dd71ca562c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:18.157348 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1339/2712] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:18.161876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397c46a-68fd-4835-96dc-73f8fbd274b7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:18.172317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397c46a-68fd-4835-96dc-73f8fbd274b7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:18.177067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca96a7-1401-4dc8-a019-0e2470498339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:18.177687 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca96a7-1401-4dc8-a019-0e2470498339 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.177971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca96a7-1401-4dc8-a019-0e2470498339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.178248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca96a7-1401-4dc8-a019-0e2470498339 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.178957 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca96a7-1401-4dc8-a019-0e2470498339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:42:18.179267 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca96a7-1401-4dc8-a019-0e2470498339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:18.180897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca96a7-1401-4dc8-a019-0e2470498339 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:18.193103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1374/2713] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:42:18.197499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbcdd7-077a-4797-834a-dd71ca562c91 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:18.207064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbcdd7-077a-4797-834a-dd71ca562c91 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:18.211629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7eb42-524d-4d73-aab1-5b781c72155b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:18.212230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7eb42-524d-4d73-aab1-5b781c72155b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.212506 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7eb42-524d-4d73-aab1-5b781c72155b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.212777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7eb42-524d-4d73-aab1-5b781c72155b admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.213469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7eb42-524d-4d73-aab1-5b781c72155b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:18.215329 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7eb42-524d-4d73-aab1-5b781c72155b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:18.237708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:18.249549 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1340/2714] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:18 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:18.250618 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca96a7-1401-4dc8-a019-0e2470498339 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:18.260733 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca96a7-1401-4dc8-a019-0e2470498339 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:18.322603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1dbe5e-f087-4421-8e63-d580ffd33e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:18.323288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dbe5e-f087-4421-8e63-d580ffd33e97 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.323544 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dbe5e-f087-4421-8e63-d580ffd33e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.323927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dbe5e-f087-4421-8e63-d580ffd33e97 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.324642 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1dbe5e-f087-4421-8e63-d580ffd33e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:18.326754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1dbe5e-f087-4421-8e63-d580ffd33e97 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:18.348511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1375/2715] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:18 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:42:18.352845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7eb42-524d-4d73-aab1-5b781c72155b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:18.364051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7eb42-524d-4d73-aab1-5b781c72155b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:18.369097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6895b-c693-4fee-b3fc-a15e891fd5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:18.369741 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6895b-c693-4fee-b3fc-a15e891fd5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.370064 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6895b-c693-4fee-b3fc-a15e891fd5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.370408 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6895b-c693-4fee-b3fc-a15e891fd5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.371181 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6895b-c693-4fee-b3fc-a15e891fd5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:18.373510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6895b-c693-4fee-b3fc-a15e891fd5a6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:18.385017 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1341/2716] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:18.389557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1dbe5e-f087-4421-8e63-d580ffd33e97 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:18.401277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1dbe5e-f087-4421-8e63-d580ffd33e97 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:18.407810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc6d9-208a-45c9-85a6-a8a540478ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:18.408654 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc6d9-208a-45c9-85a6-a8a540478ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.409036 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc6d9-208a-45c9-85a6-a8a540478ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.409505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc6d9-208a-45c9-85a6-a8a540478ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.410237 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afc6d9-208a-45c9-85a6-a8a540478ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:18.412118 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afc6d9-208a-45c9-85a6-a8a540478ca0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:18.424710 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1376/2717] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:18.429447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6895b-c693-4fee-b3fc-a15e891fd5a6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:18.441323 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6895b-c693-4fee-b3fc-a15e891fd5a6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:18.446434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496aa60c-59b5-415c-bccb-fa6a559c948e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:18.447120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aa60c-59b5-415c-bccb-fa6a559c948e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.447399 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aa60c-59b5-415c-bccb-fa6a559c948e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.447730 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aa60c-59b5-415c-bccb-fa6a559c948e admin admin] PATH_INFO: `/v3/projects/eedbfa571eba48c9bb0bfd76c6b064f4/users/31f6350b49da4d60b3fa26aa57b63295/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.465766 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496aa60c-59b5-415c-bccb-fa6a559c948e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eedbfa571eba48c9bb0bfd76c6b064f4, user_id=31f6350b49da4d60b3fa26aa57b63295, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:18.470005 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496aa60c-59b5-415c-bccb-fa6a559c948e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:18.483690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1342/2718] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:18 2022] PUT /identity/v3/projects/eedbfa571eba48c9bb0bfd76c6b064f4/users/31f6350b49da4d60b3fa26aa57b63295/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:18.495214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd03fc-be70-4a94-ba70-bff0e64506e6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.495742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd03fc-be70-4a94-ba70-bff0e64506e6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.495842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd03fc-be70-4a94-ba70-bff0e64506e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.526723 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c7fd03fc-be70-4a94-ba70-bff0e64506e6 None None] MFA Rules not processed for user `31f6350b49da4d60b3fa26aa57b63295`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:18.528053 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c7fd03fc-be70-4a94-ba70-bff0e64506e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:18.593392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1377/2719] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:18.597901 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496aa60c-59b5-415c-bccb-fa6a559c948e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:18.659079 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496aa60c-59b5-415c-bccb-fa6a559c948e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:18.663658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc40c3-679b-4523-aebb-e6bd0cf11211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:18.664267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc40c3-679b-4523-aebb-e6bd0cf11211 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.664548 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc40c3-679b-4523-aebb-e6bd0cf11211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.664823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc40c3-679b-4523-aebb-e6bd0cf11211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.665509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc40c3-679b-4523-aebb-e6bd0cf11211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:18.667383 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc40c3-679b-4523-aebb-e6bd0cf11211 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:18.694567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1343/2720] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:18 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:18.698732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd03fc-be70-4a94-ba70-bff0e64506e6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:18.710205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd03fc-be70-4a94-ba70-bff0e64506e6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:18.739140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:18.768316 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce1fc3-d127-4f37-b916-8018dcd089c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:18.768951 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce1fc3-d127-4f37-b916-8018dcd089c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.769240 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce1fc3-d127-4f37-b916-8018dcd089c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.769516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce1fc3-d127-4f37-b916-8018dcd089c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.770181 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce1fc3-d127-4f37-b916-8018dcd089c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:18.772066 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce1fc3-d127-4f37-b916-8018dcd089c2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:18.792570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1378/2721] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:18 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:18.797119 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc40c3-679b-4523-aebb-e6bd0cf11211 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:18.807226 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc40c3-679b-4523-aebb-e6bd0cf11211 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:18.812712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193024c-4062-4e6a-8c07-ef446d48427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:18.813359 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193024c-4062-4e6a-8c07-ef446d48427c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.813629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193024c-4062-4e6a-8c07-ef446d48427c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.813905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193024c-4062-4e6a-8c07-ef446d48427c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.814598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193024c-4062-4e6a-8c07-ef446d48427c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:18.816177 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193024c-4062-4e6a-8c07-ef446d48427c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:18.826830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1344/2722] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:18.830731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce1fc3-d127-4f37-b916-8018dcd089c2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:18.840598 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce1fc3-d127-4f37-b916-8018dcd089c2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:18.845457 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d048b81-4476-4a84-bbd2-9568a2e31f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:18.846122 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d048b81-4476-4a84-bbd2-9568a2e31f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.846400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d048b81-4476-4a84-bbd2-9568a2e31f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.846674 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d048b81-4476-4a84-bbd2-9568a2e31f99 admin admin] PATH_INFO: `/v3/projects/56a4794b30054dbe99e06593e171cfa8/users/c402107d479e4abc928861a15d706a72/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.861941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d048b81-4476-4a84-bbd2-9568a2e31f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a4794b30054dbe99e06593e171cfa8, user_id=c402107d479e4abc928861a15d706a72, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:18.864534 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d048b81-4476-4a84-bbd2-9568a2e31f99 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:18.877173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1379/2723] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:18 2022] PUT /identity/v3/projects/56a4794b30054dbe99e06593e171cfa8/users/c402107d479e4abc928861a15d706a72/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:18.881246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193024c-4062-4e6a-8c07-ef446d48427c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:18.891748 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193024c-4062-4e6a-8c07-ef446d48427c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:18.947783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8aaf02-ebbe-46d9-8dd1-8767bf545d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:18.948397 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aaf02-ebbe-46d9-8dd1-8767bf545d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.948684 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aaf02-ebbe-46d9-8dd1-8767bf545d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.949051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aaf02-ebbe-46d9-8dd1-8767bf545d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.949693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8aaf02-ebbe-46d9-8dd1-8767bf545d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:18.951987 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8aaf02-ebbe-46d9-8dd1-8767bf545d8e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:18.961597 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1345/2724] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:18.965681 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d048b81-4476-4a84-bbd2-9568a2e31f99 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:18.976401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d048b81-4476-4a84-bbd2-9568a2e31f99 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:18.980955 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a29f3-59df-4f2e-a6b5-eaa8205062b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:18.981611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a29f3-59df-4f2e-a6b5-eaa8205062b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:18.981895 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a29f3-59df-4f2e-a6b5-eaa8205062b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:18.982191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a29f3-59df-4f2e-a6b5-eaa8205062b0 admin admin] PATH_INFO: `/v3/projects/56a4794b30054dbe99e06593e171cfa8/users/c402107d479e4abc928861a15d706a72/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:18.984155 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a29f3-59df-4f2e-a6b5-eaa8205062b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a4794b30054dbe99e06593e171cfa8, user_id=c402107d479e4abc928861a15d706a72, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:18.986789 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a29f3-59df-4f2e-a6b5-eaa8205062b0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:18.996981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1380/2725] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:18 2022] PUT /identity/v3/projects/56a4794b30054dbe99e06593e171cfa8/users/c402107d479e4abc928861a15d706a72/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:19.008404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eef95-2764-4a67-ab93-40953a4b9ac6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:19.008699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eef95-2764-4a67-ab93-40953a4b9ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:19.009030 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eef95-2764-4a67-ab93-40953a4b9ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:19.037275 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fe5eef95-2764-4a67-ab93-40953a4b9ac6 None None] MFA Rules not processed for user `c402107d479e4abc928861a15d706a72`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:19.038537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fe5eef95-2764-4a67-ab93-40953a4b9ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:19.062246 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:19.108153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1346/2726] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:19 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:19.119341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a29f3-59df-4f2e-a6b5-eaa8205062b0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:19.121068 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-540a29f3-59df-4f2e-a6b5-eaa8205062b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:19.178925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a29f3-59df-4f2e-a6b5-eaa8205062b0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:19.182603 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896cb94-3c7f-44aa-953f-ec1b8c87ec64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:19.183193 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896cb94-3c7f-44aa-953f-ec1b8c87ec64 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:19.183472 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896cb94-3c7f-44aa-953f-ec1b8c87ec64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:19.183743 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896cb94-3c7f-44aa-953f-ec1b8c87ec64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:19.194004 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896cb94-3c7f-44aa-953f-ec1b8c87ec64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:19.195422 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896cb94-3c7f-44aa-953f-ec1b8c87ec64 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:19.205784 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1381/2727] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:19 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:19.279468 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eef95-2764-4a67-ab93-40953a4b9ac6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:19.289317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eef95-2764-4a67-ab93-40953a4b9ac6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:19.293041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f5c47-e7a8-4757-a882-70ca624df4a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:19.293657 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f5c47-e7a8-4757-a882-70ca624df4a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:19.293944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f5c47-e7a8-4757-a882-70ca624df4a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:19.294228 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f5c47-e7a8-4757-a882-70ca624df4a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:19.350699 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f5c47-e7a8-4757-a882-70ca624df4a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:19.352134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f5c47-e7a8-4757-a882-70ca624df4a8 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:19.361822 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1347/2728] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:23.451372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896cb94-3c7f-44aa-953f-ec1b8c87ec64 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:23.514541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896cb94-3c7f-44aa-953f-ec1b8c87ec64 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:23.519054 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:23.519722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:23.520009 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:23.520285 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] PATH_INFO: `/v3/users/31f6350b49da4d60b3fa26aa57b63295` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:23.521474 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f6350b49da4d60b3fa26aa57b63295)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:23.523365 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:23.552372 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:23.572095 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f6350b49da4d60b3fa26aa57b63295'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:23.584444 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f6350b49da4d60b3fa26aa57b63295'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:23.585148 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f6350b49da4d60b3fa26aa57b63295'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:23.585760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f6350b49da4d60b3fa26aa57b63295'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:23.593531 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f6350b49da4d60b3fa26aa57b63295'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:23.605575 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1382/2729] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:23 2022] DELETE /identity/v3/users/31f6350b49da4d60b3fa26aa57b63295 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:23.610199 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27dedc-ad44-41f4-a0bf-29e26168bac7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:23.610723 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27dedc-ad44-41f4-a0bf-29e26168bac7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:23.610723 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27dedc-ad44-41f4-a0bf-29e26168bac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:23.630315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7f27dedc-ad44-41f4-a0bf-29e26168bac7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:23.631523 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7f27dedc-ad44-41f4-a0bf-29e26168bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:23.698114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1348/2730] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:23.708581 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:23.710006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:23.766608 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6296f0a-341d-4087-9ac0-5277909edeaa admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:23.770215 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c80dc-f90e-4230-a541-78e92537eb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:23.770833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c80dc-f90e-4230-a541-78e92537eb00 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:23.771117 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c80dc-f90e-4230-a541-78e92537eb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:23.771390 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c80dc-f90e-4230-a541-78e92537eb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:23.780814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c80dc-f90e-4230-a541-78e92537eb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:23.782274 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c80dc-f90e-4230-a541-78e92537eb00 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:23.791572 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1383/2731] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:24.055399 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27dedc-ad44-41f4-a0bf-29e26168bac7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:24.056958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7f27dedc-ad44-41f4-a0bf-29e26168bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:24.075171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27dedc-ad44-41f4-a0bf-29e26168bac7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:24.079973 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:24.080621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:24.080922 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:24.081285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] PATH_INFO: `/v3/projects/eedbfa571eba48c9bb0bfd76c6b064f4` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:24.082389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eedbfa571eba48c9bb0bfd76c6b064f4)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:24.084264 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:24.131233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eedbfa571eba48c9bb0bfd76c6b064f4', 'request_id': 'req-ded753a9-1422-429b-9643-efd1873d27b9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.135082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:24.137626 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eedbfa571eba48c9bb0bfd76c6b064f4', 'request_id': 'req-ded753a9-1422-429b-9643-efd1873d27b9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.145336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eedbfa571eba48c9bb0bfd76c6b064f4', 'request_id': 'req-ded753a9-1422-429b-9643-efd1873d27b9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.156126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] The token cache is being invalidate because project eedbfa571eba48c9bb0bfd76c6b064f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:24.156417 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.157078 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.158585 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1349/2732] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:24 2022] DELETE /identity/v3/projects/eedbfa571eba48c9bb0bfd76c6b064f4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:24.162560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c80dc-f90e-4230-a541-78e92537eb00 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:24.172516 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c80dc-f90e-4230-a541-78e92537eb00 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:24.228417 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49c480-4533-4640-9f38-47292ccbc315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:24.229084 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49c480-4533-4640-9f38-47292ccbc315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:24.229361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49c480-4533-4640-9f38-47292ccbc315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:24.229632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49c480-4533-4640-9f38-47292ccbc315 admin admin] PATH_INFO: `/v3/users/c402107d479e4abc928861a15d706a72` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:24.230775 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49c480-4533-4640-9f38-47292ccbc315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c402107d479e4abc928861a15d706a72)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:24.233528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49c480-4533-4640-9f38-47292ccbc315 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:24.285791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9c49c480-4533-4640-9f38-47292ccbc315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c402107d479e4abc928861a15d706a72'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.287896 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:24.302362 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9c49c480-4533-4640-9f38-47292ccbc315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c402107d479e4abc928861a15d706a72'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.303210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9c49c480-4533-4640-9f38-47292ccbc315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c402107d479e4abc928861a15d706a72'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.303798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9c49c480-4533-4640-9f38-47292ccbc315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c402107d479e4abc928861a15d706a72'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.313147 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9c49c480-4533-4640-9f38-47292ccbc315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c402107d479e4abc928861a15d706a72'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.326860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1384/2733] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:24 2022] DELETE /identity/v3/users/c402107d479e4abc928861a15d706a72 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:24.612100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:24.613920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:24.627491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded753a9-1422-429b-9643-efd1873d27b9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:24.687818 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f0c5a-1e85-4edc-a0e7-79c55e367c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:24.688382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f0c5a-1e85-4edc-a0e7-79c55e367c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:24.688669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f0c5a-1e85-4edc-a0e7-79c55e367c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:24.688978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f0c5a-1e85-4edc-a0e7-79c55e367c27 admin admin] PATH_INFO: `/v3/projects/56a4794b30054dbe99e06593e171cfa8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:24.690140 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f0c5a-1e85-4edc-a0e7-79c55e367c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a4794b30054dbe99e06593e171cfa8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:24.692031 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f0c5a-1e85-4edc-a0e7-79c55e367c27 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:24.741686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-237f0c5a-1e85-4edc-a0e7-79c55e367c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a4794b30054dbe99e06593e171cfa8', 'request_id': 'req-237f0c5a-1e85-4edc-a0e7-79c55e367c27'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.747156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-237f0c5a-1e85-4edc-a0e7-79c55e367c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a4794b30054dbe99e06593e171cfa8', 'request_id': 'req-237f0c5a-1e85-4edc-a0e7-79c55e367c27'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.754720 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-237f0c5a-1e85-4edc-a0e7-79c55e367c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a4794b30054dbe99e06593e171cfa8', 'request_id': 'req-237f0c5a-1e85-4edc-a0e7-79c55e367c27'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.766478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-237f0c5a-1e85-4edc-a0e7-79c55e367c27 admin admin] The token cache is being invalidate because project 56a4794b30054dbe99e06593e171cfa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:24.766767 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-237f0c5a-1e85-4edc-a0e7-79c55e367c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.767393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-237f0c5a-1e85-4edc-a0e7-79c55e367c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:24.768895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1350/2734] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:24 2022] DELETE /identity/v3/projects/56a4794b30054dbe99e06593e171cfa8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:24.773801 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227d981-4cd9-4f34-97b8-72128dc9d583 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:24.774276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227d981-4cd9-4f34-97b8-72128dc9d583 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:24.774401 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227d981-4cd9-4f34-97b8-72128dc9d583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:24.794165 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f227d981-4cd9-4f34-97b8-72128dc9d583 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:24.795365 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f227d981-4cd9-4f34-97b8-72128dc9d583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:24.853150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1385/2735] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:24.861338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212526d4-3d7d-4ba6-b662-5cc15b514580 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:24.861622 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212526d4-3d7d-4ba6-b662-5cc15b514580 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:24.861896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212526d4-3d7d-4ba6-b662-5cc15b514580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:24.881645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-212526d4-3d7d-4ba6-b662-5cc15b514580 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:24.882854 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-212526d4-3d7d-4ba6-b662-5cc15b514580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:24.891884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1351/2736] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:24.896187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227d981-4cd9-4f34-97b8-72128dc9d583 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:24.906248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227d981-4cd9-4f34-97b8-72128dc9d583 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:24.910922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec49893-af6d-4f29-8994-cacf519e87de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:24.911522 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec49893-af6d-4f29-8994-cacf519e87de admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:24.911803 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec49893-af6d-4f29-8994-cacf519e87de admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:24.912079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec49893-af6d-4f29-8994-cacf519e87de admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:24.912766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec49893-af6d-4f29-8994-cacf519e87de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:42:24.913100 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec49893-af6d-4f29-8994-cacf519e87de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:24.914665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec49893-af6d-4f29-8994-cacf519e87de admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:24.926426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1386/2737] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:42:24.930691 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212526d4-3d7d-4ba6-b662-5cc15b514580 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:24.941003 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212526d4-3d7d-4ba6-b662-5cc15b514580 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:24.945559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977be700-c9b1-4a7e-a1bf-f0dd11178812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:24.946172 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977be700-c9b1-4a7e-a1bf-f0dd11178812 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:24.946449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977be700-c9b1-4a7e-a1bf-f0dd11178812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:24.946720 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977be700-c9b1-4a7e-a1bf-f0dd11178812 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:24.947436 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977be700-c9b1-4a7e-a1bf-f0dd11178812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:24.949344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977be700-c9b1-4a7e-a1bf-f0dd11178812 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:24.975477 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1352/2738] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:24 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:24.979599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec49893-af6d-4f29-8994-cacf519e87de admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:24.990013 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec49893-af6d-4f29-8994-cacf519e87de admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:25.043794 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e0c95-28be-471e-b56d-800933dab7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:25.045206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e0c95-28be-471e-b56d-800933dab7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.045206 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e0c95-28be-471e-b56d-800933dab7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.045495 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e0c95-28be-471e-b56d-800933dab7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.046151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e0c95-28be-471e-b56d-800933dab7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:25.048074 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e0c95-28be-471e-b56d-800933dab7b1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:25.069461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1387/2739] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:24 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:42:25.073569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977be700-c9b1-4a7e-a1bf-f0dd11178812 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:25.084191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977be700-c9b1-4a7e-a1bf-f0dd11178812 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:25.089106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef23c3-1fa2-4791-bdc3-ec27f4a77fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:25.089711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef23c3-1fa2-4791-bdc3-ec27f4a77fae admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.089989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef23c3-1fa2-4791-bdc3-ec27f4a77fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.090258 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef23c3-1fa2-4791-bdc3-ec27f4a77fae admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.090941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef23c3-1fa2-4791-bdc3-ec27f4a77fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:25.093268 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef23c3-1fa2-4791-bdc3-ec27f4a77fae admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:25.103186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1353/2740] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:25.107747 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e0c95-28be-471e-b56d-800933dab7b1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:25.117695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e0c95-28be-471e-b56d-800933dab7b1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:25.122177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b23a26-3827-4e3c-b0a5-ab26a6f02452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:25.122813 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b23a26-3827-4e3c-b0a5-ab26a6f02452 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.123091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b23a26-3827-4e3c-b0a5-ab26a6f02452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.123364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b23a26-3827-4e3c-b0a5-ab26a6f02452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.124082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b23a26-3827-4e3c-b0a5-ab26a6f02452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:25.125680 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b23a26-3827-4e3c-b0a5-ab26a6f02452 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:25.136144 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1388/2741] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:25.140485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef23c3-1fa2-4791-bdc3-ec27f4a77fae admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:25.150423 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef23c3-1fa2-4791-bdc3-ec27f4a77fae admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:25.155685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4e307-47b0-478d-b610-158078ac4254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:25.156332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4e307-47b0-478d-b610-158078ac4254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.156615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4e307-47b0-478d-b610-158078ac4254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.156892 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4e307-47b0-478d-b610-158078ac4254 admin admin] PATH_INFO: `/v3/projects/9343c52990ac474083be63c8252cd4a9/users/1d0c11b8448b4c819a8de0364da18f32/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.172303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4e307-47b0-478d-b610-158078ac4254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9343c52990ac474083be63c8252cd4a9, user_id=1d0c11b8448b4c819a8de0364da18f32, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:25.174960 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4e307-47b0-478d-b610-158078ac4254 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:25.189095 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1354/2742] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:25 2022] PUT /identity/v3/projects/9343c52990ac474083be63c8252cd4a9/users/1d0c11b8448b4c819a8de0364da18f32/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:25.199180 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d722d-6e20-4d17-b3af-b890a27c5bc2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.199421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d722d-6e20-4d17-b3af-b890a27c5bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.199724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d722d-6e20-4d17-b3af-b890a27c5bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.227338 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ba7d722d-6e20-4d17-b3af-b890a27c5bc2 None None] MFA Rules not processed for user `1d0c11b8448b4c819a8de0364da18f32`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:25.228549 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ba7d722d-6e20-4d17-b3af-b890a27c5bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:25.249429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:25.294716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1389/2743] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:25.299223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4e307-47b0-478d-b610-158078ac4254 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:25.308924 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:25.361898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4e307-47b0-478d-b610-158078ac4254 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:25.368090 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d893b9-4209-401e-956c-84b1a4f1b422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:25.368845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d893b9-4209-401e-956c-84b1a4f1b422 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.369163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d893b9-4209-401e-956c-84b1a4f1b422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.369444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d893b9-4209-401e-956c-84b1a4f1b422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.370112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d893b9-4209-401e-956c-84b1a4f1b422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:25.372013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d893b9-4209-401e-956c-84b1a4f1b422 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:25.378844 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d722d-6e20-4d17-b3af-b890a27c5bc2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:25.380211 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ba7d722d-6e20-4d17-b3af-b890a27c5bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:25.394619 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d722d-6e20-4d17-b3af-b890a27c5bc2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:25.399191 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2297bdd-1d40-444e-8883-5382cdc1a612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:25.399828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2297bdd-1d40-444e-8883-5382cdc1a612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.400110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2297bdd-1d40-444e-8883-5382cdc1a612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.400387 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2297bdd-1d40-444e-8883-5382cdc1a612 admin admin] PATH_INFO: `/v3/users/5014a0883b4746aea562dd20adf763d4` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.401546 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1355/2744] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:25 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:25.401772 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2297bdd-1d40-444e-8883-5382cdc1a612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5014a0883b4746aea562dd20adf763d4)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:25.403544 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2297bdd-1d40-444e-8883-5382cdc1a612 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:25.405603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d893b9-4209-401e-956c-84b1a4f1b422 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:25.453150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a2297bdd-1d40-444e-8883-5382cdc1a612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5014a0883b4746aea562dd20adf763d4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:25.465071 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a2297bdd-1d40-444e-8883-5382cdc1a612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5014a0883b4746aea562dd20adf763d4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:25.465773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a2297bdd-1d40-444e-8883-5382cdc1a612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5014a0883b4746aea562dd20adf763d4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:25.466433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a2297bdd-1d40-444e-8883-5382cdc1a612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5014a0883b4746aea562dd20adf763d4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:25.469358 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d893b9-4209-401e-956c-84b1a4f1b422 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:25.474082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a2297bdd-1d40-444e-8883-5382cdc1a612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5014a0883b4746aea562dd20adf763d4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:25.474864 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8bd69-110f-4ded-a170-1a13ac5e8078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:25.475640 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8bd69-110f-4ded-a170-1a13ac5e8078 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.476316 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8bd69-110f-4ded-a170-1a13ac5e8078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.476316 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8bd69-110f-4ded-a170-1a13ac5e8078 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.477179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8bd69-110f-4ded-a170-1a13ac5e8078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:25.479215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8bd69-110f-4ded-a170-1a13ac5e8078 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:25.487601 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1390/2745] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:25 2022] DELETE /identity/v3/users/5014a0883b4746aea562dd20adf763d4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:25.491926 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d26b-36d1-44db-a39d-c7d31227ecbe None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.492479 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d26b-36d1-44db-a39d-c7d31227ecbe None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.492479 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d26b-36d1-44db-a39d-c7d31227ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.506973 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1356/2746] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:25 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:25.508233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8bd69-110f-4ded-a170-1a13ac5e8078 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:25.510149 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f5f8bd69-110f-4ded-a170-1a13ac5e8078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:25.512402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9575d26b-36d1-44db-a39d-c7d31227ecbe None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:25.513751 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9575d26b-36d1-44db-a39d-c7d31227ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:25.522475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8bd69-110f-4ded-a170-1a13ac5e8078 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:25.573635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1391/2747] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:25.581425 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b04e3-c04b-4559-875f-7024214fe5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:25.582047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b04e3-c04b-4559-875f-7024214fe5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.582326 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b04e3-c04b-4559-875f-7024214fe5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.582598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b04e3-c04b-4559-875f-7024214fe5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.583297 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b04e3-c04b-4559-875f-7024214fe5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:25.583938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d26b-36d1-44db-a39d-c7d31227ecbe None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:25.584925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b04e3-c04b-4559-875f-7024214fe5c9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:25.585304 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9575d26b-36d1-44db-a39d-c7d31227ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:25.598589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1357/2748] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:42:25.599583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b04e3-c04b-4559-875f-7024214fe5c9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:25.609925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b04e3-c04b-4559-875f-7024214fe5c9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:25.614761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899604d6-dca5-45a4-b67d-ff389b60ad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:25.615464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899604d6-dca5-45a4-b67d-ff389b60ad8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.615779 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899604d6-dca5-45a4-b67d-ff389b60ad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.616062 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899604d6-dca5-45a4-b67d-ff389b60ad8e admin admin] PATH_INFO: `/v3/projects/945690987fd64e95ba064c301f0a4a08/users/bd9d6c2e416240dfafc58e7a961efc5d/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.626288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:25.631997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899604d6-dca5-45a4-b67d-ff389b60ad8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=945690987fd64e95ba064c301f0a4a08, user_id=bd9d6c2e416240dfafc58e7a961efc5d, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:25.634796 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899604d6-dca5-45a4-b67d-ff389b60ad8e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:25.638687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:25.646757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d26b-36d1-44db-a39d-c7d31227ecbe None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:25.653099 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1358/2749] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:25 2022] PUT /identity/v3/projects/945690987fd64e95ba064c301f0a4a08/users/bd9d6c2e416240dfafc58e7a961efc5d/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:25.657197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899604d6-dca5-45a4-b67d-ff389b60ad8e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:25.697470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef446893-1502-43a2-b5cf-5194e9e65a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:25.698096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef446893-1502-43a2-b5cf-5194e9e65a7d service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.698376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef446893-1502-43a2-b5cf-5194e9e65a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.698981 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef446893-1502-43a2-b5cf-5194e9e65a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.718947 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899604d6-dca5-45a4-b67d-ff389b60ad8e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:25.724068 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee471a9-300c-44ee-b447-ccebf96ae0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:25.724686 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee471a9-300c-44ee-b447-ccebf96ae0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.724992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee471a9-300c-44ee-b447-ccebf96ae0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.725273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee471a9-300c-44ee-b447-ccebf96ae0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.725997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee471a9-300c-44ee-b447-ccebf96ae0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:25.727577 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee471a9-300c-44ee-b447-ccebf96ae0e0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:25.738237 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1359/2750] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:42:25.742299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee471a9-300c-44ee-b447-ccebf96ae0e0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:25.753517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee471a9-300c-44ee-b447-ccebf96ae0e0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:25.758126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0584f-21bd-47d9-894b-0a1221e069c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:25.758777 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0584f-21bd-47d9-894b-0a1221e069c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.759061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0584f-21bd-47d9-894b-0a1221e069c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.759337 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0584f-21bd-47d9-894b-0a1221e069c3 admin admin] PATH_INFO: `/v3/projects/945690987fd64e95ba064c301f0a4a08/users/bd9d6c2e416240dfafc58e7a961efc5d/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.761799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0584f-21bd-47d9-894b-0a1221e069c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945690987fd64e95ba064c301f0a4a08, user_id=bd9d6c2e416240dfafc58e7a961efc5d, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:25.763568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef446893-1502-43a2-b5cf-5194e9e65a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:25.765067 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef446893-1502-43a2-b5cf-5194e9e65a7d service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:25.765186 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0584f-21bd-47d9-894b-0a1221e069c3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:25.774773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1392/2751] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:42:25.775269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1360/2752] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:25 2022] PUT /identity/v3/projects/945690987fd64e95ba064c301f0a4a08/users/bd9d6c2e416240dfafc58e7a961efc5d/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:25.844057 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095163cb-a584-4f9d-84f4-20318e095e7b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:25.844346 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095163cb-a584-4f9d-84f4-20318e095e7b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:25.844623 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095163cb-a584-4f9d-84f4-20318e095e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:25.875020 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-095163cb-a584-4f9d-84f4-20318e095e7b None None] MFA Rules not processed for user `bd9d6c2e416240dfafc58e7a961efc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:25.876296 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-095163cb-a584-4f9d-84f4-20318e095e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:25.954763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1393/2753] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:25.965625 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0584f-21bd-47d9-894b-0a1221e069c3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:25.968157 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bdf0584f-21bd-47d9-894b-0a1221e069c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:26.027293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0584f-21bd-47d9-894b-0a1221e069c3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:26.032210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54133917-75fb-4f69-a6b3-9535f1bd89dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:26.032840 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133917-75fb-4f69-a6b3-9535f1bd89dd service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.033191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133917-75fb-4f69-a6b3-9535f1bd89dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.033434 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133917-75fb-4f69-a6b3-9535f1bd89dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.043664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54133917-75fb-4f69-a6b3-9535f1bd89dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:26.046080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54133917-75fb-4f69-a6b3-9535f1bd89dd service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:26.058624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1361/2754] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:26.060151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095163cb-a584-4f9d-84f4-20318e095e7b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:26.061988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-095163cb-a584-4f9d-84f4-20318e095e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:26.112637 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:26.151273 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095163cb-a584-4f9d-84f4-20318e095e7b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:26.158381 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f45e7e-b168-4e83-a837-7f8658d7d079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:26.159020 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f45e7e-b168-4e83-a837-7f8658d7d079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.159297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f45e7e-b168-4e83-a837-7f8658d7d079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.159570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f45e7e-b168-4e83-a837-7f8658d7d079 admin admin] PATH_INFO: `/v3/projects/9ec1ae14eda04cf282fde29bf768f2b4` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.160739 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f45e7e-b168-4e83-a837-7f8658d7d079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec1ae14eda04cf282fde29bf768f2b4)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:26.162648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f45e7e-b168-4e83-a837-7f8658d7d079 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:26.210906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-78f45e7e-b168-4e83-a837-7f8658d7d079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec1ae14eda04cf282fde29bf768f2b4', 'request_id': 'req-78f45e7e-b168-4e83-a837-7f8658d7d079'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:26.217196 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-78f45e7e-b168-4e83-a837-7f8658d7d079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec1ae14eda04cf282fde29bf768f2b4', 'request_id': 'req-78f45e7e-b168-4e83-a837-7f8658d7d079'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:26.225284 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-78f45e7e-b168-4e83-a837-7f8658d7d079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec1ae14eda04cf282fde29bf768f2b4', 'request_id': 'req-78f45e7e-b168-4e83-a837-7f8658d7d079'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:26.239650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-78f45e7e-b168-4e83-a837-7f8658d7d079 admin admin] The token cache is being invalidate because project 9ec1ae14eda04cf282fde29bf768f2b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:26.239947 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-78f45e7e-b168-4e83-a837-7f8658d7d079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:26.240611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-78f45e7e-b168-4e83-a837-7f8658d7d079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:26.242306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1394/2755] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:26 2022] DELETE /identity/v3/projects/9ec1ae14eda04cf282fde29bf768f2b4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:26.247204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0840-98b1-474d-ad08-e9c9cd0303b4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.247569 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0840-98b1-474d-ad08-e9c9cd0303b4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.247882 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0840-98b1-474d-ad08-e9c9cd0303b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.268664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a25e0840-98b1-474d-ad08-e9c9cd0303b4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:26.269886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a25e0840-98b1-474d-ad08-e9c9cd0303b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:26.331816 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1362/2756] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:26.339239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fece16-034e-4377-9bd3-00797edfbee9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.339555 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fece16-034e-4377-9bd3-00797edfbee9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.339836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fece16-034e-4377-9bd3-00797edfbee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.360040 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a0fece16-034e-4377-9bd3-00797edfbee9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:26.361584 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a0fece16-034e-4377-9bd3-00797edfbee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:26.370521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1395/2757] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:26.375419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0840-98b1-474d-ad08-e9c9cd0303b4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:26.386329 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0840-98b1-474d-ad08-e9c9cd0303b4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:26.391938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c68bf-a8e0-45a8-a3dc-99d1afb51eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:26.392278 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c68bf-a8e0-45a8-a3dc-99d1afb51eff admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.392563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c68bf-a8e0-45a8-a3dc-99d1afb51eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.392843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c68bf-a8e0-45a8-a3dc-99d1afb51eff admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.393586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c68bf-a8e0-45a8-a3dc-99d1afb51eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:42:26.393895 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c68bf-a8e0-45a8-a3dc-99d1afb51eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:26.395486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c68bf-a8e0-45a8-a3dc-99d1afb51eff admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:26.409209 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1363/2758] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:42:26.413525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fece16-034e-4377-9bd3-00797edfbee9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:26.423392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fece16-034e-4377-9bd3-00797edfbee9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:26.428859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d0969-43a4-41c3-ab1c-bb21ff2302ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:26.429500 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0969-43a4-41c3-ab1c-bb21ff2302ae admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.429808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0969-43a4-41c3-ab1c-bb21ff2302ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.430079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0969-43a4-41c3-ab1c-bb21ff2302ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.430752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d0969-43a4-41c3-ab1c-bb21ff2302ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:26.432625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d0969-43a4-41c3-ab1c-bb21ff2302ae admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:26.469828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1396/2759] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:26 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:26.471250 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c68bf-a8e0-45a8-a3dc-99d1afb51eff admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:26.482396 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c68bf-a8e0-45a8-a3dc-99d1afb51eff admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:26.487788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:26.542967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044ce97-d949-4a83-8bde-b292c4a54948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:26.543596 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044ce97-d949-4a83-8bde-b292c4a54948 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.543884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044ce97-d949-4a83-8bde-b292c4a54948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.544208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044ce97-d949-4a83-8bde-b292c4a54948 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.544889 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044ce97-d949-4a83-8bde-b292c4a54948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:26.549501 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044ce97-d949-4a83-8bde-b292c4a54948 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:26.574735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1364/2760] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:26 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:42:26.576859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d0969-43a4-41c3-ab1c-bb21ff2302ae admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:26.587258 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d0969-43a4-41c3-ab1c-bb21ff2302ae admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:26.592073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d2748-473f-4958-b8ef-5969be9d491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:26.592684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d2748-473f-4958-b8ef-5969be9d491b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.593001 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d2748-473f-4958-b8ef-5969be9d491b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.593286 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d2748-473f-4958-b8ef-5969be9d491b admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.593987 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d2748-473f-4958-b8ef-5969be9d491b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:26.595559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d2748-473f-4958-b8ef-5969be9d491b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:26.606774 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1397/2761] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:26.611060 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044ce97-d949-4a83-8bde-b292c4a54948 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:26.622826 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044ce97-d949-4a83-8bde-b292c4a54948 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:26.627665 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696dc4-f5f5-4424-8ecc-55ea96dc6b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:26.628647 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696dc4-f5f5-4424-8ecc-55ea96dc6b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.629097 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696dc4-f5f5-4424-8ecc-55ea96dc6b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.629484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696dc4-f5f5-4424-8ecc-55ea96dc6b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.630179 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25696dc4-f5f5-4424-8ecc-55ea96dc6b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:26.631763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25696dc4-f5f5-4424-8ecc-55ea96dc6b69 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:26.632171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d2748-473f-4958-b8ef-5969be9d491b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:26.633911 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1f5d2748-473f-4958-b8ef-5969be9d491b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:26.643350 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1365/2762] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:26.647389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d2748-473f-4958-b8ef-5969be9d491b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:26.647536 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696dc4-f5f5-4424-8ecc-55ea96dc6b69 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:26.652080 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019eb5f-4b1e-4073-b5db-89b4f6c02bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:26.652716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019eb5f-4b1e-4073-b5db-89b4f6c02bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.653035 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019eb5f-4b1e-4073-b5db-89b4f6c02bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.653324 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019eb5f-4b1e-4073-b5db-89b4f6c02bc9 admin admin] PATH_INFO: `/v3/users/1d0c11b8448b4c819a8de0364da18f32` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.655163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019eb5f-4b1e-4073-b5db-89b4f6c02bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0c11b8448b4c819a8de0364da18f32)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:26.657150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019eb5f-4b1e-4073-b5db-89b4f6c02bc9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:26.658012 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25696dc4-f5f5-4424-8ecc-55ea96dc6b69 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:26.662598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcda2f7-fd35-417c-9da9-f9d17b210100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:26.663233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcda2f7-fd35-417c-9da9-f9d17b210100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.663515 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcda2f7-fd35-417c-9da9-f9d17b210100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.663789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcda2f7-fd35-417c-9da9-f9d17b210100 admin admin] PATH_INFO: `/v3/projects/c0318c2e197548c1b99d73bdd61ef945/users/840b11bb4df547b0a3878750f6c496dc/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.679111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcda2f7-fd35-417c-9da9-f9d17b210100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0318c2e197548c1b99d73bdd61ef945, user_id=840b11bb4df547b0a3878750f6c496dc, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:26.682121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcda2f7-fd35-417c-9da9-f9d17b210100 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:26.695977 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1366/2763] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:26 2022] PUT /identity/v3/projects/c0318c2e197548c1b99d73bdd61ef945/users/840b11bb4df547b0a3878750f6c496dc/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:26.704494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6019eb5f-4b1e-4073-b5db-89b4f6c02bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0c11b8448b4c819a8de0364da18f32'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:26.709107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26a32a-62ae-442a-b8f1-a414629d9548 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.709278 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26a32a-62ae-442a-b8f1-a414629d9548 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.709563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26a32a-62ae-442a-b8f1-a414629d9548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.717556 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6019eb5f-4b1e-4073-b5db-89b4f6c02bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0c11b8448b4c819a8de0364da18f32'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:26.718277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6019eb5f-4b1e-4073-b5db-89b4f6c02bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0c11b8448b4c819a8de0364da18f32'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:26.718912 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6019eb5f-4b1e-4073-b5db-89b4f6c02bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0c11b8448b4c819a8de0364da18f32'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:26.726277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6019eb5f-4b1e-4073-b5db-89b4f6c02bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0c11b8448b4c819a8de0364da18f32'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:26.727511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:26.739809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4e26a32a-62ae-442a-b8f1-a414629d9548 None None] MFA Rules not processed for user `840b11bb4df547b0a3878750f6c496dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:26.740967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4e26a32a-62ae-442a-b8f1-a414629d9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:26.742069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1398/2764] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:26 2022] DELETE /identity/v3/users/1d0c11b8448b4c819a8de0364da18f32 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:26.746305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49c6c2-e033-4a56-91cb-8a7e1a4e20f5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.746590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49c6c2-e033-4a56-91cb-8a7e1a4e20f5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.746863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49c6c2-e033-4a56-91cb-8a7e1a4e20f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.767342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2f49c6c2-e033-4a56-91cb-8a7e1a4e20f5 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:26.768594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2f49c6c2-e033-4a56-91cb-8a7e1a4e20f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:26.807486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1367/2765] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:42:26.822579 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26a32a-62ae-442a-b8f1-a414629d9548 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:26.824018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4e26a32a-62ae-442a-b8f1-a414629d9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:26.831203 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1399/2766] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:42:26.841727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49c6c2-e033-4a56-91cb-8a7e1a4e20f5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:26.843102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2f49c6c2-e033-4a56-91cb-8a7e1a4e20f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:26.883183 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26a32a-62ae-442a-b8f1-a414629d9548 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:26.887712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6f6dc-0312-4b8f-82c1-47015ee68228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:26.889207 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6f6dc-0312-4b8f-82c1-47015ee68228 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.889492 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6f6dc-0312-4b8f-82c1-47015ee68228 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.889769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6f6dc-0312-4b8f-82c1-47015ee68228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.896820 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:26.900315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6f6dc-0312-4b8f-82c1-47015ee68228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:26.902511 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6f6dc-0312-4b8f-82c1-47015ee68228 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:26.902968 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49c6c2-e033-4a56-91cb-8a7e1a4e20f5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:26.907648 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a60e7-cd59-453f-a083-abeefd21a274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:26.908256 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a60e7-cd59-453f-a083-abeefd21a274 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:26.908544 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a60e7-cd59-453f-a083-abeefd21a274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:26.908814 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a60e7-cd59-453f-a083-abeefd21a274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:26.915103 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1368/2767] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:42:26.919812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a60e7-cd59-453f-a083-abeefd21a274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:26.921312 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a60e7-cd59-453f-a083-abeefd21a274 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:26.931244 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1400/2768] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:42:27.210791 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6f6dc-0312-4b8f-82c1-47015ee68228 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:27.213087 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-74e6f6dc-0312-4b8f-82c1-47015ee68228 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:27.248556 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6f6dc-0312-4b8f-82c1-47015ee68228 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:27.253985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:27.254633 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:27.254916 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:27.255195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] PATH_INFO: `/v3/projects/9343c52990ac474083be63c8252cd4a9` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:27.256639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9343c52990ac474083be63c8252cd4a9)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:27.258680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:27.311086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9343c52990ac474083be63c8252cd4a9', 'request_id': 'req-72123356-319f-4bfe-962f-5ef6986bb529'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.317513 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9343c52990ac474083be63c8252cd4a9', 'request_id': 'req-72123356-319f-4bfe-962f-5ef6986bb529'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.326667 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9343c52990ac474083be63c8252cd4a9', 'request_id': 'req-72123356-319f-4bfe-962f-5ef6986bb529'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.339454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] The token cache is being invalidate because project 9343c52990ac474083be63c8252cd4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:27.339750 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.340487 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.343034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1369/2769] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:27 2022] DELETE /identity/v3/projects/9343c52990ac474083be63c8252cd4a9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:27.347082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a60e7-cd59-453f-a083-abeefd21a274 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:27.357560 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a60e7-cd59-453f-a083-abeefd21a274 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:27.422668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e019ecc-aafd-4732-9101-2078519e98f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:27.423350 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e019ecc-aafd-4732-9101-2078519e98f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:27.423644 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e019ecc-aafd-4732-9101-2078519e98f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:27.423945 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e019ecc-aafd-4732-9101-2078519e98f7 admin admin] PATH_INFO: `/v3/users/bd9d6c2e416240dfafc58e7a961efc5d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:27.425160 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e019ecc-aafd-4732-9101-2078519e98f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9d6c2e416240dfafc58e7a961efc5d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:27.427173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e019ecc-aafd-4732-9101-2078519e98f7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:27.463146 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:27.474388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e019ecc-aafd-4732-9101-2078519e98f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9d6c2e416240dfafc58e7a961efc5d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.486859 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e019ecc-aafd-4732-9101-2078519e98f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9d6c2e416240dfafc58e7a961efc5d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.487552 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e019ecc-aafd-4732-9101-2078519e98f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9d6c2e416240dfafc58e7a961efc5d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.488160 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e019ecc-aafd-4732-9101-2078519e98f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9d6c2e416240dfafc58e7a961efc5d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.495277 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e019ecc-aafd-4732-9101-2078519e98f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9d6c2e416240dfafc58e7a961efc5d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.507778 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1401/2770] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:27 2022] DELETE /identity/v3/users/bd9d6c2e416240dfafc58e7a961efc5d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:27.780761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:27.782266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:27.795466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72123356-319f-4bfe-962f-5ef6986bb529 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:27.853981 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817308f-b66d-4bbc-a553-ce31274ec42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:27.854621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817308f-b66d-4bbc-a553-ce31274ec42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:27.854899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817308f-b66d-4bbc-a553-ce31274ec42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:27.855171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817308f-b66d-4bbc-a553-ce31274ec42a admin admin] PATH_INFO: `/v3/projects/945690987fd64e95ba064c301f0a4a08` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:27.856420 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817308f-b66d-4bbc-a553-ce31274ec42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=945690987fd64e95ba064c301f0a4a08)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:27.858351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817308f-b66d-4bbc-a553-ce31274ec42a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:27.905109 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5817308f-b66d-4bbc-a553-ce31274ec42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945690987fd64e95ba064c301f0a4a08', 'request_id': 'req-5817308f-b66d-4bbc-a553-ce31274ec42a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.910528 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5817308f-b66d-4bbc-a553-ce31274ec42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945690987fd64e95ba064c301f0a4a08', 'request_id': 'req-5817308f-b66d-4bbc-a553-ce31274ec42a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.917222 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5817308f-b66d-4bbc-a553-ce31274ec42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945690987fd64e95ba064c301f0a4a08', 'request_id': 'req-5817308f-b66d-4bbc-a553-ce31274ec42a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.928700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5817308f-b66d-4bbc-a553-ce31274ec42a admin admin] The token cache is being invalidate because project 945690987fd64e95ba064c301f0a4a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:27.929027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5817308f-b66d-4bbc-a553-ce31274ec42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.929658 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5817308f-b66d-4bbc-a553-ce31274ec42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:27.931471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1370/2771] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:27 2022] DELETE /identity/v3/projects/945690987fd64e95ba064c301f0a4a08 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:27.936938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afbbad-ec0e-4926-8597-cbc9670ed06c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:27.937427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afbbad-ec0e-4926-8597-cbc9670ed06c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:27.937568 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afbbad-ec0e-4926-8597-cbc9670ed06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:27.957670 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-90afbbad-ec0e-4926-8597-cbc9670ed06c None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:27.958864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-90afbbad-ec0e-4926-8597-cbc9670ed06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:28.022317 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1402/2772] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:42:28.030980 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2889-313d-4277-978c-aa4c4b48996d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:28.031334 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2889-313d-4277-978c-aa4c4b48996d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:28.031781 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2889-313d-4277-978c-aa4c4b48996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:28.051693 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f42c2889-313d-4277-978c-aa4c4b48996d None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:28.052921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f42c2889-313d-4277-978c-aa4c4b48996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:28.061440 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1371/2773] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:28.065761 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afbbad-ec0e-4926-8597-cbc9670ed06c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:28.076088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afbbad-ec0e-4926-8597-cbc9670ed06c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:28.080656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b453d-608f-48ea-830e-2d9b4d0e4672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:28.081307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b453d-608f-48ea-830e-2d9b4d0e4672 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:28.081590 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b453d-608f-48ea-830e-2d9b4d0e4672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:28.081867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b453d-608f-48ea-830e-2d9b4d0e4672 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:28.082570 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b453d-608f-48ea-830e-2d9b4d0e4672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:42:28.082877 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b453d-608f-48ea-830e-2d9b4d0e4672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:28.084505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b453d-608f-48ea-830e-2d9b4d0e4672 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:28.096543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1403/2774] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:42:28.104878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2889-313d-4277-978c-aa4c4b48996d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:28.110413 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:28.116198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2889-313d-4277-978c-aa4c4b48996d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:28.122240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bbe67-7301-4a2a-b7df-157f99495b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:28.122948 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bbe67-7301-4a2a-b7df-157f99495b6e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:28.123398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bbe67-7301-4a2a-b7df-157f99495b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:28.123672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bbe67-7301-4a2a-b7df-157f99495b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:28.124345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bbe67-7301-4a2a-b7df-157f99495b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:28.126344 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bbe67-7301-4a2a-b7df-157f99495b6e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:28.154726 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1372/2775] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:28 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:28.158783 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b453d-608f-48ea-830e-2d9b4d0e4672 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:28.168552 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b453d-608f-48ea-830e-2d9b4d0e4672 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:28.224871 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5935534-5864-4062-a34c-65fe0b143e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:28.225523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5935534-5864-4062-a34c-65fe0b143e68 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:28.225831 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5935534-5864-4062-a34c-65fe0b143e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:28.226106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5935534-5864-4062-a34c-65fe0b143e68 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:28.226778 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5935534-5864-4062-a34c-65fe0b143e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:28.228684 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5935534-5864-4062-a34c-65fe0b143e68 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:28.249865 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1404/2776] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:28 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:28.254267 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bbe67-7301-4a2a-b7df-157f99495b6e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:28.264571 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bbe67-7301-4a2a-b7df-157f99495b6e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:28.269239 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ef950-d3ba-4b69-a711-c2e0cbed41da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:28.269839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ef950-d3ba-4b69-a711-c2e0cbed41da admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:28.270123 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ef950-d3ba-4b69-a711-c2e0cbed41da admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:28.270399 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ef950-d3ba-4b69-a711-c2e0cbed41da admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:28.271093 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ef950-d3ba-4b69-a711-c2e0cbed41da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:28.272672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ef950-d3ba-4b69-a711-c2e0cbed41da admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:28.283061 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1373/2777] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:42:28.286867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5935534-5864-4062-a34c-65fe0b143e68 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:28.296855 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5935534-5864-4062-a34c-65fe0b143e68 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:28.301337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a4328-a8a9-43a0-ac4c-5b86d66c3464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:28.301928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a4328-a8a9-43a0-ac4c-5b86d66c3464 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:28.302207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a4328-a8a9-43a0-ac4c-5b86d66c3464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:28.302478 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a4328-a8a9-43a0-ac4c-5b86d66c3464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:28.303197 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a4328-a8a9-43a0-ac4c-5b86d66c3464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:28.304750 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a4328-a8a9-43a0-ac4c-5b86d66c3464 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:28.315644 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1405/2778] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:28.319604 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ef950-d3ba-4b69-a711-c2e0cbed41da admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:28.330517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ef950-d3ba-4b69-a711-c2e0cbed41da admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:28.335112 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bfa0f-6820-4727-88e7-808d1ad53413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:28.335767 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bfa0f-6820-4727-88e7-808d1ad53413 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:28.336049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bfa0f-6820-4727-88e7-808d1ad53413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:28.336326 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bfa0f-6820-4727-88e7-808d1ad53413 admin admin] PATH_INFO: `/v3/projects/ef38ec42744f422b8df435e1efa8ba31/users/d3306cd6082043a8bb700a748b056a1e/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:28.350806 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bfa0f-6820-4727-88e7-808d1ad53413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef38ec42744f422b8df435e1efa8ba31, user_id=d3306cd6082043a8bb700a748b056a1e, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:28.353469 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bfa0f-6820-4727-88e7-808d1ad53413 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:28.367024 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1374/2779] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:28 2022] PUT /identity/v3/projects/ef38ec42744f422b8df435e1efa8ba31/users/d3306cd6082043a8bb700a748b056a1e/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:28.377695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcd850-5230-41ce-8505-bffd352b65fc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:28.378319 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcd850-5230-41ce-8505-bffd352b65fc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:28.378679 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcd850-5230-41ce-8505-bffd352b65fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:28.408305 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d4fcd850-5230-41ce-8505-bffd352b65fc None None] MFA Rules not processed for user `d3306cd6082043a8bb700a748b056a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:28.409621 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d4fcd850-5230-41ce-8505-bffd352b65fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:28.414897 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:28.479376 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1406/2780] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:28.491421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bfa0f-6820-4727-88e7-808d1ad53413 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:28.493146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ff5bfa0f-6820-4727-88e7-808d1ad53413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:28.554171 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bfa0f-6820-4727-88e7-808d1ad53413 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:28.557886 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4972b1-dc2e-4446-b4a5-5c10cd17f056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:28.558508 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4972b1-dc2e-4446-b4a5-5c10cd17f056 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:28.558790 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4972b1-dc2e-4446-b4a5-5c10cd17f056 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:28.559087 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4972b1-dc2e-4446-b4a5-5c10cd17f056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:28.568736 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4972b1-dc2e-4446-b4a5-5c10cd17f056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:28.570581 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4972b1-dc2e-4446-b4a5-5c10cd17f056 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:28.580164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1375/2781] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:28.602311 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcd850-5230-41ce-8505-bffd352b65fc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:28.669551 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcd850-5230-41ce-8505-bffd352b65fc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:28.674185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:28.674819 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:28.675102 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:28.675382 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] PATH_INFO: `/v3/users/d3306cd6082043a8bb700a748b056a1e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:28.676547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3306cd6082043a8bb700a748b056a1e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:28.678491 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:28.723635 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3306cd6082043a8bb700a748b056a1e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:28.735829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3306cd6082043a8bb700a748b056a1e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:28.736541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3306cd6082043a8bb700a748b056a1e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:28.737183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3306cd6082043a8bb700a748b056a1e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:28.744262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3306cd6082043a8bb700a748b056a1e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:28.756569 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1407/2782] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:28 2022] DELETE /identity/v3/users/d3306cd6082043a8bb700a748b056a1e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:28.761335 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804b4aa-fdfb-40b8-8a56-cc771f082e54 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:28.761623 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804b4aa-fdfb-40b8-8a56-cc771f082e54 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:28.761900 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804b4aa-fdfb-40b8-8a56-cc771f082e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:28.781666 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b804b4aa-fdfb-40b8-8a56-cc771f082e54 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:28.782866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b804b4aa-fdfb-40b8-8a56-cc771f082e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:28.840758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1376/2783] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:28.850864 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:28.852293 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:28.884371 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:28.912832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116970b8-adad-40ea-aa6a-e2dddf8fd8a0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:28.916388 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fdd8f-385e-4a65-839f-4fba710e2d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:28.917027 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fdd8f-385e-4a65-839f-4fba710e2d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:28.917307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fdd8f-385e-4a65-839f-4fba710e2d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:28.917573 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fdd8f-385e-4a65-839f-4fba710e2d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:28.926867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fdd8f-385e-4a65-839f-4fba710e2d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:28.928550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31fdd8f-385e-4a65-839f-4fba710e2d35 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:28.939267 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1408/2784] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:29.211146 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804b4aa-fdfb-40b8-8a56-cc771f082e54 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:29.212709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b804b4aa-fdfb-40b8-8a56-cc771f082e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:29.230510 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804b4aa-fdfb-40b8-8a56-cc771f082e54 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:29.237196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65042400-7aa3-405d-bd9c-0d13df1f8c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:29.237843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65042400-7aa3-405d-bd9c-0d13df1f8c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:29.238175 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65042400-7aa3-405d-bd9c-0d13df1f8c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:29.238388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65042400-7aa3-405d-bd9c-0d13df1f8c81 admin admin] PATH_INFO: `/v3/projects/ef38ec42744f422b8df435e1efa8ba31` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:29.239638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65042400-7aa3-405d-bd9c-0d13df1f8c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef38ec42744f422b8df435e1efa8ba31)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:29.241603 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65042400-7aa3-405d-bd9c-0d13df1f8c81 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:29.284438 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:29.288479 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65042400-7aa3-405d-bd9c-0d13df1f8c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef38ec42744f422b8df435e1efa8ba31', 'request_id': 'req-65042400-7aa3-405d-bd9c-0d13df1f8c81'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:29.295763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65042400-7aa3-405d-bd9c-0d13df1f8c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef38ec42744f422b8df435e1efa8ba31', 'request_id': 'req-65042400-7aa3-405d-bd9c-0d13df1f8c81'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:29.302306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65042400-7aa3-405d-bd9c-0d13df1f8c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef38ec42744f422b8df435e1efa8ba31', 'request_id': 'req-65042400-7aa3-405d-bd9c-0d13df1f8c81'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:29.314407 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65042400-7aa3-405d-bd9c-0d13df1f8c81 admin admin] The token cache is being invalidate because project ef38ec42744f422b8df435e1efa8ba31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:29.314696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65042400-7aa3-405d-bd9c-0d13df1f8c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:29.315325 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-65042400-7aa3-405d-bd9c-0d13df1f8c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:29.316841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1377/2785] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:29 2022] DELETE /identity/v3/projects/ef38ec42744f422b8df435e1efa8ba31 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:31.941707 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fdd8f-385e-4a65-839f-4fba710e2d35 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:31.943099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e31fdd8f-385e-4a65-839f-4fba710e2d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:31.955511 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fdd8f-385e-4a65-839f-4fba710e2d35 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:32.009991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:32.010610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:32.010890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:32.011170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] PATH_INFO: `/v3/users/840b11bb4df547b0a3878750f6c496dc` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:32.012307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=840b11bb4df547b0a3878750f6c496dc)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:32.014283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:32.058840 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840b11bb4df547b0a3878750f6c496dc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:32.071523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840b11bb4df547b0a3878750f6c496dc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:32.072209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840b11bb4df547b0a3878750f6c496dc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:32.072810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840b11bb4df547b0a3878750f6c496dc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:32.079978 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840b11bb4df547b0a3878750f6c496dc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:32.095073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1409/2786] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:31 2022] DELETE /identity/v3/users/840b11bb4df547b0a3878750f6c496dc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:32.099754 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef890b8-792d-41fe-86f9-aa0cf36828ca None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:32.100230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef890b8-792d-41fe-86f9-aa0cf36828ca None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:32.100351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef890b8-792d-41fe-86f9-aa0cf36828ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:32.120349 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1ef890b8-792d-41fe-86f9-aa0cf36828ca None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:32.121613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1ef890b8-792d-41fe-86f9-aa0cf36828ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:32.179938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1378/2787] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:32.189752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:32.191189 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:32.244505 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:32.249136 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705716a-1f56-439f-84ff-3ff5c347f1f3 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:32.254038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbf4dd-31de-4901-b0e1-8abaf7ebb53e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:32.254688 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbf4dd-31de-4901-b0e1-8abaf7ebb53e service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:32.254975 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbf4dd-31de-4901-b0e1-8abaf7ebb53e service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:32.255337 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbf4dd-31de-4901-b0e1-8abaf7ebb53e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:32.265421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbf4dd-31de-4901-b0e1-8abaf7ebb53e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:32.266868 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbf4dd-31de-4901-b0e1-8abaf7ebb53e service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:32.276170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1410/2788] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:32.544230 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef890b8-792d-41fe-86f9-aa0cf36828ca None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:32.545904 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1ef890b8-792d-41fe-86f9-aa0cf36828ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:32.565538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef890b8-792d-41fe-86f9-aa0cf36828ca None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:32.570624 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:32.571277 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:32.571652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:32.571890 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] PATH_INFO: `/v3/projects/c0318c2e197548c1b99d73bdd61ef945` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:32.573084 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0318c2e197548c1b99d73bdd61ef945)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:32.575125 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:32.620654 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0318c2e197548c1b99d73bdd61ef945', 'request_id': 'req-1f92960e-d8a2-4368-985a-af887fca78ec'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:32.626943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0318c2e197548c1b99d73bdd61ef945', 'request_id': 'req-1f92960e-d8a2-4368-985a-af887fca78ec'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:32.635121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0318c2e197548c1b99d73bdd61ef945', 'request_id': 'req-1f92960e-d8a2-4368-985a-af887fca78ec'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:32.647248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] The token cache is being invalidate because project c0318c2e197548c1b99d73bdd61ef945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:32.647538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:32.648163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:32.649673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1379/2789] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:32 2022] DELETE /identity/v3/projects/c0318c2e197548c1b99d73bdd61ef945 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:42.272030 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:42.644286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:45.899408 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbf4dd-31de-4901-b0e1-8abaf7ebb53e service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:45.900829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e6fbf4dd-31de-4901-b0e1-8abaf7ebb53e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:45.912538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbf4dd-31de-4901-b0e1-8abaf7ebb53e service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:45.960334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5595ca-e8be-40ef-973e-ada4d587fa32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:45.960967 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5595ca-e8be-40ef-973e-ada4d587fa32 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:45.961256 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5595ca-e8be-40ef-973e-ada4d587fa32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:45.961533 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5595ca-e8be-40ef-973e-ada4d587fa32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:45.963336 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-be5595ca-e8be-40ef-973e-ada4d587fa32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:46.025973 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5595ca-e8be-40ef-973e-ada4d587fa32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:46.027467 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5595ca-e8be-40ef-973e-ada4d587fa32 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:46.037181 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1411/2790] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:49.138717 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:49.140346 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:49.159400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92960e-d8a2-4368-985a-af887fca78ec admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:49.164303 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f439987-bbd5-481e-90f5-e9bc7dc538a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:49.164884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f439987-bbd5-481e-90f5-e9bc7dc538a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:49.165217 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f439987-bbd5-481e-90f5-e9bc7dc538a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:49.165492 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f439987-bbd5-481e-90f5-e9bc7dc538a7 admin admin] PATH_INFO: `/v3/users/3a7f87ccbd674c54807786d55eba2a9a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:49.180557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f439987-bbd5-481e-90f5-e9bc7dc538a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7f87ccbd674c54807786d55eba2a9a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:49.182555 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f439987-bbd5-481e-90f5-e9bc7dc538a7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:49.229362 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f439987-bbd5-481e-90f5-e9bc7dc538a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7f87ccbd674c54807786d55eba2a9a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:49.236420 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f439987-bbd5-481e-90f5-e9bc7dc538a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7f87ccbd674c54807786d55eba2a9a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:49.248655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f439987-bbd5-481e-90f5-e9bc7dc538a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7f87ccbd674c54807786d55eba2a9a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:49.249371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f439987-bbd5-481e-90f5-e9bc7dc538a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7f87ccbd674c54807786d55eba2a9a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:49.249983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9f439987-bbd5-481e-90f5-e9bc7dc538a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7f87ccbd674c54807786d55eba2a9a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:49.262533 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1380/2791] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:49 2022] DELETE /identity/v3/users/3a7f87ccbd674c54807786d55eba2a9a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:49.433345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5595ca-e8be-40ef-973e-ada4d587fa32 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:49.444409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5595ca-e8be-40ef-973e-ada4d587fa32 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:49.507894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaf716-a2e2-4151-9c99-09e555463046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:49.508521 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaf716-a2e2-4151-9c99-09e555463046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:49.508800 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaf716-a2e2-4151-9c99-09e555463046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:49.509100 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaf716-a2e2-4151-9c99-09e555463046 admin admin] PATH_INFO: `/v3/projects/65bb2faca6e245e291774205a41a0cf8` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:49.519678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faaf716-a2e2-4151-9c99-09e555463046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65bb2faca6e245e291774205a41a0cf8)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:49.521596 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faaf716-a2e2-4151-9c99-09e555463046 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:49.564194 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:49.568008 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6faaf716-a2e2-4151-9c99-09e555463046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65bb2faca6e245e291774205a41a0cf8', 'request_id': 'req-6faaf716-a2e2-4151-9c99-09e555463046'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:49.573732 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6faaf716-a2e2-4151-9c99-09e555463046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65bb2faca6e245e291774205a41a0cf8', 'request_id': 'req-6faaf716-a2e2-4151-9c99-09e555463046'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:49.580922 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6faaf716-a2e2-4151-9c99-09e555463046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65bb2faca6e245e291774205a41a0cf8', 'request_id': 'req-6faaf716-a2e2-4151-9c99-09e555463046'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:49.592225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6faaf716-a2e2-4151-9c99-09e555463046 admin admin] The token cache is being invalidate because project 65bb2faca6e245e291774205a41a0cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:49.592513 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6faaf716-a2e2-4151-9c99-09e555463046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:49.593154 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6faaf716-a2e2-4151-9c99-09e555463046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:49.594633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1412/2792] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:49 2022] DELETE /identity/v3/projects/65bb2faca6e245e291774205a41a0cf8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:49.599447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55da0f3-4b85-417b-9c18-bc00945b4cd0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:49.599735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55da0f3-4b85-417b-9c18-bc00945b4cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:49.600038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55da0f3-4b85-417b-9c18-bc00945b4cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:49.619461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d55da0f3-4b85-417b-9c18-bc00945b4cd0 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:49.620649 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d55da0f3-4b85-417b-9c18-bc00945b4cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:49.678124 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1381/2793] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:49.686050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f652-143f-4f23-88d4-d6817d61b3ee None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:49.686334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f652-143f-4f23-88d4-d6817d61b3ee None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:49.686610 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f652-143f-4f23-88d4-d6817d61b3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:49.706298 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7396f652-143f-4f23-88d4-d6817d61b3ee None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:49.707543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7396f652-143f-4f23-88d4-d6817d61b3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:49.716375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1413/2794] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:49.720466 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55da0f3-4b85-417b-9c18-bc00945b4cd0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:49.730033 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55da0f3-4b85-417b-9c18-bc00945b4cd0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:49.734555 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653279-9964-48be-92f3-74931927d97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:49.735154 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653279-9964-48be-92f3-74931927d97c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:49.735436 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653279-9964-48be-92f3-74931927d97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:49.735712 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653279-9964-48be-92f3-74931927d97c admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:49.736404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84653279-9964-48be-92f3-74931927d97c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:42:49.736709 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84653279-9964-48be-92f3-74931927d97c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:49.738328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84653279-9964-48be-92f3-74931927d97c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:49.749690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1382/2795] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:42:49.754160 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396f652-143f-4f23-88d4-d6817d61b3ee None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:49.764195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396f652-143f-4f23-88d4-d6817d61b3ee None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:49.768810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3a341-cfe5-4ba4-a742-1e866f30872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:49.769447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3a341-cfe5-4ba4-a742-1e866f30872a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:49.769759 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3a341-cfe5-4ba4-a742-1e866f30872a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:49.770036 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3a341-cfe5-4ba4-a742-1e866f30872a admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:49.770697 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3a341-cfe5-4ba4-a742-1e866f30872a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:49.772578 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3a341-cfe5-4ba4-a742-1e866f30872a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:49.809129 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1414/2796] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:49 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:49.813240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653279-9964-48be-92f3-74931927d97c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:49.823336 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653279-9964-48be-92f3-74931927d97c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:49.867672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:49.881979 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4fbbc-db6a-4d64-880f-d1cb480ffe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:49.882591 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4fbbc-db6a-4d64-880f-d1cb480ffe14 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:49.882874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4fbbc-db6a-4d64-880f-d1cb480ffe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:49.883149 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4fbbc-db6a-4d64-880f-d1cb480ffe14 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:49.883819 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4fbbc-db6a-4d64-880f-d1cb480ffe14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:49.885733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4fbbc-db6a-4d64-880f-d1cb480ffe14 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:49.907733 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1383/2797] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:49 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:49.911809 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3a341-cfe5-4ba4-a742-1e866f30872a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:49.922091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3a341-cfe5-4ba4-a742-1e866f30872a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:49.926611 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284ec50-d12d-45b2-ae20-9a1994245ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:49.927212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284ec50-d12d-45b2-ae20-9a1994245ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:49.927490 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284ec50-d12d-45b2-ae20-9a1994245ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:49.927760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284ec50-d12d-45b2-ae20-9a1994245ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:49.928494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284ec50-d12d-45b2-ae20-9a1994245ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:49.930038 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284ec50-d12d-45b2-ae20-9a1994245ce0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:49.940593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1415/2798] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:49.944558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4fbbc-db6a-4d64-880f-d1cb480ffe14 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:49.954602 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4fbbc-db6a-4d64-880f-d1cb480ffe14 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:49.959231 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a94eb0-52e9-422b-95f2-309eecf731ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:49.959833 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a94eb0-52e9-422b-95f2-309eecf731ee admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:49.960120 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a94eb0-52e9-422b-95f2-309eecf731ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:49.960398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a94eb0-52e9-422b-95f2-309eecf731ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:49.961129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a94eb0-52e9-422b-95f2-309eecf731ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:49.962705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a94eb0-52e9-422b-95f2-309eecf731ee admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:49.973943 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1384/2799] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:49.977978 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284ec50-d12d-45b2-ae20-9a1994245ce0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:49.988366 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284ec50-d12d-45b2-ae20-9a1994245ce0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:49.992927 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a985001-03a9-487b-9f77-47c4e04e7542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:49.993594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a985001-03a9-487b-9f77-47c4e04e7542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:49.993876 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a985001-03a9-487b-9f77-47c4e04e7542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:49.994152 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a985001-03a9-487b-9f77-47c4e04e7542 admin admin] PATH_INFO: `/v3/projects/b2a6be29294341369c4f7eade56d8f8f/users/8371179488be4ba7ba4132bdcdfc036a/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:50.008791 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a985001-03a9-487b-9f77-47c4e04e7542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a6be29294341369c4f7eade56d8f8f, user_id=8371179488be4ba7ba4132bdcdfc036a, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:50.011432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a985001-03a9-487b-9f77-47c4e04e7542 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:50.024174 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1416/2800] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:49 2022] PUT /identity/v3/projects/b2a6be29294341369c4f7eade56d8f8f/users/8371179488be4ba7ba4132bdcdfc036a/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:50.035458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27f18-b4b0-44b0-97e8-b6ac0b5852b1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:50.035752 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27f18-b4b0-44b0-97e8-b6ac0b5852b1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:50.036062 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27f18-b4b0-44b0-97e8-b6ac0b5852b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:50.063868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-92d27f18-b4b0-44b0-97e8-b6ac0b5852b1 None None] MFA Rules not processed for user `8371179488be4ba7ba4132bdcdfc036a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:50.065113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-92d27f18-b4b0-44b0-97e8-b6ac0b5852b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:50.130520 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1385/2801] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:50.134960 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a985001-03a9-487b-9f77-47c4e04e7542 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:50.197781 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a985001-03a9-487b-9f77-47c4e04e7542 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:50.202894 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0b300-c54c-478e-9112-c50fba3554d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:50.203496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b300-c54c-478e-9112-c50fba3554d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:50.203773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b300-c54c-478e-9112-c50fba3554d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:50.204041 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b300-c54c-478e-9112-c50fba3554d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:50.204686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0b300-c54c-478e-9112-c50fba3554d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:50.206627 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0b300-c54c-478e-9112-c50fba3554d8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:50.234047 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1417/2802] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:50 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:50.238211 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27f18-b4b0-44b0-97e8-b6ac0b5852b1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:50.249439 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27f18-b4b0-44b0-97e8-b6ac0b5852b1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:50.307389 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7890c-ef50-4ce7-ab7d-8e4cefb1d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:50.308299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7890c-ef50-4ce7-ab7d-8e4cefb1d6aa admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:50.308299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7890c-ef50-4ce7-ab7d-8e4cefb1d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:50.309322 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7890c-ef50-4ce7-ab7d-8e4cefb1d6aa admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:50.309991 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7890c-ef50-4ce7-ab7d-8e4cefb1d6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:50.312049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7890c-ef50-4ce7-ab7d-8e4cefb1d6aa admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:50.333830 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1386/2803] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:50 2022] POST /identity/v3/users => generated 308 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:42:50.337785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0b300-c54c-478e-9112-c50fba3554d8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:50.348392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0b300-c54c-478e-9112-c50fba3554d8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:50.353489 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88102907-ecfd-4c1f-8787-77a078867634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:50.354177 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88102907-ecfd-4c1f-8787-77a078867634 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:50.354462 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88102907-ecfd-4c1f-8787-77a078867634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:50.354906 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88102907-ecfd-4c1f-8787-77a078867634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:50.356208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88102907-ecfd-4c1f-8787-77a078867634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:50.358091 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88102907-ecfd-4c1f-8787-77a078867634 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:50.369616 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1418/2804] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:50.373898 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7890c-ef50-4ce7-ab7d-8e4cefb1d6aa admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:50.384163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7890c-ef50-4ce7-ab7d-8e4cefb1d6aa admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:50.389315 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3952bb-5d71-4e82-8816-06b632b9dd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:50.389967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3952bb-5d71-4e82-8816-06b632b9dd1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:50.390248 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3952bb-5d71-4e82-8816-06b632b9dd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:50.390525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3952bb-5d71-4e82-8816-06b632b9dd1d admin admin] PATH_INFO: `/v3/projects/fdb84f65eb3545c49f672b9f802bdfd2/users/79d57ea377fd44ccaaf4eeb09e29603c/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:50.406763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3952bb-5d71-4e82-8816-06b632b9dd1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb84f65eb3545c49f672b9f802bdfd2, user_id=79d57ea377fd44ccaaf4eeb09e29603c, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:50.409419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3952bb-5d71-4e82-8816-06b632b9dd1d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:50.422257 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1387/2805] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:50 2022] PUT /identity/v3/projects/fdb84f65eb3545c49f672b9f802bdfd2/users/79d57ea377fd44ccaaf4eeb09e29603c/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:50.426112 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88102907-ecfd-4c1f-8787-77a078867634 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:50.436811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88102907-ecfd-4c1f-8787-77a078867634 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:50.465766 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:50.493604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40598f6c-4e91-4116-a21b-e32dae0e43ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:50.494214 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40598f6c-4e91-4116-a21b-e32dae0e43ef admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:50.494494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40598f6c-4e91-4116-a21b-e32dae0e43ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:50.494765 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40598f6c-4e91-4116-a21b-e32dae0e43ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:50.495453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40598f6c-4e91-4116-a21b-e32dae0e43ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:50.497715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40598f6c-4e91-4116-a21b-e32dae0e43ef admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:50.507517 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1419/2806] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:50.512180 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3952bb-5d71-4e82-8816-06b632b9dd1d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:50.522166 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3952bb-5d71-4e82-8816-06b632b9dd1d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:50.526677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ebf1a-146d-44ad-bfb3-5a6157467e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:50.529101 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ebf1a-146d-44ad-bfb3-5a6157467e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:50.529391 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ebf1a-146d-44ad-bfb3-5a6157467e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:50.529671 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ebf1a-146d-44ad-bfb3-5a6157467e23 admin admin] PATH_INFO: `/v3/projects/fdb84f65eb3545c49f672b9f802bdfd2/users/79d57ea377fd44ccaaf4eeb09e29603c/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:50.531621 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ebf1a-146d-44ad-bfb3-5a6157467e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb84f65eb3545c49f672b9f802bdfd2, user_id=79d57ea377fd44ccaaf4eeb09e29603c, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:50.534270 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ebf1a-146d-44ad-bfb3-5a6157467e23 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:50.544657 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1388/2807] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:50 2022] PUT /identity/v3/projects/fdb84f65eb3545c49f672b9f802bdfd2/users/79d57ea377fd44ccaaf4eeb09e29603c/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:50.556081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641779d4-fe81-4ac2-8aab-2f00405bb4a2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:50.556405 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641779d4-fe81-4ac2-8aab-2f00405bb4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:50.556683 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641779d4-fe81-4ac2-8aab-2f00405bb4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:50.584744 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-641779d4-fe81-4ac2-8aab-2f00405bb4a2 None None] MFA Rules not processed for user `79d57ea377fd44ccaaf4eeb09e29603c`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:50.586060 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-641779d4-fe81-4ac2-8aab-2f00405bb4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:50.654900 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1420/2808] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:50 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:50.665464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ebf1a-146d-44ad-bfb3-5a6157467e23 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:50.667204 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-559ebf1a-146d-44ad-bfb3-5a6157467e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:50.677907 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:50.725789 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ebf1a-146d-44ad-bfb3-5a6157467e23 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:50.729352 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f83b41-ddaa-4e97-8efe-5588945c6a75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:50.729970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f83b41-ddaa-4e97-8efe-5588945c6a75 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:50.730823 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f83b41-ddaa-4e97-8efe-5588945c6a75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:50.731113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f83b41-ddaa-4e97-8efe-5588945c6a75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:50.740105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f83b41-ddaa-4e97-8efe-5588945c6a75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:50.741573 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f83b41-ddaa-4e97-8efe-5588945c6a75 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:50.750975 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1389/2809] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:50 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:50.897087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641779d4-fe81-4ac2-8aab-2f00405bb4a2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:50.957629 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641779d4-fe81-4ac2-8aab-2f00405bb4a2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:50.962031 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:50.962655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:50.962938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:50.963212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] PATH_INFO: `/v3/users/8371179488be4ba7ba4132bdcdfc036a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:50.964351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8371179488be4ba7ba4132bdcdfc036a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:50.966301 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:51.011866 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8371179488be4ba7ba4132bdcdfc036a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.019209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:51.026106 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8371179488be4ba7ba4132bdcdfc036a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.026761 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8371179488be4ba7ba4132bdcdfc036a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.027453 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8371179488be4ba7ba4132bdcdfc036a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.034782 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8371179488be4ba7ba4132bdcdfc036a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.047727 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1421/2810] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:50 2022] DELETE /identity/v3/users/8371179488be4ba7ba4132bdcdfc036a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:51.052168 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2794b-0566-4f19-adb6-c13379e0701b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:51.052461 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2794b-0566-4f19-adb6-c13379e0701b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:51.052743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2794b-0566-4f19-adb6-c13379e0701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:51.072128 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4dd2794b-0566-4f19-adb6-c13379e0701b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:51.073384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4dd2794b-0566-4f19-adb6-c13379e0701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:51.133156 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1390/2811] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:51.142786 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:51.144186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:51.200725 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4979294-f1ca-4973-af26-aee4ffad0d90 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:51.204353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4479a9-f5f5-47ba-823b-86704b2f9826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:51.204995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4479a9-f5f5-47ba-823b-86704b2f9826 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:51.205281 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4479a9-f5f5-47ba-823b-86704b2f9826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:51.205553 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4479a9-f5f5-47ba-823b-86704b2f9826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:51.215335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4479a9-f5f5-47ba-823b-86704b2f9826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:51.216752 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4479a9-f5f5-47ba-823b-86704b2f9826 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:51.226216 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1422/2812] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:51.491034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2794b-0566-4f19-adb6-c13379e0701b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:51.492475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4dd2794b-0566-4f19-adb6-c13379e0701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:51.505911 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2794b-0566-4f19-adb6-c13379e0701b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:51.510465 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:51.511131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:51.511454 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:51.512951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] PATH_INFO: `/v3/projects/b2a6be29294341369c4f7eade56d8f8f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:51.514164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a6be29294341369c4f7eade56d8f8f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:51.516039 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:51.562711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a6be29294341369c4f7eade56d8f8f', 'request_id': 'req-3a7420a0-ec1b-4278-956a-be922868e54b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.568161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a6be29294341369c4f7eade56d8f8f', 'request_id': 'req-3a7420a0-ec1b-4278-956a-be922868e54b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.576081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a6be29294341369c4f7eade56d8f8f', 'request_id': 'req-3a7420a0-ec1b-4278-956a-be922868e54b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.587105 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] The token cache is being invalidate because project b2a6be29294341369c4f7eade56d8f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:51.587395 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.588026 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.589764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1391/2813] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:51 2022] DELETE /identity/v3/projects/b2a6be29294341369c4f7eade56d8f8f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:51.593538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4479a9-f5f5-47ba-823b-86704b2f9826 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:51.604715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4479a9-f5f5-47ba-823b-86704b2f9826 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:51.664014 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81956039-0282-4c2b-8141-435401d9834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:51.664651 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81956039-0282-4c2b-8141-435401d9834e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:51.664962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81956039-0282-4c2b-8141-435401d9834e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:51.665248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81956039-0282-4c2b-8141-435401d9834e admin admin] PATH_INFO: `/v3/users/79d57ea377fd44ccaaf4eeb09e29603c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:51.666395 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81956039-0282-4c2b-8141-435401d9834e admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d57ea377fd44ccaaf4eeb09e29603c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:51.668656 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81956039-0282-4c2b-8141-435401d9834e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:51.714837 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-81956039-0282-4c2b-8141-435401d9834e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d57ea377fd44ccaaf4eeb09e29603c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.728620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-81956039-0282-4c2b-8141-435401d9834e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d57ea377fd44ccaaf4eeb09e29603c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.729335 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-81956039-0282-4c2b-8141-435401d9834e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d57ea377fd44ccaaf4eeb09e29603c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.729939 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-81956039-0282-4c2b-8141-435401d9834e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d57ea377fd44ccaaf4eeb09e29603c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.743339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-81956039-0282-4c2b-8141-435401d9834e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d57ea377fd44ccaaf4eeb09e29603c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:51.750015 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:51.761178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1423/2814] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:42:51 2022] DELETE /identity/v3/users/79d57ea377fd44ccaaf4eeb09e29603c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:52.098618 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:52.100210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:52.114111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7420a0-ec1b-4278-956a-be922868e54b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:52.150266 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:52.180306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a815a2-2909-4482-b33b-b8f27a6a4f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:52.181026 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a815a2-2909-4482-b33b-b8f27a6a4f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:52.181316 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a815a2-2909-4482-b33b-b8f27a6a4f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:52.181589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a815a2-2909-4482-b33b-b8f27a6a4f9e admin admin] PATH_INFO: `/v3/projects/fdb84f65eb3545c49f672b9f802bdfd2` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:52.184066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a815a2-2909-4482-b33b-b8f27a6a4f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb84f65eb3545c49f672b9f802bdfd2)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:52.186108 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a815a2-2909-4482-b33b-b8f27a6a4f9e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:52.242114 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-32a815a2-2909-4482-b33b-b8f27a6a4f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb84f65eb3545c49f672b9f802bdfd2', 'request_id': 'req-32a815a2-2909-4482-b33b-b8f27a6a4f9e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:52.248011 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-32a815a2-2909-4482-b33b-b8f27a6a4f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb84f65eb3545c49f672b9f802bdfd2', 'request_id': 'req-32a815a2-2909-4482-b33b-b8f27a6a4f9e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:52.257299 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-32a815a2-2909-4482-b33b-b8f27a6a4f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb84f65eb3545c49f672b9f802bdfd2', 'request_id': 'req-32a815a2-2909-4482-b33b-b8f27a6a4f9e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:52.270744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-32a815a2-2909-4482-b33b-b8f27a6a4f9e admin admin] The token cache is being invalidate because project fdb84f65eb3545c49f672b9f802bdfd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:42:52.271037 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-32a815a2-2909-4482-b33b-b8f27a6a4f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:52.271688 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-32a815a2-2909-4482-b33b-b8f27a6a4f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:42:52.273240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1392/2815] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:42:52 2022] DELETE /identity/v3/projects/fdb84f65eb3545c49f672b9f802bdfd2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:52.278742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039123f-ee09-445b-9acd-1effcfab0500 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:52.279034 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039123f-ee09-445b-9acd-1effcfab0500 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:52.279352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039123f-ee09-445b-9acd-1effcfab0500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:52.303056 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1039123f-ee09-445b-9acd-1effcfab0500 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:52.305021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1039123f-ee09-445b-9acd-1effcfab0500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:52.369262 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1424/2816] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:52.377845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f534f4-6f7b-4f5a-8588-6ef70719d8e9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:52.378129 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f534f4-6f7b-4f5a-8588-6ef70719d8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:52.378399 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f534f4-6f7b-4f5a-8588-6ef70719d8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:52.400144 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-12f534f4-6f7b-4f5a-8588-6ef70719d8e9 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:52.401869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-12f534f4-6f7b-4f5a-8588-6ef70719d8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:52.411071 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1393/2817] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:52.415433 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039123f-ee09-445b-9acd-1effcfab0500 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:52.426620 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039123f-ee09-445b-9acd-1effcfab0500 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:52.431223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c561d8-5141-4dd6-8fe1-6dbf5e939dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:52.431836 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c561d8-5141-4dd6-8fe1-6dbf5e939dac admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:52.432138 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c561d8-5141-4dd6-8fe1-6dbf5e939dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:52.432413 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c561d8-5141-4dd6-8fe1-6dbf5e939dac admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:52.433164 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c561d8-5141-4dd6-8fe1-6dbf5e939dac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:42:52.433991 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c561d8-5141-4dd6-8fe1-6dbf5e939dac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:52.435845 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c561d8-5141-4dd6-8fe1-6dbf5e939dac admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:52.447780 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1425/2818] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:42:52.452857 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f534f4-6f7b-4f5a-8588-6ef70719d8e9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:52.462366 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f534f4-6f7b-4f5a-8588-6ef70719d8e9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:52.467799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f39c2c-be84-4ee3-a3e9-43d88ad9307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:52.467977 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f39c2c-be84-4ee3-a3e9-43d88ad9307f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:52.468290 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f39c2c-be84-4ee3-a3e9-43d88ad9307f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:52.468568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f39c2c-be84-4ee3-a3e9-43d88ad9307f admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:52.469692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f39c2c-be84-4ee3-a3e9-43d88ad9307f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:52.471203 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f39c2c-be84-4ee3-a3e9-43d88ad9307f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:52.503683 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1394/2819] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:52 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:52.508136 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c561d8-5141-4dd6-8fe1-6dbf5e939dac admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:52.518420 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c561d8-5141-4dd6-8fe1-6dbf5e939dac admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:52.577432 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddb079-91ce-487b-8bdf-5f4bebf50476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:52.578050 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddb079-91ce-487b-8bdf-5f4bebf50476 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:52.578334 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddb079-91ce-487b-8bdf-5f4bebf50476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:52.578614 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddb079-91ce-487b-8bdf-5f4bebf50476 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:52.579290 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddb079-91ce-487b-8bdf-5f4bebf50476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:52.581236 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddb079-91ce-487b-8bdf-5f4bebf50476 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:52.601929 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1426/2820] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:52 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:52.606567 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f39c2c-be84-4ee3-a3e9-43d88ad9307f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:52.616832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f39c2c-be84-4ee3-a3e9-43d88ad9307f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:52.622442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c21b87-fb25-4432-ac97-e150d9f790c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:52.622997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c21b87-fb25-4432-ac97-e150d9f790c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:52.623281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c21b87-fb25-4432-ac97-e150d9f790c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:52.623559 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c21b87-fb25-4432-ac97-e150d9f790c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:52.624254 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c21b87-fb25-4432-ac97-e150d9f790c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:52.625914 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c21b87-fb25-4432-ac97-e150d9f790c2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:52.636619 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1395/2821] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:52.640429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddb079-91ce-487b-8bdf-5f4bebf50476 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:52.650528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddb079-91ce-487b-8bdf-5f4bebf50476 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:52.655329 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a9a66-a77e-4142-8ca5-422a0b39718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:52.655962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a9a66-a77e-4142-8ca5-422a0b39718b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:52.656247 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a9a66-a77e-4142-8ca5-422a0b39718b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:52.656527 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a9a66-a77e-4142-8ca5-422a0b39718b admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:52.657251 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a9a66-a77e-4142-8ca5-422a0b39718b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:52.658829 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a9a66-a77e-4142-8ca5-422a0b39718b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:52.671497 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1427/2822] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:52.675758 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c21b87-fb25-4432-ac97-e150d9f790c2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:52.686586 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c21b87-fb25-4432-ac97-e150d9f790c2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:52.691218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5d22b-ab2e-4735-95a5-90806303d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:52.691878 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5d22b-ab2e-4735-95a5-90806303d711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:52.692163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5d22b-ab2e-4735-95a5-90806303d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:52.692435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5d22b-ab2e-4735-95a5-90806303d711 admin admin] PATH_INFO: `/v3/projects/842e782bf43e443d89e4433a45bc8a14/users/3e913b55b32b466bbd65464c255cddc5/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:52.707092 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5d22b-ab2e-4735-95a5-90806303d711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842e782bf43e443d89e4433a45bc8a14, user_id=3e913b55b32b466bbd65464c255cddc5, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:52.709775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5d22b-ab2e-4735-95a5-90806303d711 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:52.722676 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1396/2823] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:52 2022] PUT /identity/v3/projects/842e782bf43e443d89e4433a45bc8a14/users/3e913b55b32b466bbd65464c255cddc5/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:52.733447 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882841b1-574f-40c9-bca9-e80c329121f7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:52.733738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882841b1-574f-40c9-bca9-e80c329121f7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:52.734017 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882841b1-574f-40c9-bca9-e80c329121f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:52.762980 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-882841b1-574f-40c9-bca9-e80c329121f7 None None] MFA Rules not processed for user `3e913b55b32b466bbd65464c255cddc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:52.764183 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-882841b1-574f-40c9-bca9-e80c329121f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:52.810996 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:52.828239 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1428/2824] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:52.832705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5d22b-ab2e-4735-95a5-90806303d711 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:52.894827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5d22b-ab2e-4735-95a5-90806303d711 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:52.899427 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfa519-5ff8-4589-abbe-848286b961f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:52.900047 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfa519-5ff8-4589-abbe-848286b961f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:52.900331 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfa519-5ff8-4589-abbe-848286b961f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:52.900606 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfa519-5ff8-4589-abbe-848286b961f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:52.901318 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfa519-5ff8-4589-abbe-848286b961f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:52.903705 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfa519-5ff8-4589-abbe-848286b961f4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:52.908940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:52.932210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1397/2825] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:52 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:42:52.937087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882841b1-574f-40c9-bca9-e80c329121f7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:52.947754 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882841b1-574f-40c9-bca9-e80c329121f7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:53.003711 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8814b-430b-40df-bf53-960f88b68721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:53.004325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8814b-430b-40df-bf53-960f88b68721 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.004612 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8814b-430b-40df-bf53-960f88b68721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.004940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8814b-430b-40df-bf53-960f88b68721 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.005613 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8814b-430b-40df-bf53-960f88b68721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:53.007554 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8814b-430b-40df-bf53-960f88b68721 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:53.029965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1429/2826] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:52 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:53.034174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfa519-5ff8-4589-abbe-848286b961f4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:53.045208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfa519-5ff8-4589-abbe-848286b961f4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:53.049990 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50a06d-619a-4a3f-81b4-31cc086b3cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:53.050598 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50a06d-619a-4a3f-81b4-31cc086b3cad admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.050883 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50a06d-619a-4a3f-81b4-31cc086b3cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.051181 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50a06d-619a-4a3f-81b4-31cc086b3cad admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.051873 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50a06d-619a-4a3f-81b4-31cc086b3cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:53.053551 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50a06d-619a-4a3f-81b4-31cc086b3cad admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:53.063421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1398/2827] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:42:53.067361 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8814b-430b-40df-bf53-960f88b68721 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:53.078633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8814b-430b-40df-bf53-960f88b68721 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:53.083185 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb335a06-1a11-4d52-8006-c3aef6df2d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:53.083785 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb335a06-1a11-4d52-8006-c3aef6df2d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.084063 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb335a06-1a11-4d52-8006-c3aef6df2d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.084333 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb335a06-1a11-4d52-8006-c3aef6df2d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.085051 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb335a06-1a11-4d52-8006-c3aef6df2d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:53.086614 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb335a06-1a11-4d52-8006-c3aef6df2d41 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:53.096842 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1430/2828] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:53.100842 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50a06d-619a-4a3f-81b4-31cc086b3cad admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:53.111351 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50a06d-619a-4a3f-81b4-31cc086b3cad admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:53.115917 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c7705-d629-477f-9b1d-77e7f8979a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:53.116561 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c7705-d629-477f-9b1d-77e7f8979a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.116843 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c7705-d629-477f-9b1d-77e7f8979a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.117154 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c7705-d629-477f-9b1d-77e7f8979a6a admin admin] PATH_INFO: `/v3/projects/d634eed2c4b14d1fba4a06c000e33321/users/efea942046804b4fa4f2b26d5c7a56c1/roles/102380322b574754b40ec23fe0394401` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.131631 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c7705-d629-477f-9b1d-77e7f8979a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d634eed2c4b14d1fba4a06c000e33321, user_id=efea942046804b4fa4f2b26d5c7a56c1, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:53.134330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c7705-d629-477f-9b1d-77e7f8979a6a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:53.147317 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1399/2829] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:53 2022] PUT /identity/v3/projects/d634eed2c4b14d1fba4a06c000e33321/users/efea942046804b4fa4f2b26d5c7a56c1/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:53.159071 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0804b8-4331-4f5a-ab89-83b6cafaa7f3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.159356 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0804b8-4331-4f5a-ab89-83b6cafaa7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.159630 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0804b8-4331-4f5a-ab89-83b6cafaa7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.187195 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fe0804b8-4331-4f5a-ab89-83b6cafaa7f3 None None] MFA Rules not processed for user `efea942046804b4fa4f2b26d5c7a56c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:53.188382 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fe0804b8-4331-4f5a-ab89-83b6cafaa7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:53.252065 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1431/2830] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:53.256965 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c7705-d629-477f-9b1d-77e7f8979a6a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:53.318475 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c7705-d629-477f-9b1d-77e7f8979a6a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:53.323088 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd810b-d339-4cf1-bd72-988f47842411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:53.323700 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd810b-d339-4cf1-bd72-988f47842411 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.324523 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd810b-d339-4cf1-bd72-988f47842411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.324787 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd810b-d339-4cf1-bd72-988f47842411 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.325472 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd810b-d339-4cf1-bd72-988f47842411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:53.327357 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd810b-d339-4cf1-bd72-988f47842411 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:53.353205 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1400/2831] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:42:53 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:53.357787 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0804b8-4331-4f5a-ab89-83b6cafaa7f3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:53.368989 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0804b8-4331-4f5a-ab89-83b6cafaa7f3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:53.425276 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5eef4-e38e-4c92-9d11-3e5dde655296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:53.425810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5eef4-e38e-4c92-9d11-3e5dde655296 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.426094 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5eef4-e38e-4c92-9d11-3e5dde655296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.426363 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5eef4-e38e-4c92-9d11-3e5dde655296 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.427025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5eef4-e38e-4c92-9d11-3e5dde655296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:53.428965 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5eef4-e38e-4c92-9d11-3e5dde655296 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:53.437209 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:53.450492 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1432/2832] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:42:53 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:42:53.454516 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd810b-d339-4cf1-bd72-988f47842411 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:53.465142 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd810b-d339-4cf1-bd72-988f47842411 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:53.469711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eb9a9-b983-41c5-a79b-d9becc8c0437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:53.470358 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eb9a9-b983-41c5-a79b-d9becc8c0437 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.470639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eb9a9-b983-41c5-a79b-d9becc8c0437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.470967 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eb9a9-b983-41c5-a79b-d9becc8c0437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.471685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3eb9a9-b983-41c5-a79b-d9becc8c0437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:53.473425 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3eb9a9-b983-41c5-a79b-d9becc8c0437 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:53.484648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1401/2833] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:42:53.488798 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5eef4-e38e-4c92-9d11-3e5dde655296 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:53.499525 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5eef4-e38e-4c92-9d11-3e5dde655296 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:53.504374 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7da993-6bdf-47b3-a4ba-cffa909768fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:53.505066 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da993-6bdf-47b3-a4ba-cffa909768fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.505352 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da993-6bdf-47b3-a4ba-cffa909768fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.505633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da993-6bdf-47b3-a4ba-cffa909768fe admin admin] PATH_INFO: `/v3/projects/b77b7165bb7e49609f0fa0c32b9f8218/users/c665d6e9274c4a788c770f66b77f4d7b/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.520061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7da993-6bdf-47b3-a4ba-cffa909768fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77b7165bb7e49609f0fa0c32b9f8218, user_id=c665d6e9274c4a788c770f66b77f4d7b, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:53.522742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7da993-6bdf-47b3-a4ba-cffa909768fe admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:53.535625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1433/2834] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:53 2022] PUT /identity/v3/projects/b77b7165bb7e49609f0fa0c32b9f8218/users/c665d6e9274c4a788c770f66b77f4d7b/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:42:53.539550 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eb9a9-b983-41c5-a79b-d9becc8c0437 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:53.550131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eb9a9-b983-41c5-a79b-d9becc8c0437 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:53.607253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf380d1-59eb-4900-81bf-2ad20e196810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:53.607856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf380d1-59eb-4900-81bf-2ad20e196810 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.608131 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf380d1-59eb-4900-81bf-2ad20e196810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.608400 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf380d1-59eb-4900-81bf-2ad20e196810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.609133 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf380d1-59eb-4900-81bf-2ad20e196810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:53.610711 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf380d1-59eb-4900-81bf-2ad20e196810 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:53.620165 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1402/2835] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:42:53.624547 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7da993-6bdf-47b3-a4ba-cffa909768fe admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:53.635029 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7da993-6bdf-47b3-a4ba-cffa909768fe admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:53.639938 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283683a1-8afa-4a34-a5cd-80809df1d4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:53.640585 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283683a1-8afa-4a34-a5cd-80809df1d4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.640866 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283683a1-8afa-4a34-a5cd-80809df1d4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.641173 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283683a1-8afa-4a34-a5cd-80809df1d4e9 admin admin] PATH_INFO: `/v3/projects/b77b7165bb7e49609f0fa0c32b9f8218/users/c665d6e9274c4a788c770f66b77f4d7b/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.643105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283683a1-8afa-4a34-a5cd-80809df1d4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77b7165bb7e49609f0fa0c32b9f8218, user_id=c665d6e9274c4a788c770f66b77f4d7b, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:53.645776 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283683a1-8afa-4a34-a5cd-80809df1d4e9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:53.656641 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1434/2836] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:42:53 2022] PUT /identity/v3/projects/b77b7165bb7e49609f0fa0c32b9f8218/users/c665d6e9274c4a788c770f66b77f4d7b/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:42:53.666494 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff04d43-663a-42e7-ba38-982824030544 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.666845 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff04d43-663a-42e7-ba38-982824030544 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.667201 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff04d43-663a-42e7-ba38-982824030544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.695284 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-aff04d43-663a-42e7-ba38-982824030544 None None] MFA Rules not processed for user `c665d6e9274c4a788c770f66b77f4d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:42:53.696398 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aff04d43-663a-42e7-ba38-982824030544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:53.705846 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:42:53.765081 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1403/2837] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:42:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:42:53.775673 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283683a1-8afa-4a34-a5cd-80809df1d4e9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:53.777810 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-283683a1-8afa-4a34-a5cd-80809df1d4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:53.837437 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283683a1-8afa-4a34-a5cd-80809df1d4e9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:53.841503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a2f43-6f98-4d81-bdfa-899f65bae256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:53.842150 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a2f43-6f98-4d81-bdfa-899f65bae256 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:53.842465 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a2f43-6f98-4d81-bdfa-899f65bae256 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:53.842745 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a2f43-6f98-4d81-bdfa-899f65bae256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:53.851658 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a2f43-6f98-4d81-bdfa-899f65bae256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:53.853120 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a2f43-6f98-4d81-bdfa-899f65bae256 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:53.862742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1435/2838] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:54.360321 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff04d43-663a-42e7-ba38-982824030544 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:54.361788 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aff04d43-663a-42e7-ba38-982824030544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:42:54.384370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff04d43-663a-42e7-ba38-982824030544 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:54.388014 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40e58a-2fd2-41b0-9737-44533349eda8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:54.388634 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40e58a-2fd2-41b0-9737-44533349eda8 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:54.388941 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40e58a-2fd2-41b0-9737-44533349eda8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:54.389225 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40e58a-2fd2-41b0-9737-44533349eda8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:54.444018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40e58a-2fd2-41b0-9737-44533349eda8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:54.445486 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40e58a-2fd2-41b0-9737-44533349eda8 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:54.454537 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1404/2839] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:42:58.455463 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a2f43-6f98-4d81-bdfa-899f65bae256 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:42:58.464002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a2f43-6f98-4d81-bdfa-899f65bae256 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:42:58.467655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913d8df-205b-4997-9b3f-3dc2297f8ed5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:42:58.468251 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913d8df-205b-4997-9b3f-3dc2297f8ed5 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:42:58.468530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913d8df-205b-4997-9b3f-3dc2297f8ed5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:42:58.468802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913d8df-205b-4997-9b3f-3dc2297f8ed5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:42:58.523847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913d8df-205b-4997-9b3f-3dc2297f8ed5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:42:58.525223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913d8df-205b-4997-9b3f-3dc2297f8ed5 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:42:58.534442 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1436/2840] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:42:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:00.602444 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40e58a-2fd2-41b0-9737-44533349eda8 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:00.663690 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40e58a-2fd2-41b0-9737-44533349eda8 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:00.668404 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:00.669076 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:00.669368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:00.669637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] PATH_INFO: `/v3/users/3e913b55b32b466bbd65464c255cddc5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:00.670793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e913b55b32b466bbd65464c255cddc5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:00.672695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:00.717986 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e913b55b32b466bbd65464c255cddc5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:00.719195 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:00.726820 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e913b55b32b466bbd65464c255cddc5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:00.740013 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e913b55b32b466bbd65464c255cddc5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:00.740695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e913b55b32b466bbd65464c255cddc5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:00.741329 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e913b55b32b466bbd65464c255cddc5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:00.755669 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1405/2841] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:43:00 2022] DELETE /identity/v3/users/3e913b55b32b466bbd65464c255cddc5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:00.760105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1781f-3517-4653-97fb-0e1389893add None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:00.760579 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1781f-3517-4653-97fb-0e1389893add None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:00.760724 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1781f-3517-4653-97fb-0e1389893add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:00.779140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-97b1781f-3517-4653-97fb-0e1389893add None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:00.780343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-97b1781f-3517-4653-97fb-0e1389893add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:00.827292 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:00.840140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1437/2842] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:00.849875 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:00.851293 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:00.908451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35e9e-d860-4b7b-93fd-1c92778385da admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:00.912130 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9e11b-c801-4638-98f5-5f371bf1afa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:00.912745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9e11b-c801-4638-98f5-5f371bf1afa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:00.913058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9e11b-c801-4638-98f5-5f371bf1afa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:00.913338 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9e11b-c801-4638-98f5-5f371bf1afa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:00.923189 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9e11b-c801-4638-98f5-5f371bf1afa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:00.924608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9e11b-c801-4638-98f5-5f371bf1afa2 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:00.934497 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1406/2843] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:01.202722 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1781f-3517-4653-97fb-0e1389893add None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:01.204325 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-97b1781f-3517-4653-97fb-0e1389893add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:01.217160 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1781f-3517-4653-97fb-0e1389893add None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:01.221933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:01.222582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:01.222867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:01.223151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] PATH_INFO: `/v3/projects/842e782bf43e443d89e4433a45bc8a14` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:01.224429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=842e782bf43e443d89e4433a45bc8a14)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:01.226409 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:01.272999 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842e782bf43e443d89e4433a45bc8a14', 'request_id': 'req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.279222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842e782bf43e443d89e4433a45bc8a14', 'request_id': 'req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.286496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842e782bf43e443d89e4433a45bc8a14', 'request_id': 'req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.298115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] The token cache is being invalidate because project 842e782bf43e443d89e4433a45bc8a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:43:01.298425 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.299010 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.300566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1438/2844] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:43:01 2022] DELETE /identity/v3/projects/842e782bf43e443d89e4433a45bc8a14 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:01.304500 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9e11b-c801-4638-98f5-5f371bf1afa2 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:01.313905 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9e11b-c801-4638-98f5-5f371bf1afa2 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:01.370118 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:01.370829 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:01.371113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:01.371385 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] PATH_INFO: `/v3/users/efea942046804b4fa4f2b26d5c7a56c1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:01.372557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efea942046804b4fa4f2b26d5c7a56c1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:01.374517 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:01.421309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efea942046804b4fa4f2b26d5c7a56c1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.428155 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efea942046804b4fa4f2b26d5c7a56c1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.438265 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:01.440678 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efea942046804b4fa4f2b26d5c7a56c1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.441419 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efea942046804b4fa4f2b26d5c7a56c1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.442394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efea942046804b4fa4f2b26d5c7a56c1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.455814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1407/2845] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:43:01 2022] DELETE /identity/v3/users/efea942046804b4fa4f2b26d5c7a56c1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:01.728661 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:01.730691 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:01.744254 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1394b7c-2e3e-4bae-bbdc-ae5c5126df19 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:01.802007 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:01.802665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:01.802924 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:01.803201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] PATH_INFO: `/v3/projects/d634eed2c4b14d1fba4a06c000e33321` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:01.804364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d634eed2c4b14d1fba4a06c000e33321)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:01.806307 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:01.852061 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd634eed2c4b14d1fba4a06c000e33321', 'request_id': 'req-0274133b-a6ab-41aa-8575-3338df517331'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.858250 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd634eed2c4b14d1fba4a06c000e33321', 'request_id': 'req-0274133b-a6ab-41aa-8575-3338df517331'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.865340 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd634eed2c4b14d1fba4a06c000e33321', 'request_id': 'req-0274133b-a6ab-41aa-8575-3338df517331'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.876692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] The token cache is being invalidate because project d634eed2c4b14d1fba4a06c000e33321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:43:01.877014 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.877902 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:01.879390 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1439/2846] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:43:01 2022] DELETE /identity/v3/projects/d634eed2c4b14d1fba4a06c000e33321 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:01.883484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:01.884935 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:01.897557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d850ba2-b22d-4611-97f5-ba68e50215c8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:01.953457 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d482-cbe7-4bd4-a829-c8f6f411d1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:01.954028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d482-cbe7-4bd4-a829-c8f6f411d1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:01.954313 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d482-cbe7-4bd4-a829-c8f6f411d1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:01.954590 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d482-cbe7-4bd4-a829-c8f6f411d1be admin admin] PATH_INFO: `/v3/users/c665d6e9274c4a788c770f66b77f4d7b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:01.955751 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2d482-cbe7-4bd4-a829-c8f6f411d1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c665d6e9274c4a788c770f66b77f4d7b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:01.957687 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2d482-cbe7-4bd4-a829-c8f6f411d1be admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:02.002695 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96f2d482-cbe7-4bd4-a829-c8f6f411d1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c665d6e9274c4a788c770f66b77f4d7b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:02.009535 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96f2d482-cbe7-4bd4-a829-c8f6f411d1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c665d6e9274c4a788c770f66b77f4d7b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:02.021944 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96f2d482-cbe7-4bd4-a829-c8f6f411d1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c665d6e9274c4a788c770f66b77f4d7b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:02.022601 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96f2d482-cbe7-4bd4-a829-c8f6f411d1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c665d6e9274c4a788c770f66b77f4d7b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:02.023193 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-96f2d482-cbe7-4bd4-a829-c8f6f411d1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c665d6e9274c4a788c770f66b77f4d7b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:02.035989 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1408/2847] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:43:01 2022] DELETE /identity/v3/users/c665d6e9274c4a788c770f66b77f4d7b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:02.307427 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:02.309523 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:02.326830 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274133b-a6ab-41aa-8575-3338df517331 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:02.331282 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:02.387484 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff3614-e89e-48f7-a2df-38c3bf729cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:02.388127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff3614-e89e-48f7-a2df-38c3bf729cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:02.388405 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff3614-e89e-48f7-a2df-38c3bf729cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:02.388677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff3614-e89e-48f7-a2df-38c3bf729cf3 admin admin] PATH_INFO: `/v3/projects/b77b7165bb7e49609f0fa0c32b9f8218` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:02.389867 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff3614-e89e-48f7-a2df-38c3bf729cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77b7165bb7e49609f0fa0c32b9f8218)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:02.391807 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff3614-e89e-48f7-a2df-38c3bf729cf3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:02.439208 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fcff3614-e89e-48f7-a2df-38c3bf729cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77b7165bb7e49609f0fa0c32b9f8218', 'request_id': 'req-fcff3614-e89e-48f7-a2df-38c3bf729cf3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:02.444883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fcff3614-e89e-48f7-a2df-38c3bf729cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77b7165bb7e49609f0fa0c32b9f8218', 'request_id': 'req-fcff3614-e89e-48f7-a2df-38c3bf729cf3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:02.452369 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fcff3614-e89e-48f7-a2df-38c3bf729cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77b7165bb7e49609f0fa0c32b9f8218', 'request_id': 'req-fcff3614-e89e-48f7-a2df-38c3bf729cf3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:02.463308 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fcff3614-e89e-48f7-a2df-38c3bf729cf3 admin admin] The token cache is being invalidate because project b77b7165bb7e49609f0fa0c32b9f8218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:43:02.463599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fcff3614-e89e-48f7-a2df-38c3bf729cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:02.464223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fcff3614-e89e-48f7-a2df-38c3bf729cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:02.465832 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1440/2848] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:43:02 2022] DELETE /identity/v3/projects/b77b7165bb7e49609f0fa0c32b9f8218 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:02.471793 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920aa69-9137-46bd-86ee-95d6cd28583a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:02.472166 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920aa69-9137-46bd-86ee-95d6cd28583a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:02.472508 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920aa69-9137-46bd-86ee-95d6cd28583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:02.492430 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7920aa69-9137-46bd-86ee-95d6cd28583a None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:02.493615 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7920aa69-9137-46bd-86ee-95d6cd28583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:02.556045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1409/2849] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:43:02.565127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2067d7c-f9c1-46d5-9b78-5da6bdb2cac7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:02.565421 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2067d7c-f9c1-46d5-9b78-5da6bdb2cac7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:02.565698 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2067d7c-f9c1-46d5-9b78-5da6bdb2cac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:02.585713 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f2067d7c-f9c1-46d5-9b78-5da6bdb2cac7 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:02.586917 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f2067d7c-f9c1-46d5-9b78-5da6bdb2cac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:02.594773 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1441/2850] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:02.598914 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920aa69-9137-46bd-86ee-95d6cd28583a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:02.609244 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920aa69-9137-46bd-86ee-95d6cd28583a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:02.613773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc72d7-e2cb-401d-864f-8f29632dd00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:02.614371 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc72d7-e2cb-401d-864f-8f29632dd00d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:02.614648 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc72d7-e2cb-401d-864f-8f29632dd00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:02.614918 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc72d7-e2cb-401d-864f-8f29632dd00d admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:02.615605 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc72d7-e2cb-401d-864f-8f29632dd00d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:43:02.615913 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc72d7-e2cb-401d-864f-8f29632dd00d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:02.617525 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc72d7-e2cb-401d-864f-8f29632dd00d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:02.618984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:02.635655 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1410/2851] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:43:02.638159 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2067d7c-f9c1-46d5-9b78-5da6bdb2cac7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:02.647469 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2067d7c-f9c1-46d5-9b78-5da6bdb2cac7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:02.652748 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc0349-12af-4b85-95c6-8ed61db71bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:02.653383 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0349-12af-4b85-95c6-8ed61db71bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:02.653671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0349-12af-4b85-95c6-8ed61db71bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:02.653971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0349-12af-4b85-95c6-8ed61db71bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:02.654633 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc0349-12af-4b85-95c6-8ed61db71bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:02.656538 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc0349-12af-4b85-95c6-8ed61db71bf5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:02.682580 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1442/2852] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:43:02 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:43:02.687386 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc72d7-e2cb-401d-864f-8f29632dd00d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:02.697545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc72d7-e2cb-401d-864f-8f29632dd00d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:02.754253 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b0f17-e607-41a8-9a63-54cbb2e34dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:02.754804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b0f17-e607-41a8-9a63-54cbb2e34dcf admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:02.755091 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b0f17-e607-41a8-9a63-54cbb2e34dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:02.755368 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b0f17-e607-41a8-9a63-54cbb2e34dcf admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:02.756028 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b0f17-e607-41a8-9a63-54cbb2e34dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:02.757970 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b0f17-e607-41a8-9a63-54cbb2e34dcf admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:02.779339 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1411/2853] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:43:02 2022] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:43:02.783606 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc0349-12af-4b85-95c6-8ed61db71bf5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:02.793804 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc0349-12af-4b85-95c6-8ed61db71bf5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:02.798605 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf65450-f78f-49c8-a218-1b1b81ed5af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:02.799212 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf65450-f78f-49c8-a218-1b1b81ed5af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:02.799518 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf65450-f78f-49c8-a218-1b1b81ed5af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:02.799793 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf65450-f78f-49c8-a218-1b1b81ed5af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:02.800487 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf65450-f78f-49c8-a218-1b1b81ed5af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:02.802098 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf65450-f78f-49c8-a218-1b1b81ed5af2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:02.812439 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1443/2854] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:43:02.816314 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b0f17-e607-41a8-9a63-54cbb2e34dcf admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:02.827059 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b0f17-e607-41a8-9a63-54cbb2e34dcf admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:02.831628 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dd3dc-59f9-42c5-b6f9-9c96b985928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:02.832218 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd3dc-59f9-42c5-b6f9-9c96b985928d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:02.832498 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd3dc-59f9-42c5-b6f9-9c96b985928d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:02.832771 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd3dc-59f9-42c5-b6f9-9c96b985928d admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:02.833491 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dd3dc-59f9-42c5-b6f9-9c96b985928d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:02.835042 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dd3dc-59f9-42c5-b6f9-9c96b985928d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:02.845647 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1412/2855] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:43:02.849768 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf65450-f78f-49c8-a218-1b1b81ed5af2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:02.859863 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf65450-f78f-49c8-a218-1b1b81ed5af2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:02.864454 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d27db-a710-4994-8f17-42b2452686a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:02.865134 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d27db-a710-4994-8f17-42b2452686a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:02.865423 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d27db-a710-4994-8f17-42b2452686a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:02.865701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d27db-a710-4994-8f17-42b2452686a1 admin admin] PATH_INFO: `/v3/projects/6c478b0cb4a342f285c31c92a08d1a30/users/8a21bc3f04514b6fad9dfe64a536beed/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:02.880871 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d27db-a710-4994-8f17-42b2452686a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c478b0cb4a342f285c31c92a08d1a30, user_id=8a21bc3f04514b6fad9dfe64a536beed, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:02.883528 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d27db-a710-4994-8f17-42b2452686a1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:02.897377 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1444/2856] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:43:02 2022] PUT /identity/v3/projects/6c478b0cb4a342f285c31c92a08d1a30/users/8a21bc3f04514b6fad9dfe64a536beed/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:02.908553 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40575f-b74d-4af6-9ec9-185118424e9f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:02.909066 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40575f-b74d-4af6-9ec9-185118424e9f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:02.909169 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40575f-b74d-4af6-9ec9-185118424e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:02.936409 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cc40575f-b74d-4af6-9ec9-185118424e9f None None] MFA Rules not processed for user `8a21bc3f04514b6fad9dfe64a536beed`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:02.937739 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cc40575f-b74d-4af6-9ec9-185118424e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:03.000208 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1413/2857] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:43:02 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:03.005023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d27db-a710-4994-8f17-42b2452686a1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:03.038097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:03.067607 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d27db-a710-4994-8f17-42b2452686a1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:03.072833 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370e43e-c226-4eab-8e0f-28dd00ce4609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:03.073519 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370e43e-c226-4eab-8e0f-28dd00ce4609 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:03.073805 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370e43e-c226-4eab-8e0f-28dd00ce4609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:03.074088 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370e43e-c226-4eab-8e0f-28dd00ce4609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:03.074763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370e43e-c226-4eab-8e0f-28dd00ce4609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:03.076655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370e43e-c226-4eab-8e0f-28dd00ce4609 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:03.102343 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1445/2858] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:43:03 2022] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:43:03.107001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40575f-b74d-4af6-9ec9-185118424e9f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:03.117514 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40575f-b74d-4af6-9ec9-185118424e9f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:03.172760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd1e6a-a252-4d3a-aa09-2fc3ffac4499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:03.173399 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd1e6a-a252-4d3a-aa09-2fc3ffac4499 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:03.173680 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd1e6a-a252-4d3a-aa09-2fc3ffac4499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:03.173953 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd1e6a-a252-4d3a-aa09-2fc3ffac4499 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:03.174637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd1e6a-a252-4d3a-aa09-2fc3ffac4499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:03.176527 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd1e6a-a252-4d3a-aa09-2fc3ffac4499 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:03.185814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:03.198191 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1414/2859] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:43:03 2022] POST /identity/v3/users => generated 311 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:43:03.202390 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370e43e-c226-4eab-8e0f-28dd00ce4609 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:03.212625 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370e43e-c226-4eab-8e0f-28dd00ce4609 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:03.217818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d3616-14e0-4c2c-ab1d-296ead9277a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:03.218418 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3616-14e0-4c2c-ab1d-296ead9277a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:03.218701 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3616-14e0-4c2c-ab1d-296ead9277a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:03.218977 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3616-14e0-4c2c-ab1d-296ead9277a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:03.219671 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d3616-14e0-4c2c-ab1d-296ead9277a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:03.221288 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d3616-14e0-4c2c-ab1d-296ead9277a7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:03.232574 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1446/2860] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:43:03.236574 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd1e6a-a252-4d3a-aa09-2fc3ffac4499 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:03.247134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd1e6a-a252-4d3a-aa09-2fc3ffac4499 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:03.251769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d9616-03c6-42cd-b260-09cdca50b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:03.252749 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d9616-03c6-42cd-b260-09cdca50b305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:03.253086 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d9616-03c6-42cd-b260-09cdca50b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:03.253384 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d9616-03c6-42cd-b260-09cdca50b305 admin admin] PATH_INFO: `/v3/projects/cb8859aab8d240f18d43bc5cf459aed0/users/8beb3012ffa246e2874a75a2d9a80a5f/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:03.267647 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d9616-03c6-42cd-b260-09cdca50b305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8859aab8d240f18d43bc5cf459aed0, user_id=8beb3012ffa246e2874a75a2d9a80a5f, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:03.270262 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d9616-03c6-42cd-b260-09cdca50b305 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:03.282761 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1415/2861] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:43:03 2022] PUT /identity/v3/projects/cb8859aab8d240f18d43bc5cf459aed0/users/8beb3012ffa246e2874a75a2d9a80a5f/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:43:03.286593 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d3616-14e0-4c2c-ab1d-296ead9277a7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:03.296855 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d3616-14e0-4c2c-ab1d-296ead9277a7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:03.352332 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad1529-a46b-48de-b303-4d8d3f35b98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:03.352959 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad1529-a46b-48de-b303-4d8d3f35b98c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:03.353266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad1529-a46b-48de-b303-4d8d3f35b98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:03.353597 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad1529-a46b-48de-b303-4d8d3f35b98c admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:03.354287 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad1529-a46b-48de-b303-4d8d3f35b98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:03.356742 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad1529-a46b-48de-b303-4d8d3f35b98c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:03.366860 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1447/2862] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:43:03.371082 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d9616-03c6-42cd-b260-09cdca50b305 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:03.381543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d9616-03c6-42cd-b260-09cdca50b305 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:03.386126 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189f57a-9563-4b12-bcb3-69268c91b9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:03.386775 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189f57a-9563-4b12-bcb3-69268c91b9c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:03.387053 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189f57a-9563-4b12-bcb3-69268c91b9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:03.387324 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189f57a-9563-4b12-bcb3-69268c91b9c1 admin admin] PATH_INFO: `/v3/projects/cb8859aab8d240f18d43bc5cf459aed0/users/8beb3012ffa246e2874a75a2d9a80a5f/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:03.389295 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189f57a-9563-4b12-bcb3-69268c91b9c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8859aab8d240f18d43bc5cf459aed0, user_id=8beb3012ffa246e2874a75a2d9a80a5f, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:03.391888 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189f57a-9563-4b12-bcb3-69268c91b9c1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:03.402445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1416/2863] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:43:03 2022] PUT /identity/v3/projects/cb8859aab8d240f18d43bc5cf459aed0/users/8beb3012ffa246e2874a75a2d9a80a5f/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:03.412468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af02c05-7ff1-403d-baaf-98fb8640b640 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:03.412759 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af02c05-7ff1-403d-baaf-98fb8640b640 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:03.413077 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af02c05-7ff1-403d-baaf-98fb8640b640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:03.441980 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1af02c05-7ff1-403d-baaf-98fb8640b640 None None] MFA Rules not processed for user `8beb3012ffa246e2874a75a2d9a80a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:03.443178 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1af02c05-7ff1-403d-baaf-98fb8640b640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:03.511218 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1448/2864] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:43:03 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:03.521920 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189f57a-9563-4b12-bcb3-69268c91b9c1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:03.523558 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a189f57a-9563-4b12-bcb3-69268c91b9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:03.581210 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189f57a-9563-4b12-bcb3-69268c91b9c1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:03.584874 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410943-c64a-489a-b4aa-c46329a7a4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:03.585512 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410943-c64a-489a-b4aa-c46329a7a4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:03.585790 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410943-c64a-489a-b4aa-c46329a7a4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:03.586058 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410943-c64a-489a-b4aa-c46329a7a4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:03.595471 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410943-c64a-489a-b4aa-c46329a7a4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:03.596885 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410943-c64a-489a-b4aa-c46329a7a4c1 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:03.606769 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1417/2865] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:03 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:03.755514 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af02c05-7ff1-403d-baaf-98fb8640b640 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:03.765426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af02c05-7ff1-403d-baaf-98fb8640b640 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:03.768928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f3f23-84f3-4ecc-9ace-295a1f897195 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acd6aba844f04489adec2ce9f1eb49dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:03.769543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f3f23-84f3-4ecc-9ace-295a1f897195 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:03.769826 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f3f23-84f3-4ecc-9ace-295a1f897195 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:03.770103 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f3f23-84f3-4ecc-9ace-295a1f897195 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:03.796811 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:03.827802 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f3f23-84f3-4ecc-9ace-295a1f897195 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:03.829259 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f3f23-84f3-4ecc-9ace-295a1f897195 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:03.838092 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1449/2866] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:03 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:09.062993 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410943-c64a-489a-b4aa-c46329a7a4c1 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:09.124983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410943-c64a-489a-b4aa-c46329a7a4c1 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:09.129783 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:09.130421 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:09.130707 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:09.130983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] PATH_INFO: `/v3/users/8a21bc3f04514b6fad9dfe64a536beed` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:09.132149 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a21bc3f04514b6fad9dfe64a536beed)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:09.134111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:09.179762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a21bc3f04514b6fad9dfe64a536beed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.186692 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a21bc3f04514b6fad9dfe64a536beed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.188524 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:09.200832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a21bc3f04514b6fad9dfe64a536beed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.201616 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a21bc3f04514b6fad9dfe64a536beed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.202161 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a21bc3f04514b6fad9dfe64a536beed'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.214794 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1418/2867] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:43:09 2022] DELETE /identity/v3/users/8a21bc3f04514b6fad9dfe64a536beed => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:09.219496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678e478-10b6-4a52-ba49-e0c471bb90d4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:09.219987 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678e478-10b6-4a52-ba49-e0c471bb90d4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:09.220097 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678e478-10b6-4a52-ba49-e0c471bb90d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:09.238716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7678e478-10b6-4a52-ba49-e0c471bb90d4 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:09.239921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7678e478-10b6-4a52-ba49-e0c471bb90d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:09.301494 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1450/2868] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:09.312001 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:09.313442 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:09.370283 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f504b-8713-49e8-ba0e-0b99410d5b21 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:09.374589 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6da82-a757-4b55-99d7-b5cb691eb312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:09.375224 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6da82-a757-4b55-99d7-b5cb691eb312 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:09.375508 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6da82-a757-4b55-99d7-b5cb691eb312 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:09.375786 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6da82-a757-4b55-99d7-b5cb691eb312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:09.385240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6da82-a757-4b55-99d7-b5cb691eb312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:09.387350 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6da82-a757-4b55-99d7-b5cb691eb312 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:09.396653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1419/2869] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:09.656571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678e478-10b6-4a52-ba49-e0c471bb90d4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:09.658044 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7678e478-10b6-4a52-ba49-e0c471bb90d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:09.671940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678e478-10b6-4a52-ba49-e0c471bb90d4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:09.676471 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:09.677143 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:09.677429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:09.677705 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] PATH_INFO: `/v3/projects/6c478b0cb4a342f285c31c92a08d1a30` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:09.678883 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c478b0cb4a342f285c31c92a08d1a30)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:09.680776 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:09.730496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c478b0cb4a342f285c31c92a08d1a30', 'request_id': 'req-a0c213d5-cb9a-45fb-841b-77dfcd255634'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.735946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c478b0cb4a342f285c31c92a08d1a30', 'request_id': 'req-a0c213d5-cb9a-45fb-841b-77dfcd255634'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.743225 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c478b0cb4a342f285c31c92a08d1a30', 'request_id': 'req-a0c213d5-cb9a-45fb-841b-77dfcd255634'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.754695 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] The token cache is being invalidate because project 6c478b0cb4a342f285c31c92a08d1a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:43:09.754949 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.755594 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.757096 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1451/2870] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:43:09 2022] DELETE /identity/v3/projects/6c478b0cb4a342f285c31c92a08d1a30 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:09.761521 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6da82-a757-4b55-99d7-b5cb691eb312 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:09.771106 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6da82-a757-4b55-99d7-b5cb691eb312 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:09.827121 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bfcd3-11d1-434d-9134-1cb7231445be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:09.827756 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bfcd3-11d1-434d-9134-1cb7231445be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:09.828035 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bfcd3-11d1-434d-9134-1cb7231445be admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:09.828306 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bfcd3-11d1-434d-9134-1cb7231445be admin admin] PATH_INFO: `/v3/users/8beb3012ffa246e2874a75a2d9a80a5f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:09.829489 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bfcd3-11d1-434d-9134-1cb7231445be admin admin] RBAC: Authorizing `identity:delete_user(user_id=8beb3012ffa246e2874a75a2d9a80a5f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:09.831380 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bfcd3-11d1-434d-9134-1cb7231445be admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:09.875958 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e28bfcd3-11d1-434d-9134-1cb7231445be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8beb3012ffa246e2874a75a2d9a80a5f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.882939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e28bfcd3-11d1-434d-9134-1cb7231445be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8beb3012ffa246e2874a75a2d9a80a5f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.894445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e28bfcd3-11d1-434d-9134-1cb7231445be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8beb3012ffa246e2874a75a2d9a80a5f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.895100 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e28bfcd3-11d1-434d-9134-1cb7231445be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8beb3012ffa246e2874a75a2d9a80a5f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.895696 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e28bfcd3-11d1-434d-9134-1cb7231445be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8beb3012ffa246e2874a75a2d9a80a5f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:09.903713 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:09.908942 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1420/2871] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:43:09 2022] DELETE /identity/v3/users/8beb3012ffa246e2874a75a2d9a80a5f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:10.189667 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:10.191588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:10.215839 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c213d5-cb9a-45fb-841b-77dfcd255634 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:10.261818 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:10.273275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c63b77-e59e-4e00-9f0c-a0cbad950340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:10.274127 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c63b77-e59e-4e00-9f0c-a0cbad950340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:10.274503 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c63b77-e59e-4e00-9f0c-a0cbad950340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:10.274962 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c63b77-e59e-4e00-9f0c-a0cbad950340 admin admin] PATH_INFO: `/v3/projects/cb8859aab8d240f18d43bc5cf459aed0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:10.276176 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c63b77-e59e-4e00-9f0c-a0cbad950340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb8859aab8d240f18d43bc5cf459aed0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:10.278764 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c63b77-e59e-4e00-9f0c-a0cbad950340 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:10.323461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-34c63b77-e59e-4e00-9f0c-a0cbad950340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8859aab8d240f18d43bc5cf459aed0', 'request_id': 'req-34c63b77-e59e-4e00-9f0c-a0cbad950340'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:10.328988 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-34c63b77-e59e-4e00-9f0c-a0cbad950340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8859aab8d240f18d43bc5cf459aed0', 'request_id': 'req-34c63b77-e59e-4e00-9f0c-a0cbad950340'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:10.337341 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-34c63b77-e59e-4e00-9f0c-a0cbad950340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8859aab8d240f18d43bc5cf459aed0', 'request_id': 'req-34c63b77-e59e-4e00-9f0c-a0cbad950340'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:10.349210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-34c63b77-e59e-4e00-9f0c-a0cbad950340 admin admin] The token cache is being invalidate because project cb8859aab8d240f18d43bc5cf459aed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:43:10.349502 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-34c63b77-e59e-4e00-9f0c-a0cbad950340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:10.350241 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-34c63b77-e59e-4e00-9f0c-a0cbad950340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:10.351731 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1452/2872] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:43:10 2022] DELETE /identity/v3/projects/cb8859aab8d240f18d43bc5cf459aed0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:10.360127 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a744c0-8ddf-4b91-9b87-ee8f7a3ba20b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:10.360607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a744c0-8ddf-4b91-9b87-ee8f7a3ba20b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:10.360707 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a744c0-8ddf-4b91-9b87-ee8f7a3ba20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:10.383708 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b5a744c0-8ddf-4b91-9b87-ee8f7a3ba20b None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:10.384921 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b5a744c0-8ddf-4b91-9b87-ee8f7a3ba20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:10.442373 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1421/2873] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:10.452275 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2d66d-c714-48cf-b1e6-de4bae348188 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:10.452543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2d66d-c714-48cf-b1e6-de4bae348188 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:10.452823 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2d66d-c714-48cf-b1e6-de4bae348188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:10.473105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9bd2d66d-c714-48cf-b1e6-de4bae348188 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:10.474315 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9bd2d66d-c714-48cf-b1e6-de4bae348188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:10.482187 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1453/2874] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:10.486285 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a744c0-8ddf-4b91-9b87-ee8f7a3ba20b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:10.495884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a744c0-8ddf-4b91-9b87-ee8f7a3ba20b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:10.500637 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a9dec-a0f0-4e77-92ca-321e5b61744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:10.501305 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a9dec-a0f0-4e77-92ca-321e5b61744a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:10.501590 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a9dec-a0f0-4e77-92ca-321e5b61744a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:10.501866 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a9dec-a0f0-4e77-92ca-321e5b61744a admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:10.502856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a9dec-a0f0-4e77-92ca-321e5b61744a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:43:10.503162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a9dec-a0f0-4e77-92ca-321e5b61744a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:10.504745 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a9dec-a0f0-4e77-92ca-321e5b61744a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:10.517328 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1422/2875] 10.222.0.15 () {58 vars in 1153 bytes} [Sat Aug 6 01:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:43:10.521186 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2d66d-c714-48cf-b1e6-de4bae348188 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:10.531099 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2d66d-c714-48cf-b1e6-de4bae348188 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:10.535777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd1de9-d558-4e98-9bce-80104acae1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:10.536380 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd1de9-d558-4e98-9bce-80104acae1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:10.536665 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd1de9-d558-4e98-9bce-80104acae1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:10.536970 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd1de9-d558-4e98-9bce-80104acae1a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:10.537649 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd1de9-d558-4e98-9bce-80104acae1a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:10.539537 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd1de9-d558-4e98-9bce-80104acae1a7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:10.566171 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1454/2876] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:43:10 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:43:10.570354 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a9dec-a0f0-4e77-92ca-321e5b61744a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:10.580814 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a9dec-a0f0-4e77-92ca-321e5b61744a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:10.635055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134a355-bf62-4b69-87d5-a5bd00081c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:10.635659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a355-bf62-4b69-87d5-a5bd00081c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:10.635939 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a355-bf62-4b69-87d5-a5bd00081c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:10.636763 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a355-bf62-4b69-87d5-a5bd00081c08 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:10.637462 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134a355-bf62-4b69-87d5-a5bd00081c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:10.639345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134a355-bf62-4b69-87d5-a5bd00081c08 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:10.660662 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1423/2877] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:43:10 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:43:10.664760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd1de9-d558-4e98-9bce-80104acae1a7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:10.675381 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd1de9-d558-4e98-9bce-80104acae1a7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:10.679933 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6decac2-6c2a-4f0d-b511-66deb6067951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:10.680541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6decac2-6c2a-4f0d-b511-66deb6067951 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:10.680828 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6decac2-6c2a-4f0d-b511-66deb6067951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:10.681140 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6decac2-6c2a-4f0d-b511-66deb6067951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:10.681838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6decac2-6c2a-4f0d-b511-66deb6067951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:10.683448 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6decac2-6c2a-4f0d-b511-66deb6067951 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:10.693306 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1455/2878] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:43:10.696934 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134a355-bf62-4b69-87d5-a5bd00081c08 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:10.707356 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134a355-bf62-4b69-87d5-a5bd00081c08 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:10.711925 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf9abb-95fa-4d8a-8df7-0d15ee57a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:10.712519 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf9abb-95fa-4d8a-8df7-0d15ee57a5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:10.712802 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf9abb-95fa-4d8a-8df7-0d15ee57a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:10.713111 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf9abb-95fa-4d8a-8df7-0d15ee57a5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:10.713799 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf9abb-95fa-4d8a-8df7-0d15ee57a5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:10.716018 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf9abb-95fa-4d8a-8df7-0d15ee57a5e8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:10.726382 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1424/2879] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:43:10.730595 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6decac2-6c2a-4f0d-b511-66deb6067951 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:10.740488 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6decac2-6c2a-4f0d-b511-66deb6067951 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:10.745163 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4eeafb-d538-42ce-8efb-67be169d247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:10.745847 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4eeafb-d538-42ce-8efb-67be169d247d admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:10.746131 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4eeafb-d538-42ce-8efb-67be169d247d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:10.746411 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4eeafb-d538-42ce-8efb-67be169d247d admin admin] PATH_INFO: `/v3/projects/66ed0f585a694d5ba5add5afd0b3566c/users/2946dea40fb2408abd2b9a00c762f99a/roles/102380322b574754b40ec23fe0394401` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:10.760838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4eeafb-d538-42ce-8efb-67be169d247d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ed0f585a694d5ba5add5afd0b3566c, user_id=2946dea40fb2408abd2b9a00c762f99a, role_id=102380322b574754b40ec23fe0394401)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:10.764398 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4eeafb-d538-42ce-8efb-67be169d247d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:10.778093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1456/2880] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:43:10 2022] PUT /identity/v3/projects/66ed0f585a694d5ba5add5afd0b3566c/users/2946dea40fb2408abd2b9a00c762f99a/roles/102380322b574754b40ec23fe0394401 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:10.782965 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f4c37-1ec1-4591-87b2-ef681b389274 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:10.783255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f4c37-1ec1-4591-87b2-ef681b389274 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:10.783532 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f4c37-1ec1-4591-87b2-ef681b389274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:10.802196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b46f4c37-1ec1-4591-87b2-ef681b389274 None None] MFA Rules not processed for user `44865c547348438e8c2b72709661a2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:10.803388 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b46f4c37-1ec1-4591-87b2-ef681b389274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:10.861983 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1425/2881] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:10.872345 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4eeafb-d538-42ce-8efb-67be169d247d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:10.874151 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ae4eeafb-d538-42ce-8efb-67be169d247d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:10.930643 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4eeafb-d538-42ce-8efb-67be169d247d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:10.934763 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eadfb-bad4-4038-8428-166cb1925d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:10.935370 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eadfb-bad4-4038-8428-166cb1925d4f service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:10.935652 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eadfb-bad4-4038-8428-166cb1925d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:10.935925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eadfb-bad4-4038-8428-166cb1925d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:10.944788 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3eadfb-bad4-4038-8428-166cb1925d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:10.946228 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3eadfb-bad4-4038-8428-166cb1925d4f service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:10.955971 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1457/2882] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:14.912945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d8f5f-4723-4151-8782-91d52af92a4a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:14.913470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d8f5f-4723-4151-8782-91d52af92a4a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:14.913664 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d8f5f-4723-4151-8782-91d52af92a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:14.923488 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:14.943641 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-827d8f5f-4723-4151-8782-91d52af92a4a None None] MFA Rules not processed for user `2946dea40fb2408abd2b9a00c762f99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:14.944868 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-827d8f5f-4723-4151-8782-91d52af92a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:15.014077 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1426/2883] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:43:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:15.018557 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eadfb-bad4-4038-8428-166cb1925d4f service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:15.028291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eadfb-bad4-4038-8428-166cb1925d4f service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:15.032808 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08651011-d439-46d8-ad13-77d26ffc9955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:15.033470 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08651011-d439-46d8-ad13-77d26ffc9955 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:15.033749 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08651011-d439-46d8-ad13-77d26ffc9955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:15.034021 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08651011-d439-46d8-ad13-77d26ffc9955 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:15.034691 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08651011-d439-46d8-ad13-77d26ffc9955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:15.036571 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08651011-d439-46d8-ad13-77d26ffc9955 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:15.056712 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:15.066543 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1458/2884] 10.222.0.15 () {60 vars in 1153 bytes} [Sat Aug 6 01:43:15 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:43:15.070639 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d8f5f-4723-4151-8782-91d52af92a4a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:15.081682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d8f5f-4723-4151-8782-91d52af92a4a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:15.137629 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84617d4d-7ece-4c93-a065-6abcef238983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:15.138198 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84617d4d-7ece-4c93-a065-6abcef238983 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:15.138484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84617d4d-7ece-4c93-a065-6abcef238983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:15.138760 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84617d4d-7ece-4c93-a065-6abcef238983 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:15.139435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84617d4d-7ece-4c93-a065-6abcef238983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:15.141397 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84617d4d-7ece-4c93-a065-6abcef238983 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:15.162162 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1427/2885] 10.222.0.15 () {60 vars in 1144 bytes} [Sat Aug 6 01:43:15 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:43:15.166073 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08651011-d439-46d8-ad13-77d26ffc9955 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:15.176520 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08651011-d439-46d8-ad13-77d26ffc9955 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:15.181115 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada3208-9e1b-4e26-832c-86edf8854619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:15.181716 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3208-9e1b-4e26-832c-86edf8854619 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:15.181995 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3208-9e1b-4e26-832c-86edf8854619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:15.182266 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3208-9e1b-4e26-832c-86edf8854619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:15.182956 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada3208-9e1b-4e26-832c-86edf8854619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:15.184529 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada3208-9e1b-4e26-832c-86edf8854619 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:15.196452 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1459/2886] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:43:15.201213 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84617d4d-7ece-4c93-a065-6abcef238983 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:15.211675 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84617d4d-7ece-4c93-a065-6abcef238983 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:15.217190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702975f6-1b22-4433-8965-57a180f36659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:15.217856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702975f6-1b22-4433-8965-57a180f36659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:15.218176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702975f6-1b22-4433-8965-57a180f36659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:15.218455 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702975f6-1b22-4433-8965-57a180f36659 admin admin] PATH_INFO: `/v3/projects/d3ac5e6908fc43c39bb7abc266bdaa57/users/e644ef1010284b5a84f804ae41c1c0e3/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:15.233448 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702975f6-1b22-4433-8965-57a180f36659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ac5e6908fc43c39bb7abc266bdaa57, user_id=e644ef1010284b5a84f804ae41c1c0e3, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:15.236153 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702975f6-1b22-4433-8965-57a180f36659 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:15.249182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1428/2887] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:43:15 2022] PUT /identity/v3/projects/d3ac5e6908fc43c39bb7abc266bdaa57/users/e644ef1010284b5a84f804ae41c1c0e3/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:15.253300 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada3208-9e1b-4e26-832c-86edf8854619 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:15.263760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada3208-9e1b-4e26-832c-86edf8854619 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:15.319042 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760ba96-e3b1-4807-93dd-bc2ffd20f0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:15.319660 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760ba96-e3b1-4807-93dd-bc2ffd20f0af admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:15.319946 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760ba96-e3b1-4807-93dd-bc2ffd20f0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:15.320226 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760ba96-e3b1-4807-93dd-bc2ffd20f0af admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:15.320952 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760ba96-e3b1-4807-93dd-bc2ffd20f0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:15.322542 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760ba96-e3b1-4807-93dd-bc2ffd20f0af admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:15.332928 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1460/2888] 10.222.0.15 () {58 vars in 1122 bytes} [Sat Aug 6 01:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:43:15.337136 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702975f6-1b22-4433-8965-57a180f36659 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:15.347286 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702975f6-1b22-4433-8965-57a180f36659 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:15.351815 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8262da-c02e-4f8e-9a05-3dea862ad9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:15.352458 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8262da-c02e-4f8e-9a05-3dea862ad9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:15.352736 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8262da-c02e-4f8e-9a05-3dea862ad9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:15.353041 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8262da-c02e-4f8e-9a05-3dea862ad9f6 admin admin] PATH_INFO: `/v3/projects/d3ac5e6908fc43c39bb7abc266bdaa57/users/e644ef1010284b5a84f804ae41c1c0e3/roles/5a6ea74454b34ab3893038b7fe523d18` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:15.355051 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8262da-c02e-4f8e-9a05-3dea862ad9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ac5e6908fc43c39bb7abc266bdaa57, user_id=e644ef1010284b5a84f804ae41c1c0e3, role_id=5a6ea74454b34ab3893038b7fe523d18)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:15.357653 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8262da-c02e-4f8e-9a05-3dea862ad9f6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:15.367811 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1429/2889] 10.222.0.15 () {60 vars in 1483 bytes} [Sat Aug 6 01:43:15 2022] PUT /identity/v3/projects/d3ac5e6908fc43c39bb7abc266bdaa57/users/e644ef1010284b5a84f804ae41c1c0e3/roles/5a6ea74454b34ab3893038b7fe523d18 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:19.742588 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b89fb1-0e45-4521-bbfa-42c57f187ae7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:19.743149 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b89fb1-0e45-4521-bbfa-42c57f187ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:19.743149 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b89fb1-0e45-4521-bbfa-42c57f187ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:19.778024 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d8b89fb1-0e45-4521-bbfa-42c57f187ae7 None None] MFA Rules not processed for user `e644ef1010284b5a84f804ae41c1c0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:19.779426 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d8b89fb1-0e45-4521-bbfa-42c57f187ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:19.861295 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1461/2890] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:43:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:19.875190 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8262da-c02e-4f8e-9a05-3dea862ad9f6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:19.877638 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9d8262da-c02e-4f8e-9a05-3dea862ad9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:19.941938 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:19.949485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8262da-c02e-4f8e-9a05-3dea862ad9f6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:19.954927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb79112-6b16-4c58-8033-1314cb1d71cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da39170a654d4d52a39b4b2c8cfd8906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:19.956010 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb79112-6b16-4c58-8033-1314cb1d71cf service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:19.956645 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb79112-6b16-4c58-8033-1314cb1d71cf service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:19.958473 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb79112-6b16-4c58-8033-1314cb1d71cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:20.023197 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb79112-6b16-4c58-8033-1314cb1d71cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:20.024667 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb79112-6b16-4c58-8033-1314cb1d71cf service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:20.035476 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1430/2891] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:20.184081 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b057b82-ea60-4205-afdc-d4bf8c2acc29 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:20.184449 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b057b82-ea60-4205-afdc-d4bf8c2acc29 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:20.184812 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b057b82-ea60-4205-afdc-d4bf8c2acc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:20.237382 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2b057b82-ea60-4205-afdc-d4bf8c2acc29 None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:20.238582 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2b057b82-ea60-4205-afdc-d4bf8c2acc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:20.282351 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:20.310342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1462/2892] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:43:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:20.359659 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb79112-6b16-4c58-8033-1314cb1d71cf service glance] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:20.370869 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4cb79112-6b16-4c58-8033-1314cb1d71cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:20.460732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb79112-6b16-4c58-8033-1314cb1d71cf service glance] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:20.466054 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3e005-02f9-466d-add1-f6866c838b7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:20.466677 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3e005-02f9-466d-add1-f6866c838b7f service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:20.466964 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3e005-02f9-466d-add1-f6866c838b7f service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:20.467261 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3e005-02f9-466d-add1-f6866c838b7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:20.475613 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3e005-02f9-466d-add1-f6866c838b7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:20.477223 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3e005-02f9-466d-add1-f6866c838b7f service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:20.486841 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1431/2893] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:43:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:43:28.891147 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc42e2-99b6-4863-acdc-f414bf3c5598 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:28.891708 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc42e2-99b6-4863-acdc-f414bf3c5598 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:28.891708 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc42e2-99b6-4863-acdc-f414bf3c5598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:28.910201 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e4fc42e2-99b6-4863-acdc-f414bf3c5598 None None] MFA Rules not processed for user `2946dea40fb2408abd2b9a00c762f99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:28.911375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e4fc42e2-99b6-4863-acdc-f414bf3c5598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:28.918368 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1463/2894] 10.222.0.15 () {58 vars in 958 bytes} [Sat Aug 6 01:43:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:28.958394 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3e005-02f9-466d-add1-f6866c838b7f service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:28.968038 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3e005-02f9-466d-add1-f6866c838b7f service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:28.971580 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac8faa-b43b-4a87-ac53-758d32c6d243 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da39170a654d4d52a39b4b2c8cfd8906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:28.972170 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac8faa-b43b-4a87-ac53-758d32c6d243 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:28.972447 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac8faa-b43b-4a87-ac53-758d32c6d243 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:28.972719 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac8faa-b43b-4a87-ac53-758d32c6d243 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:28.974445 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-66ac8faa-b43b-4a87-ac53-758d32c6d243 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:29.043233 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:29.045682 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac8faa-b43b-4a87-ac53-758d32c6d243 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:29.047478 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac8faa-b43b-4a87-ac53-758d32c6d243 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:29.059545 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1432/2895] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:29.602167 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc42e2-99b6-4863-acdc-f414bf3c5598 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:29.603735 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e4fc42e2-99b6-4863-acdc-f414bf3c5598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:29.624985 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac8faa-b43b-4a87-ac53-758d32c6d243 service glance] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:29.675161 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc42e2-99b6-4863-acdc-f414bf3c5598 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:29.681079 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e84a5b-9faa-4dab-a3e1-a3d8cb50e754 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:29.681706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84a5b-9faa-4dab-a3e1-a3d8cb50e754 service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:29.683235 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84a5b-9faa-4dab-a3e1-a3d8cb50e754 service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:29.683559 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e84a5b-9faa-4dab-a3e1-a3d8cb50e754 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:29.684034 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac8faa-b43b-4a87-ac53-758d32c6d243 service glance] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:29.685375 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-52e84a5b-9faa-4dab-a3e1-a3d8cb50e754 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:29.687652 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae0bb7-c8a2-4679-88d5-d75fcb1153f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:29.688269 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae0bb7-c8a2-4679-88d5-d75fcb1153f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:29.688552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae0bb7-c8a2-4679-88d5-d75fcb1153f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:29.688833 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae0bb7-c8a2-4679-88d5-d75fcb1153f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:29.691312 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e2ae0bb7-c8a2-4679-88d5-d75fcb1153f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:29.699389 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e84a5b-9faa-4dab-a3e1-a3d8cb50e754 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:29.701062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e84a5b-9faa-4dab-a3e1-a3d8cb50e754 service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:29.707046 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae0bb7-c8a2-4679-88d5-d75fcb1153f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:29.708496 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae0bb7-c8a2-4679-88d5-d75fcb1153f9 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:29.712579 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1464/2896] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:29.722706 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1433/2897] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:43:30.991121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5248143-c75c-4e9c-8e4c-5286094325e5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:30.991655 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5248143-c75c-4e9c-8e4c-5286094325e5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:30.991770 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5248143-c75c-4e9c-8e4c-5286094325e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:31.013227 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b5248143-c75c-4e9c-8e4c-5286094325e5 None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:43:31.014342 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b5248143-c75c-4e9c-8e4c-5286094325e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:31.021485 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1465/2898] 10.222.0.15 () {58 vars in 1009 bytes} [Sat Aug 6 01:43:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:43:31.033978 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae0bb7-c8a2-4679-88d5-d75fcb1153f9 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:31.046134 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae0bb7-c8a2-4679-88d5-d75fcb1153f9 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:31.051164 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc9b5-308f-42ca-acd9-7ac0b5c1c3f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:31.051776 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc9b5-308f-42ca-acd9-7ac0b5c1c3f8 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:31.052055 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc9b5-308f-42ca-acd9-7ac0b5c1c3f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:31.052330 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc9b5-308f-42ca-acd9-7ac0b5c1c3f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:31.061850 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fc9b5-308f-42ca-acd9-7ac0b5c1c3f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:31.063422 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fc9b5-308f-42ca-acd9-7ac0b5c1c3f8 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:31.072181 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1434/2899] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:43:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:43:32.515563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5248143-c75c-4e9c-8e4c-5286094325e5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:32.519082 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b5248143-c75c-4e9c-8e4c-5286094325e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:32.534632 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5248143-c75c-4e9c-8e4c-5286094325e5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:32.538400 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1eca0-6c7b-4319-91fc-a3048f5ddc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:32.539059 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1eca0-6c7b-4319-91fc-a3048f5ddc88 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:32.539349 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1eca0-6c7b-4319-91fc-a3048f5ddc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:32.539626 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1eca0-6c7b-4319-91fc-a3048f5ddc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:32.541530 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-53e1eca0-6c7b-4319-91fc-a3048f5ddc88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:32.615446 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1eca0-6c7b-4319-91fc-a3048f5ddc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:32.616925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1eca0-6c7b-4319-91fc-a3048f5ddc88 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:32.627726 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1466/2900] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:41.068281 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=34 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:41.591484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc9b5-308f-42ca-acd9-7ac0b5c1c3f8 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:41.602309 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc9b5-308f-42ca-acd9-7ac0b5c1c3f8 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:41.606332 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ffac5-849a-4063-a4bf-415e561312f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:41.606951 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ffac5-849a-4063-a4bf-415e561312f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:41.607435 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ffac5-849a-4063-a4bf-415e561312f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:41.607563 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ffac5-849a-4063-a4bf-415e561312f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:41.609345 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-414ffac5-849a-4063-a4bf-415e561312f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:41.619738 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ffac5-849a-4063-a4bf-415e561312f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:41.621735 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ffac5-849a-4063-a4bf-415e561312f7 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:41.630744 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1435/2901] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:42.622824 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=75 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:43.377135 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1eca0-6c7b-4319-91fc-a3048f5ddc88 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:43.378986 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-53e1eca0-6c7b-4319-91fc-a3048f5ddc88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:43.411729 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1eca0-6c7b-4319-91fc-a3048f5ddc88 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:43.419051 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a43d7-095e-484c-bfaf-d1f78c18b33e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:43.419778 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a43d7-095e-484c-bfaf-d1f78c18b33e service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:43.420121 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a43d7-095e-484c-bfaf-d1f78c18b33e service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:43.420493 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a43d7-095e-484c-bfaf-d1f78c18b33e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:43.422392 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bb3a43d7-095e-484c-bfaf-d1f78c18b33e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:43.437566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a43d7-095e-484c-bfaf-d1f78c18b33e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:43.439205 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a43d7-095e-484c-bfaf-d1f78c18b33e service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:43.451915 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1467/2902] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:47.216996 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ffac5-849a-4063-a4bf-415e561312f7 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:47.226566 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ffac5-849a-4063-a4bf-415e561312f7 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:47.230808 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168b07b-e9e9-4bb4-a381-b354cb821eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:47.231552 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168b07b-e9e9-4bb4-a381-b354cb821eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:47.231832 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168b07b-e9e9-4bb4-a381-b354cb821eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:47.232104 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168b07b-e9e9-4bb4-a381-b354cb821eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:47.234163 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b168b07b-e9e9-4bb4-a381-b354cb821eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:47.303771 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168b07b-e9e9-4bb4-a381-b354cb821eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:47.305258 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168b07b-e9e9-4bb4-a381-b354cb821eb9 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:47.316665 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1436/2903] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:48.798794 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a43d7-095e-484c-bfaf-d1f78c18b33e service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:48.800430 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bb3a43d7-095e-484c-bfaf-d1f78c18b33e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:48.818650 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a43d7-095e-484c-bfaf-d1f78c18b33e service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:48.825925 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7274dbb-03ca-4c3b-bc65-71ee45ce729f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:48.826941 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7274dbb-03ca-4c3b-bc65-71ee45ce729f service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:48.827336 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7274dbb-03ca-4c3b-bc65-71ee45ce729f service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:48.827686 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7274dbb-03ca-4c3b-bc65-71ee45ce729f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:48.829904 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f7274dbb-03ca-4c3b-bc65-71ee45ce729f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:48.845019 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7274dbb-03ca-4c3b-bc65-71ee45ce729f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:48.847248 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7274dbb-03ca-4c3b-bc65-71ee45ce729f service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:48.861347 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1468/2904] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:43:54.113908 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168b07b-e9e9-4bb4-a381-b354cb821eb9 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:54.116280 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b168b07b-e9e9-4bb4-a381-b354cb821eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:54.132426 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168b07b-e9e9-4bb4-a381-b354cb821eb9 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:54.138151 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:54.138764 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:54.139043 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:54.139319 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] PATH_INFO: `/v3/users/60b46017e2d24b0c89ba54ba610d59fd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:54.140509 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b46017e2d24b0c89ba54ba610d59fd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:54.142485 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:54.194997 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b46017e2d24b0c89ba54ba610d59fd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.205927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b46017e2d24b0c89ba54ba610d59fd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.222899 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b46017e2d24b0c89ba54ba610d59fd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.223673 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b46017e2d24b0c89ba54ba610d59fd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.224685 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b46017e2d24b0c89ba54ba610d59fd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.244940 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1437/2905] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:43:54 2022] DELETE /identity/v3/users/60b46017e2d24b0c89ba54ba610d59fd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:54.439481 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7274dbb-03ca-4c3b-bc65-71ee45ce729f service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:54.451706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7274dbb-03ca-4c3b-bc65-71ee45ce729f service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:54.511394 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:54.512170 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:54.512454 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:54.512738 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] PATH_INFO: `/v3/projects/e0147db6e37944e19652505e1117da64` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:54.513940 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0147db6e37944e19652505e1117da64)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:54.516016 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:54.565564 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0147db6e37944e19652505e1117da64', 'request_id': 'req-275eea16-37ff-4e3a-ada6-eee0c112a6c6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.571058 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0147db6e37944e19652505e1117da64', 'request_id': 'req-275eea16-37ff-4e3a-ada6-eee0c112a6c6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.578207 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0147db6e37944e19652505e1117da64', 'request_id': 'req-275eea16-37ff-4e3a-ada6-eee0c112a6c6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.589998 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] The token cache is being invalidate because project e0147db6e37944e19652505e1117da64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:43:54.590283 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.590921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.592468 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1469/2906] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:43:54 2022] DELETE /identity/v3/projects/e0147db6e37944e19652505e1117da64 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:54.596499 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:54.597919 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:54.611570 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72490378-0c0b-491d-bf25-629b7b517ced admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:54.659856 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:54.670451 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:54.671107 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:54.671538 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:54.671994 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] PATH_INFO: `/v3/users/2a153113326340218a5e398a6caa3cb5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:54.673196 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a153113326340218a5e398a6caa3cb5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:54.675117 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:54.725263 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a153113326340218a5e398a6caa3cb5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.732333 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a153113326340218a5e398a6caa3cb5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.745956 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a153113326340218a5e398a6caa3cb5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.746879 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a153113326340218a5e398a6caa3cb5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.747481 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a153113326340218a5e398a6caa3cb5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:54.764216 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1438/2907] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:43:54 2022] DELETE /identity/v3/users/2a153113326340218a5e398a6caa3cb5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:43:54.949062 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:54.950678 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:54.963550 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eea16-37ff-4e3a-ada6-eee0c112a6c6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:55.027777 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:55.028429 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:55.028717 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:55.029023 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] PATH_INFO: `/v3/projects/0e101c722b974cedaea873a85546f594` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:55.030200 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e101c722b974cedaea873a85546f594)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:55.032101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:55.038653 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:55.082645 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e101c722b974cedaea873a85546f594', 'request_id': 'req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:55.088069 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e101c722b974cedaea873a85546f594', 'request_id': 'req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:55.095431 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e101c722b974cedaea873a85546f594', 'request_id': 'req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:55.106323 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] The token cache is being invalidate because project 0e101c722b974cedaea873a85546f594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:43:55.106604 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:55.107222 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:43:55.108692 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1470/2908] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:43:54 2022] DELETE /identity/v3/projects/0e101c722b974cedaea873a85546f594 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:43:56.658759 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:43:56.660182 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:56.717835 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467772c-5890-49c5-a9d9-e9fabe5a8256 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:43:56.765765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eecb6d-e28d-435c-9351-342d2bfe1ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '403beb9eb6c04cc69579361138bea12d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:43:56.766393 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eecb6d-e28d-435c-9351-342d2bfe1ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:43:56.766703 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eecb6d-e28d-435c-9351-342d2bfe1ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:43:56.766984 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eecb6d-e28d-435c-9351-342d2bfe1ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:43:56.768785 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-58eecb6d-e28d-435c-9351-342d2bfe1ef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:43:56.816557 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:43:56.838831 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eecb6d-e28d-435c-9351-342d2bfe1ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:43:56.840329 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eecb6d-e28d-435c-9351-342d2bfe1ef5 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:43:56.849660 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1439/2909] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:43:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:44:05.103318 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:44:06.845437 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=10 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:46:06.727583 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:46:06.729006 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:46:06.803087 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2eb0f-9ec4-4a8b-a37c-a19b607356db admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:46:06.808110 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba55d8-a591-4476-abdd-2783ce48562c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:46:06.808730 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba55d8-a591-4476-abdd-2783ce48562c service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:46:06.809111 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba55d8-a591-4476-abdd-2783ce48562c service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:46:06.809390 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba55d8-a591-4476-abdd-2783ce48562c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:46:06.811159 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b4ba55d8-a591-4476-abdd-2783ce48562c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:46:06.823502 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba55d8-a591-4476-abdd-2783ce48562c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:46:06.825093 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba55d8-a591-4476-abdd-2783ce48562c service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:46:06.835105 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1471/2910] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:46:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:46:16.830634 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=32 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:46:17.164602 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eecb6d-e28d-435c-9351-342d2bfe1ef5 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:46:17.166298 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-58eecb6d-e28d-435c-9351-342d2bfe1ef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:46:17.248049 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eecb6d-e28d-435c-9351-342d2bfe1ef5 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:46:17.254240 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f33e3-c319-4c0e-920e-446dbbe35da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666f4864832445d5a10d60f677f5cd6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:46:17.254896 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f33e3-c319-4c0e-920e-446dbbe35da2 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:46:17.255173 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f33e3-c319-4c0e-920e-446dbbe35da2 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:46:17.255449 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f33e3-c319-4c0e-920e-446dbbe35da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:46:17.257273 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-209f33e3-c319-4c0e-920e-446dbbe35da2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:46:17.271215 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f33e3-c319-4c0e-920e-446dbbe35da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:46:17.272762 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f33e3-c319-4c0e-920e-446dbbe35da2 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:46:17.284734 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1440/2911] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:46:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:46:25.380263 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcfe27-9c15-4fa8-993e-139e290046a6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:46:25.380734 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcfe27-9c15-4fa8-993e-139e290046a6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:46:25.380838 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcfe27-9c15-4fa8-993e-139e290046a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:46:25.400217 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-55fcfe27-9c15-4fa8-993e-139e290046a6 None None] MFA Rules not processed for user `f922f2209fff4986b04e1f0aaeb20fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:46:25.401461 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-55fcfe27-9c15-4fa8-993e-139e290046a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:46:25.455760 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1472/2912] 10.222.0.15 () {58 vars in 967 bytes} [Sat Aug 6 01:46:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:46:25.496370 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f33e3-c319-4c0e-920e-446dbbe35da2 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:46:25.497827 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-209f33e3-c319-4c0e-920e-446dbbe35da2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:46:25.565307 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f33e3-c319-4c0e-920e-446dbbe35da2 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:46:25.570927 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ec805-4fcb-4ba5-bf4d-bfda52ebabbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8d43b9ceeba432db6d141bb52d4bf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:46:25.571534 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ec805-4fcb-4ba5-bf4d-bfda52ebabbb service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:46:25.571813 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ec805-4fcb-4ba5-bf4d-bfda52ebabbb service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:46:25.572085 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ec805-4fcb-4ba5-bf4d-bfda52ebabbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:46:25.579945 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ec805-4fcb-4ba5-bf4d-bfda52ebabbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:46:25.581484 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ec805-4fcb-4ba5-bf4d-bfda52ebabbb service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:46:25.590113 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1441/2913] 10.222.0.15 () {60 vars in 1384 bytes} [Sat Aug 6 01:46:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:46:31.817070 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcfe27-9c15-4fa8-993e-139e290046a6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:46:31.829921 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcfe27-9c15-4fa8-993e-139e290046a6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:46:31.839136 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35bde1-2942-455c-b893-c9bf78a0cdab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:46:31.839746 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35bde1-2942-455c-b893-c9bf78a0cdab service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:46:31.840216 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35bde1-2942-455c-b893-c9bf78a0cdab service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:46:31.840496 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35bde1-2942-455c-b893-c9bf78a0cdab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:46:31.842415 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8a35bde1-2942-455c-b893-c9bf78a0cdab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:46:31.857436 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35bde1-2942-455c-b893-c9bf78a0cdab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:46:31.860028 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35bde1-2942-455c-b893-c9bf78a0cdab service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:46:31.873757 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1473/2914] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:46:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:46:31.881255 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ec805-4fcb-4ba5-bf4d-bfda52ebabbb service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:46:31.882543 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5e7ec805-4fcb-4ba5-bf4d-bfda52ebabbb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:46:31.950425 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ec805-4fcb-4ba5-bf4d-bfda52ebabbb service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:46:31.954839 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:46:31.955470 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:46:31.955765 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:46:31.956023 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] PATH_INFO: `/v3/users/2946dea40fb2408abd2b9a00c762f99a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:46:31.958045 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2946dea40fb2408abd2b9a00c762f99a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:46:31.960009 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:46:31.976743 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:46:32.005176 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2946dea40fb2408abd2b9a00c762f99a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.012490 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2946dea40fb2408abd2b9a00c762f99a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.025588 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2946dea40fb2408abd2b9a00c762f99a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.026325 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2946dea40fb2408abd2b9a00c762f99a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.026972 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2946dea40fb2408abd2b9a00c762f99a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.040422 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1442/2915] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:46:31 2022] DELETE /identity/v3/users/2946dea40fb2408abd2b9a00c762f99a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:46:32.214002 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35bde1-2942-455c-b893-c9bf78a0cdab service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:46:32.225289 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35bde1-2942-455c-b893-c9bf78a0cdab service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:46:32.282721 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:46:32.283355 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:46:32.283639 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:46:32.283915 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] PATH_INFO: `/v3/projects/66ed0f585a694d5ba5add5afd0b3566c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:46:32.285101 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ed0f585a694d5ba5add5afd0b3566c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:46:32.287353 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:46:32.332223 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ed0f585a694d5ba5add5afd0b3566c', 'request_id': 'req-8cd18883-f7ab-431d-92c8-151dfcadf1c4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.337599 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ed0f585a694d5ba5add5afd0b3566c', 'request_id': 'req-8cd18883-f7ab-431d-92c8-151dfcadf1c4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.345210 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ed0f585a694d5ba5add5afd0b3566c', 'request_id': 'req-8cd18883-f7ab-431d-92c8-151dfcadf1c4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.359339 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] The token cache is being invalidate because project 66ed0f585a694d5ba5add5afd0b3566c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:46:32.359890 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.360297 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.365683 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1474/2916] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:46:32 2022] DELETE /identity/v3/projects/66ed0f585a694d5ba5add5afd0b3566c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:46:32.366903 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:46:32.368568 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:46:32.382607 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787fc59-8d63-41a7-b879-52930cef2483 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:46:32.442672 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:46:32.443325 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:46:32.443608 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:46:32.443884 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] PATH_INFO: `/v3/users/e644ef1010284b5a84f804ae41c1c0e3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:46:32.445080 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e644ef1010284b5a84f804ae41c1c0e3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:46:32.446992 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:46:32.496587 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e644ef1010284b5a84f804ae41c1c0e3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.504578 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e644ef1010284b5a84f804ae41c1c0e3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.516464 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e644ef1010284b5a84f804ae41c1c0e3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.517174 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e644ef1010284b5a84f804ae41c1c0e3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.517773 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e644ef1010284b5a84f804ae41c1c0e3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.531027 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1443/2917] 10.222.0.15 () {58 vars in 1224 bytes} [Sat Aug 6 01:46:32 2022] DELETE /identity/v3/users/e644ef1010284b5a84f804ae41c1c0e3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:46:32.706156 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:46:32.708402 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:46:32.722668 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18883-f7ab-431d-92c8-151dfcadf1c4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:46:32.742563 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:46:32.782364 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1975e-ef8d-4294-a86d-292350d7d302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44865c547348438e8c2b72709661a2a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c0f4c0f88fe4deb812ff64ab95ac12c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:46:32.783025 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1975e-ef8d-4294-a86d-292350d7d302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:46:32.783291 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1975e-ef8d-4294-a86d-292350d7d302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:46:32.783566 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1975e-ef8d-4294-a86d-292350d7d302 admin admin] PATH_INFO: `/v3/projects/d3ac5e6908fc43c39bb7abc266bdaa57` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:46:32.784715 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1975e-ef8d-4294-a86d-292350d7d302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ac5e6908fc43c39bb7abc266bdaa57)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:46:32.786677 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1975e-ef8d-4294-a86d-292350d7d302 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:46:32.831706 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b4e1975e-ef8d-4294-a86d-292350d7d302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ac5e6908fc43c39bb7abc266bdaa57', 'request_id': 'req-b4e1975e-ef8d-4294-a86d-292350d7d302'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.837249 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b4e1975e-ef8d-4294-a86d-292350d7d302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ac5e6908fc43c39bb7abc266bdaa57', 'request_id': 'req-b4e1975e-ef8d-4294-a86d-292350d7d302'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.844423 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b4e1975e-ef8d-4294-a86d-292350d7d302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ac5e6908fc43c39bb7abc266bdaa57', 'request_id': 'req-b4e1975e-ef8d-4294-a86d-292350d7d302'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.855246 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b4e1975e-ef8d-4294-a86d-292350d7d302 admin admin] The token cache is being invalidate because project d3ac5e6908fc43c39bb7abc266bdaa57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:46:32.855541 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b4e1975e-ef8d-4294-a86d-292350d7d302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.856168 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b4e1975e-ef8d-4294-a86d-292350d7d302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:46:32.857741 dv-cinder-852009-1-smb devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1475/2918] 10.222.0.15 () {58 vars in 1233 bytes} [Sat Aug 6 01:46:32 2022] DELETE /identity/v3/projects/d3ac5e6908fc43c39bb7abc266bdaa57 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:46:42.527463 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=19,keystone:SELECT=73,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:46:42.852251 dv-cinder-852009-1-smb devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:51:09.767583 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:51:09.769008 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:51:09.905804 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedf659-44d1-4ffb-8963-2221c51f544b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:51:09.963824 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d848298-7e4a-42c7-a6cf-a4839a5179e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc1bd453c1114da4a5d9aa543bf1ff32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c344ed6bac754173af05207b5f444dca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:51:09.964448 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d848298-7e4a-42c7-a6cf-a4839a5179e2 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:51:09.964732 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d848298-7e4a-42c7-a6cf-a4839a5179e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:51:09.965039 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d848298-7e4a-42c7-a6cf-a4839a5179e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:51:09.966809 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0d848298-7e4a-42c7-a6cf-a4839a5179e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:51:09.977853 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d848298-7e4a-42c7-a6cf-a4839a5179e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:51:09.980250 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d848298-7e4a-42c7-a6cf-a4839a5179e2 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:51:09.990116 dv-cinder-852009-1-smb devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1444/2919] 10.222.0.15 () {60 vars in 1365 bytes} [Sat Aug 6 01:51:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:51:19.985961 dv-cinder-852009-1-smb devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}